GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → suyuanhxx → crawler

suyuanhxx / crawler

Licence: other
爬取tumblr关注博主图片

Programming Languages

go
31211 projects - #10 most used programming language

Labels

crawlertumblr

Projects that are alternatives of or similar to crawler

Tumblr crawler
tumblr解析网站
Stars: ✭ 83 (+196.43%)
Mutual labels:  tumblr
Tumblthree
A Tumblr Backup Application
Stars: ✭ 211 (+653.57%)
Mutual labels:  tumblr
tumblr-likes
Command-line program that downloads liked posts from Tumblr.
Stars: ✭ 37 (+32.14%)
Mutual labels:  tumblr
Python Tumblpy
A Python Library to interface with Tumblr v2 REST API & OAuth
Stars: ✭ 126 (+350%)
Mutual labels:  tumblr
Media Scraper
Scrapes all photos and videos in a web page / Instagram / Twitter / Tumblr / Reddit / pixiv / TikTok
Stars: ✭ 206 (+635.71%)
Mutual labels:  tumblr
Reaper
Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs
Stars: ✭ 240 (+757.14%)
Mutual labels:  tumblr
Tumblr Liked Photos Export
Export the photos from your liked posts in tumblr
Stars: ✭ 74 (+164.29%)
Mutual labels:  tumblr
tumblr-to-ghost
Tumblr exporter to Ghost importer
Stars: ✭ 26 (-7.14%)
Mutual labels:  tumblr
Ripme
Downloads albums in bulk
Stars: ✭ 2,748 (+9714.29%)
Mutual labels:  tumblr
trans girls rule the world
Code for transgirlsruletheworld.tumblr.com
Stars: ✭ 11 (-60.71%)
Mutual labels:  tumblr
Yuki
❄️ Responsive masonry style theme for Tumblr.
Stars: ✭ 134 (+378.57%)
Mutual labels:  tumblr
Postwill
Posting to the most popular social media from Ruby
Stars: ✭ 181 (+546.43%)
Mutual labels:  tumblr
Awesome crawl
腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等
Stars: ✭ 246 (+778.57%)
Mutual labels:  tumblr
Socialcounters
jQuery/PHP - Collection of Social Media APIs that display number of your social media fans. Facebook Likes, Twitter Followers, Instagram Followers, YouTube Subscribers, etc..
Stars: ✭ 104 (+271.43%)
Mutual labels:  tumblr
finduntaggedtumblrposts.com
A site for finding untagged Tumblr posts
Stars: ✭ 24 (-14.29%)
Mutual labels:  tumblr
Tumblr backup
A Python script for saving your Tumblr blog to your hard drive as HTML or CSV.
Stars: ✭ 80 (+185.71%)
Mutual labels:  tumblr
Annie
👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+58360.71%)
Mutual labels:  tumblr
lux
👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 19,266 (+68707.14%)
Mutual labels:  tumblr
Loglr
A project to enable 'Login using Tumblr' a breeze.
Stars: ✭ 18 (-35.71%)
Mutual labels:  tumblr
vue-socials
💬 Social media share buttons and counts for Vue.js
Stars: ✭ 32 (+14.29%)
Mutual labels:  tumblr
View All Similar Projects ➔

golang tumblr爬虫

  1. 在sites.txt中添加指定tumblr主页，比如http://allthingseurope.tumblr.com/只需要添加allthingseurope
  2. 多条分行添加
  3. 代理，默认使用本地代理127.0.0.1:1080端口代理。如需修改请将common/proxyHttp.go中的127.0.0.1:1080改成自己代理。
  4. 目前已完成图片和视频的下载
  5. 采用channel控制并发，goroutine有点少，下载速度一般
  6. 代码进一步优化，修复空指针问题
  7. 已采用waitGroup控制并发，最大程度开启goroutine，下载速度飞快，但一般情况下会将机器直接卡死......
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].