HITFRobot / Happy Spiders
🔧 🔩 🔨 收集整理了爬虫相关的工具、模拟登陆技术、代理IP、scrapy模板代码等内容。
Stars: ✭ 261
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to Happy Spiders
zeekEye
A Fast and Powerful Scraping and Web Crawling Framework.
Stars: ✭ 36 (-86.21%)
Mutual labels: spider, weibo
scrapy-distributed
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Stars: ✭ 38 (-85.44%)
Mutual labels: spider, scrapy
python-spider
python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答
Stars: ✭ 45 (-82.76%)
Mutual labels: spider, scrapy
elves
🎊 Design and implement of lightweight crawler framework.
Stars: ✭ 322 (+23.37%)
Mutual labels: spider, scrapy
PttImageSpider
PTT 圖片下載器 (抓取整個看板的圖片，並用文章標題作為資料夾的名稱 ) (使用Scrapy)
Stars: ✭ 16 (-93.87%)
Mutual labels: spider, scrapy
OpenScraper
An open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (-69.35%)
Mutual labels: spider, scrapy
photo-spider-scrapy
10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码
Stars: ✭ 17 (-93.49%)
Mutual labels: spider, scrapy
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-91.57%)
Mutual labels: spider, scrapy
weibo topic
微博话题关键词,个人微博采集, 微博博文一键删除 selenium获取cookie,requests处理
Stars: ✭ 28 (-89.27%)
Mutual labels: spider, weibo
模板代码📄爬虫工具🔧相关文档📚模拟登陆🔓IP代理池🌐
快速导航
- scrapy_templates——基于scrapy框架编写的，爬取各大主流网站的模板代码。
- tools——爬虫涉及到的相关工具。
- documents——爬虫知识相关的文档和书籍。
- login——模拟登陆。
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].