AbotxCross Platform C# Web crawler framework, headless browser, parallel crawler. Please star this project! +1.
Stars: ✭ 63 (-27.59%)
Creeper🐾 Creeper - The Next Generation Crawler Framework (Go)
Stars: ✭ 762 (+775.86%)
Python crawlerIt's designed to be a simple, tiny, pratical python crawler using json and sqlite instead of mysql or mongdb. The destination website is Zhihu.com.
Stars: ✭ 45 (-48.28%)
Zheye者也 - 知乎 倒立的文字 汉字验证码识别程序
Stars: ✭ 750 (+762.07%)
Image DownloaderDownload images from Google, Bing, Baidu. 谷歌、百度、必应图片下载.
Stars: ✭ 1,173 (+1248.28%)
WindowimageviewAn ImageView display in RecyclerView, looks like window.
Stars: ✭ 699 (+703.45%)
FbiwarningNode.js seed downloader (Node.js 种子神器)
Stars: ✭ 44 (-49.43%)
Grab SiteThe archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Stars: ✭ 680 (+681.61%)
T66y spiderPython多线程下载 草榴(t66y.com) 网站【新時代的我們】和【達蓋爾的旗幟】两个板块帖子内的图片
Stars: ✭ 62 (-28.74%)
Fuck Login模拟登录一些知名的网站，为了方便爬取需要登录的网站
Stars: ✭ 5,729 (+6485.06%)
AvbookAV 电影管理系统， avmoo , javbus , javlibrary 爬虫，线上 AV 影片图书馆，AV 磁力链接数据库，Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database
Stars: ✭ 8,133 (+9248.28%)
Lizard💐 Full Amazon Automatic Download
Stars: ✭ 41 (-52.87%)
Istock👉一个基于spring boot 实现的java股票爬虫(仅支持A股)，如果你❤️请⭐️ . V2升级版正在开发中！
Stars: ✭ 622 (+614.94%)
Test demoTesting Using Python Demo. 使用Python测试脚本demo。
Stars: ✭ 60 (-31.03%)
InfospiderINFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。
Stars: ✭ 5,984 (+6778.16%)
Domain hunterA Burp Suite Extension that try to find all sub-domain, similar-domain and related-domain of an organization automatically! 基于流量自动收集整个企业或组织的子域名、相似域名、相关域名的burp插件
Stars: ✭ 594 (+582.76%)
TspiderYet Another Web Spider
Stars: ✭ 70 (-19.54%)
NewcrawlerFree Web Scraping Tool with Java
Stars: ✭ 589 (+577.01%)
Zhihuapi PyUnofficial API for zhihu.
Stars: ✭ 39 (-55.17%)
NetdiscoveryNetDiscovery 是一款基于 Vert.x、RxJava 2 等框架实现的通用爬虫框架/中间件。
Stars: ✭ 573 (+558.62%)
GlyphhangerYour web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.
Stars: ✭ 1,099 (+1163.22%)
Xxl CrawlerA distributed web crawler framework.（分布式爬虫框架XXL-CRAWLER）
Stars: ✭ 561 (+544.83%)
NetcloudNetCloud Web Spider
Stars: ✭ 37 (-57.47%)
91porn php最简单的91porn爬虫php版本
Stars: ✭ 557 (+540.23%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+1332.18%)
FbcrawlA Facebook crawler
Stars: ✭ 536 (+516.09%)
SpiderA configurable web spider with a easy-to-use web console
Stars: ✭ 954 (+996.55%)
Car PricesGolang爬虫 爬取汽车之家 二手车产品库
Stars: ✭ 57 (-34.48%)
Haipproxy💖 High available distributed ip proxy pool, powerd by Scrapy and Redis
Stars: ✭ 4,993 (+5639.08%)
Zhihu ApiZhihu API for Humans
Stars: ✭ 911 (+947.13%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (-21.84%)
Go DemoGo语言实例教程从入门到进阶，包括基础库使用、设计模式、面试易错点、工具类、对接第三方等
Stars: ✭ 881 (+912.64%)
CrawlyCrawly, a high-level web crawling & scraping framework for Elixir.
Stars: ✭ 440 (+405.75%)
Capturercapture pictures from website like sina, lofter, huaban and so on
Stars: ✭ 76 (-12.64%)
QqzonemoodQQZone mood spider and analysis. QQ空间多线程爬虫和数据挖掘。提供线上服务，扫码登陆即可自动爬取和分析数据，还有网易云年度报告风格的数据展示；使用docker-compose打包程序，方便部署；额外提供QQ空间抽奖小程序。
Stars: ✭ 439 (+404.6%)
Go spiderA golang spider
Stars: ✭ 25 (-71.26%)
Gotoolscreate some tools use go lang.
Stars: ✭ 54 (-37.93%)
Zhihu✨ 知乎日报 - 爬虫、数据分析、Node.js、Vue.js ...
Stars: ✭ 406 (+366.67%)
Paperplane📚 PaperPlane - An Android reading app, including articles from Zhihu Daily, Guokr Handpick and Douban Moment.
Stars: ✭ 1,147 (+1218.39%)
Jdpackage跨平台的京东全能工具包 仅供学习使用，技术交流群：108934299
Stars: ✭ 396 (+355.17%)
Templatespider扒网站工具，看好哪个网站，指定好URL，自动扒下来做成模版。所见网站，皆可为我所用！
Stars: ✭ 390 (+348.28%)
QzoneexporterQQ空间爬虫，可导出并显示日志、相册、留言板、说说、照片、视频等数据。
Stars: ✭ 386 (+343.68%)
SeekerSeeker - another job board aggregator.
Stars: ✭ 16 (-81.61%)
