804 Open source projects that are alternatives of or similar to Zhihuspider

🐞简单轻便的Java爬虫框架，只要会一点简单的正则表达式和简单的css选择器就能轻松的采集数据。

📦 Per-request global storage for Rails prepared for multi-threaded apps

The tool which imports raw JSON to ElasticSearch in one line of commands

用严肃的数据来回答“什么样的企业会到什么样的大学招聘”？

download document from book118 for free

A collection of awesome web scaper, crawler.

A configurable web spider with a easy-to-use web console

Crawl GitHub APIs and store the discovered orgs, repos, commits, ...

ZX-Poly platform info page and its emulator. It is a multi-CPU ZXSpectrum clone.

Powerful multi-threaded coroutine dispatcher and parallel execution engine

一个基于Glang语言开发的站群系统（蜘蛛池系统）

又一个 java 内容（pa）获取（chong）工具

一些爬虫开发的技巧和案例

Zhihu API for Humans

一个基于Scrapy的数据采集爬虫代码库

owllook-小说搜索引擎

虎扑网相册下载工具

Scrapy as a Web Crawler for Azure Search Samples

ZUCC正方教务系统抢课助手。针对ZUCC正方教务系统模拟登录，爬取课程信息，自动抓包发包抢课。具体实现流程可参考README中的实现原理链接

Music Spider. Go 👾 Music Spider 是使用Golang写的音乐聚合爬虫，目前支持的站点包括 网易、QQ、虾米、酷狗、百度。

Tor website crawler (specific for Alphabay at the time)

有道词典网页爬虫

netease-music-spider is a sipder that you can find beautiful girlfriend or handsome boyfriend.

《多处理器编程的艺术》一书中的示例代码实现，带有注释与单元测试

Go语言实例教程从入门到进阶，包括基础库使用、设计模式、面试易错点、工具类、对接第三方等

😉【乐享】Kotlin 版本 每天一张精选妹纸图、一个精选短视频，知乎美文的精美应用

🕷招聘网站爬虫合集，不定期更新分支

爬取QQ用户信息（qq号、昵称、生日、地址等基本信息）并做简要analysis。

Sina stock options crawler with CSV output 新浪上证ETF期权数据爬虫

🌀 Zhihu Daily Reader (Web).

Simple yet powerful automation stuffs.

Get movie info from douban(豆瓣) and display in your terminal

Distributed Image Search Engine Crawler

An open source webapp for scraping: towards a public service for webscraping

💻 Quickly crawl the information (e.g. followers, tags, etc...) of an instagram profile. No login required!

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码

爬取amazon/bestbuy/costco/6pm 的商品详情

自动答题程序🎉

Touhou Project random music video generator/player, crawling image and video from websites to generate MV.

Simple for use node html crawler (spider) of site web pages

Pholcus is a distributed high-concurrency crawler software written in pure golang

🎊 Design and implement of lightweight crawler framework.

Cross-platform persistent and distributed web crawler 🔗

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Implements the crawler package into Symfony

163music spider by scrapy.

My Python Demo

妹子图全站采集10G套图资源

massive SQL injection vulnerability scanner

银行、支行名称。中国各地区各银行支行名称数据爬虫，数据来源微信商户平台，已经整理可直接导入的sql文件

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Web Scan Lazy Tools - Python Package

Download Videos Skill Share per ID or per Class

When you solve the problem of Baekjoon Online Judge, it automatically commits and pushes to the remote repository.

An powerful download library for Android.

知乎爬虫/可以爬出关注关系的爬虫

Testing Using Python Demo. 使用Python测试脚本demo。

一个灵活、友好的爬虫框架

基于Scrapy的QQ音乐爬虫(QQ Music Spider)，爬取歌曲信息、歌词、精彩评论等，并且分享了QQ音乐中排名前6400名的内地和港台歌手的49万+的音乐语料

仿知乎网站