465 Open source projects that are alternatives of or similar to Zhihuvapi

swiss army knife for hackers

A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

那些年，我爬过的北科。一个由浅入深的定向爬虫教程。

以Node.js基于express以及爬虫实现的视频资源后端

Download videos from pornhub.

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索

稳健高效的评分制-针对性- IP代理池 + API服务，可以自己插入采集器进行代理IP的爬取，针对你的爬虫的一个或多个目标网站分别生成有效的IP代理数据库，支持MongoDB 4.0 使用 Python3.7（Scored IP proxy pool ,customise proxy data crawler can be added anytime）

今日头条机器人，支持用户登陆、关注、取消关注、获取关注粉丝、发文、发悟空问答、点赞、评论、采集各种类型新闻讯息等，使用今日头条网页版API实现

Get (almost) original messages from google group archives. Your data is yours.

Easily download all the photos/videos from tumblr blogs. 下载指定的 Tumblr 博客中的图片，视频

Easy to use lightweight web crawler（易用的轻量化网络爬虫）

一个入门级别的资讯类微信小程序

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

A tool for pixiv.net. 人人可用的P站爬虫

🐝 Web vertical crawler framework for fun

🌭💦 91porn爬虫在线API接口（永久有效） 及 在线web预览

A simple distributed crawler for zhihu && data analysis

Web Crawler written in C#

A cross platform UI crawler which scans view trees then generate and execute UI test cases.

The DomCrawler component eases DOM navigation for HTML and XML documents.

네이버 뉴스 수집을 위한 도구

A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

疫情数据爬虫，2019新型冠状病毒数据仓库，轨迹数据，同乘数据，报道

Android 本地网络小说爬虫，基于jsoup及xpath

🥄 A package for building specific Proxy Pool for different Sites.

Tổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt

Crawler for LinkedIn full profiles 2019

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

Python爬虫代理IP池(proxy pool)

者也 - 知乎 倒立的文字 汉字验证码识别程序

Crawl some picture for fun

The fastest dork scanner written in Go.

抖音爬虫，tiktok crawler，抖音数据采集接口，抖音视频去水印，百分百成功，不需要服务器，不需要代理 IP。

[DEPRECATED] Simple, flexible, delightful web crawler/spider package

ScrapingOutsourcing专注分享爬虫代码 尽量每周更新一个

一个知乎爬虫，登陆，获取答案，图片

Alternative for VK Audio API

✌️ Python3 BitTorrent DHT crawler

一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)

Simple yet powerful automation stuffs.

Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.

Beanbun 是用 PHP 编写的多进程网络爬虫框架，具有良好的开放性、高可扩展性，基于 Workerman。

An easy to use, powerful crawler implemented in PHP. Can execute Javascript.

知乎爬虫/可以爬出关注关系的爬虫

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

A lite distributed Java spider framework :-)

golang实现的爬虫框架，使用者只需关心页面规则，提供web管理界面。基于colly开发。

2019新型冠状病毒疫情实时爬虫及API | COVID-19/2019-nCoV Realtime Infection Crawler and API

Crawler for leboncoin.fr

爬蟲極簡教學（fetch, parse, search, multiprocessing, API）- PTT 為例

🕸 Modular, multithreaded, puppeteer-based crawler

Parser and database to index the terpene profile of different strains of Cannabis from online databases

When you solve the problem of Baekjoon Online Judge, it automatically commits and pushes to the remote repository.

哔咔漫画收藏夹下载程序

Rust Web Crawler saving pages on Redis

Android应用市场网络爬虫

Crawl BookCorpus

My user scripts