2403 Open source projects that are alternatives of or similar to Ppspider

Python的基础练习代码与各种爬虫代码

API of DouYin for Humans used to Crawl Popular Videos and Musics

📖 Puppeteer中文文档（官方指定的中文文档）

Distributed crawler powered by Headless Chrome

Gospider - Fast web spider written in Go

链家网和贝壳网房价爬虫，采集北京上海广州深圳等21个中国主要城市的房价数据（小区，二手房，出租房，新房），稳定可靠快速！支持csv,MySQL, MongoDB,Excel, json存储，支持Python2和3，图表展示数据，注释丰富 ，点星支持，仅供学习参考，请勿用于商业用途，后果自负。

Getting started with Puppeteer and Chrome Headless for Web Scraping

Rust Web Crawler saving pages on Redis

JavaScript + BeautifulSoup = JSSoup

Serverless Framework + AWS Lambda Layers + Puppeteer = ❤️

Google search results crawler, get google search results that you need

Crawl websites for accessibility issues from the command line.

基于Electron爬虫程序

Module for using Headless-Chrome by Puppeteer on AWS Lambda.

A simple and flexible web crawler framework for java.

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

No description or website provided.

一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。

A fast tool to fetch URLs from HTML attributes by crawl-in.

🍰 一个可视化的爬虫平台

📰 A responsive interface of Hacker News with summaries and thumbnails.

[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn

golang实现的爬虫框架，使用者只需关心页面规则，提供web管理界面。基于colly开发。

High performance crawler for Nodejs

🌭💦 91porn爬虫在线无限制API接口（永久有效，口令每日更新） 及 在线web预览

知乎模拟登录，支持提取验证码和保存 Cookies

Fresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion

Every web site provides APIs.

各种App、小程序、网站的请求签名或加密算法。 现已有：自如、小红书、蛋壳公寓、luckin coffee(瑞幸咖啡)、bangkokair(曼谷航空)

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

带你了解一下Golang的市场行情

book.zi5.me全站kindle电子书籍爬取，按照作者书籍名分类，每本书有mobi和equb两种格式，采用分布式进行全站爬取

A collection of awesome web crawler,spider in different languages

python crawler spider

Digger is a powerful and flexible web crawler implemented by pure golang

Crawl some picture for fun

A simple distributed crawler for zhihu && data analysis

[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。

招聘网数据爬虫

HTTP(S) Rotating Residential proxies - Code examples & General information

Clojure News Web Application - (Hacker News Clone)

Instant Graphql for MongoDb (active branch is golang, rewrite in process)

🔍 Root Cause is a tool for troubleshooting Puppeteer and Playwright tests. 🔎

A poorman's proxycannon and botnet, using docker, ovpn files, and a dante socks5 proxy

Simple news aggregator displaying top stories in real time

This is an Open Source PHP Reporting Framework which you can use to write perfect data reports or to construct awesome dashboards using PHP

HTTP-based JSON storage.

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

A beautifully-simple framework-agnostic modern state management library.

Customizable honeypots for monitoring network traffic, bots activities and username\password credentials (DNS, HTTP Proxy, HTTP, HTTPS, SSH, POP3, IMAP, STMP, RDP, VNC, SMB, SOCKS5, Redis, TELNET, Postgres and MySQL)

Small tool to wait that all xhr are finished in puppeteer

Article publishing platform that automatically distributes your articles to various media channels

Perl driver for the MongoDB

The Sanity Studio – Collaborate in real-time on structured content

socks -- a proxy server.

Node.js基础与应用教程，适合初学者入门，以及有一定经验的开发者提高。Node.js全栈交流QQ群：423652352，node.js或者全栈开发培训QQ群：579500717

Webpack plugin to generate the skeleton page automatically

An HTTP router and reverse proxy for service composition, including use cases like Kubernetes Ingress

An Easy and Simple Anti-DDoS solution for VPS,Dedicated Servers and IoT devices - Beta

Generate tiktok signature token using node