1054 Open source projects that are alternatives of or similar to Baiducrawler

Proxy [Finder | Checker | Server]. HTTP(S) & SOCKS 🎭

🥄 A package for building specific Proxy Pool for different Sites.

Crawlera middleware for Scrapy

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

获取免费socks/https/http代理的网站集合

Proxying Python Requests

简单易用的Python爬虫框架，QQ交流群：597510560

BaiduSpider，一个爬取百度搜索结果的爬虫，目前支持百度网页搜索，百度图片搜索，百度知道搜索，百度视频搜索，百度资讯搜索，百度文库搜索，百度经验搜索和百度百科搜索。

码云仓库链接:AJay13/ECommerceCrawlers Github 仓库链接:DropsDevopsOrg/ECommerceCrawlers 项目展示平台链接:http://wechat.doonsec.com

HTTP(S) Rotating Residential proxies - Code examples & General information

💐Marmot | Web Crawler/HTTP protocol Download Package 🐭

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

一个超级轻量的百度图片爬虫

APIs for loginning some websites by using requests.

🌈Python3网络爬虫实战：QQ音乐歌曲、京东商品信息、房天下、破解有道翻译、构建代理池、豆瓣读书、百度图片、破解网易登录、B站模拟扫码登录、小鹅通、荔枝微课

Python爬虫代理IP池(proxy pool)

Proxy-Scraper is simple Perl script for scraping proxies from multiple websites.

hproxy - Asynchronous IP proxy pool, aims to make getting proxy as convenient as possible.(异步爬虫代理池)

A Fast UDP Proxy written in Golang

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

Fawkes is a tool to search for targets vulnerable to SQL Injection. Performs the search using Google search engine.

Go HTTP proxy server library

PySocket ，一个通过猴子补丁（monkey patch）动态修改 socket 的项目。在不修改源码的情况下给 socket 增加一些诸如限制客户端数量、前置代理之类的功能。让我们将 Monkey Patch 进行到底吧！

Scrapy, a fast high-level web crawling & scraping framework for Python.

A python module for dumping usable proxies.

🔛 an Elixir reverse proxy Plug with HTTP/2, chunked transfer and path proxying support

A scalable web crawler framework for Java.

An automated website accessibility scanner and cli

Ansible Role - HAProxy

Combines all swagger documents in microservices

scrapy专利爬虫（停止维护）

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

An AWS S3 gateway proxying SFTP connections.

A platform for building proxies to bypass network restrictions.

An intelligent AMQP proxy, with connection and channel pooling/reusing

🏩 A simple process manager for developers. Start apps from your browser and access them using local domains

GraphQuery is a query language and execution engine tied to any backend service.

A lightweight and ultra-fast shadowsocks library written in C++14 with Qt framework

Golang爬虫 爬取豆瓣电影Top250

WebDriverAgent Proxy

tunnel over http[s]

A web crawler (for bug hunting) that gathers more than you can imagine.

Library that allows to create async beans from sync beans

🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

爬虫, http代理, 模拟登陆!

java framework for prerender

B站用户爬虫 好耶~是爬虫

Martian is a library for building custom HTTP/S proxies

Node.js scraper to get data from Google Play

蓝天采集器是一款免费的数据采集发布爬虫软件，采用php+mysql开发，可部署在云服务器，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统

随机代理

a tiny&smart AI & Repo for work for AI Survey百度云资源持续更新中，欢迎点赞star Min's blog 欢迎访问我的博客主页！(Welcome to my blog website !)https://liweimin1996.github.io/

python 代理池

A set of useful libraries for Edge Apps. Run locally, write tests, and integrate it into your deployment process. Move fast and maybe don't break things? Because, gosh darnit, you're an adult.

Async PHP client/server API for the telegram MTProto protocol

BaiduPCS API & App 百度网盘客户端

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

免费、高速的 V2Ray 代理和订阅。

150 LOC Ruby forward proxy using only standard libraries.

Proxy specifically available for AP scores to enable simple early access to your scores without any storing of your College Board account details or dealing with untrustable proxies.