569 Open source projects that are alternatives of or similar to DeadPool

一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )

😩Tool For Taobao/Tmall| 儿时玩具已经过时

在线地址: http://119.23.223.90:8000

An asynchronous enumeration & vulnerability scanner. Run all the tools on all the hosts.

一个简单的分布式爬虫框架

A cross-platform framework to build native, dynamic and swift user interface - 强大轻巧灵活的客户端动态化解决方案

APIs for loginning some websites by using requests.

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

scrapy spider for scraping imdb {movie_id: [recommended, ...]}

基于nodejs的网络聊天室、爬虫，vue音乐播放器，及php后台开发的管理系统等项目

零基础学习python爬虫

scala结合actor编写的分布式网络爬虫

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

My sexy Django + python-telegram-bot + Celery + Redis + Postgres + Dokku + GitHub Actions template

🕷️ A simple crawler (spider) writen in php just for fun, with zero dependencies

一个让 THREE 平台化的项目，目前已适配微信，淘宝，头条小程序，微信小游戏

一个简单的基于DHT协议的BT磁力链接爬虫

Google search results crawler, get google search results that you need

🔞 JAVClub - 让你的大姐姐不再走丢

妹子图

文章采集工具 Article collection tool

Dynamic configurable crawl (动态可配置化爬虫)

A Penetration Testing Framework, Information gathering tool & Website Vulnerability Scanner

招聘网数据爬虫

Demo of Asynchronous pattern (worker) using Python Flask & Celery

A Laravel wrapper for CrawlerDetect - the web crawler detection library

Celery Batches allows processing of multiple Celery task requests together

A spiders' program for weixin which made by Express & cheerio

超高速异步协程Python爬虫

⭐ 图虫网爬虫

A spider tapestry weaver

⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架

Dispatcher is an asynchronous task queue/job queue based on distributed message passing.

基于Fastapi开发，集成Celery-redis分布式任务队列、JWT 用户系统、ElasticSearch和encode orm的基础项目模板，大家可以根据自己的需求在本模板上进行修改

The celery monitor app was written by Django.

Iota is a web scraper which can find all of the images and links/suburls on a webpage

爬虫集合

gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。

直接通过链家 API 抓取数据的极速爬虫，宇宙最快~~ 🚀

Crawling GitHub Trending Pages every day

web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案

A Django + Vue reference project that focuses on developer tooling and CI/CD + IaC

微信公众号爬虫

🕷️用于爬取B站前top100的小视频

admin ui for scrapy/open source scrapinghub

基于Electron爬虫程序

裁判文书网爬虫

dynamic crawler for web vulnerability scanner

sync playlist between music platform

京东口罩库存监控爬虫(非selenium)，扫码登录、查价、加购、下单、秒杀

actor framework for Kombu

An Open Source Multi-user Blog System that Powered by Flask.

Celery prometheus metrics exporter revisited

Web crawler.

LSpider 一个为被动扫描器定制的前端爬虫

资讯爬虫App

Bilibili.com视频批量下载工具包

BitTorrent DHT Protocol && DHT Spider.

This taobao spider has been archived

FastAPI - Tortoise ORM - Celery - Docker template