804 Open source projects that are alternatives of or similar to Webspider

🍰 一个可视化的爬虫平台

Anime streaming without ads using Beautifulsoup and requests Python

Music Spider. Go 👾 Music Spider 是使用Golang写的音乐聚合爬虫，目前支持的站点包括 网易、QQ、虾米、酷狗、百度。

Pretty tornado wrapper for making lightweight REST API services

爬取 www.mzitu.com 全站图片，截至目前共5162个图集，16.5万多张美女图片，使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录，保存更合理。控制台只显示下载的进度条，详细信息保存在日志文件中。支持异常处理，不会终止爬虫程序。失败的请求，下次再执行爬虫程序时会自动下载

A socks proxy based Tornado

Your web font utility belt. It can subset web fonts. It can find unicode-ranges for you automatically. It makes julienne fries.

基于Scrapy框架的豆瓣电影爬虫

Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Data

有道词典网页爬虫

天气爬虫（全国城镇天气自动定时抓取更新，并开放RESTful查询接口），附带代理IP池定时更新并检测其可用性

妹子图

python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答

Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.

Convenient utilities for adding OpenTracing support in your python projects

A Python obfuscator using HTTP Requests and Hastebin.

No description or website provided.

⭐ 图虫网爬虫

🚀 A Simple API Gateway for Building Security and Flexible Microservices.

Tornado Oauth 2 client

Online Code Judging Tool

文章采集工具 Article collection tool

RESTful PACS server with plugins

基于Electron爬虫程序

这其实是一份学习笔记。包括学习记录、爬虫练习平台（网站）、自制工具脚本

An Open Source Multi-user Blog System that Powered by Flask.

🕷 A lightning fast multithreaded network scanner framework with modules.

This taobao spider has been archived

An experimental web based map display for MAVProxy based on Cesium

Grapy, a fast high-level web crawling framework for Python 3.3 or later base on asyncio.

各大网站逆向demo。企名片、震坤行工业超市、天翼云登录、物超所值、瓜子二手车、马蜂窝、中华诗词库、澳门彩票、药智网、福建省招标投标在线监管平台、全国公共资源交易平台、问卷星、中国人民银行条法司、中华人民共和国公安部、AqiStudy、巨量星图、HeyTap、掌上高考、船讯网、百度指数、今日头条、知乎、七麦数据、途牛、七猫小说、企查查、同花顺、网易云音乐、拉勾招聘、玩物得志、房天下

Materials for the book "Python for Mechanical and Aerospace Engineering"

🍳 apiron is a Python package that helps you cook a tasty client for RESTful APIs. Just don't wash it with SOAP.

⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架

磁力網站U3C3介紹以及域名更新

🤖 A Versatile Telegram Bot

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

(ON REWRITE) An easy to use (a)sync wrapper for Hi-Rez Studios API (Paladins, Realm Royale, and Smite), written in Python. 🐍

HTTP-based DSL for for validating RESTful APIs

快递鸟 kdniao python sdk, with tornado async & asyncio http client support.

Get movie info from douban(豆瓣) and display in your terminal

Dynamic configurable crawl (动态可配置化爬虫)

html5 斗地主游戏

Share a post into your Instagram account using the requests library.

Fully open-source online food delivery website built using Python, Django web framework, Bootstrap4, Vanilla Javascript, and more...

Simple curl-like CLI tool to automatically page through APIs

High performance crawler for Nodejs

裁判文书网爬虫

Implementing Celery within a Flask application factory

pawn-requests provides an API for interacting with HTTP(S) JSON APIs.

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

😃 T计划 是一个集成了任务队列、进程管理、爬虫部署、服务可视化监控、数据展示、在线编码、远程部署的通用系统。

研究学习各种拦截：反爬虫、拦截ad、防广告注入、斗黄牛等

Modern fail-safety scheduler for Celery

A Django Debug Toolbar panel for most popular http library requests.

REST API calls made easier

NSE Nifty Option chain analysis on the web page.

徒手实现定时爬取知乎，从中发掘有价值的信息，并可视化爬取的数据作网页展示。

一个基于Glang语言开发的站群系统（蜘蛛池系统）

😎Asynchronous tasks in Python with Celery + RabbitMQ + Redis