309 Open source projects that are alternatives of or similar to factory

An open source webapp for scraping: towards a public service for webscraping

Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器，基于Tornado和Scrapy，在本地搭建属于自己的代理池

Tornado HTTP/2 Client

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

A chat application build on top of tornado python web framework and websocket.

show full stack technology applications : Scrapy + webservice[restful] + websocket + VueJS + MongoDB

A web search engine built with Python which uses TF-IDF and PageRank to sort search results.

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Pretty tornado wrapper for making lightweight REST API services

No description or website provided.

Saisoku is a Python module that helps you build complex pipelines of batch file/directory transfer/sync jobs.

爬取拉勾、BOSS直聘、智联招聘、51job、赶集招聘、58招聘等职位信息

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

日常爬虫

163music spider by scrapy.

A Scrapy extension to log items coverage when the spider shuts down

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Distributed crawling/scraping, Kafka And Redis based components for Scrapy

免费 IP 代理池。Scrapy 爬虫框架插件

scrapy mysql pipeline

Scrapy项目（mysql+mongodb豆瓣top250电影）

Common interface for data container classes

The source code for animecenter

Watch web pages for changes

基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

A Web Crawler that scrapes using YAML and python code.

UFC bout winner prediction using neural nets.

A middleware of cookies persistence for Scrapy

A Scrapy middleware to bypass the CloudFlare's anti-bot protection

Hurricane is an initiative to fit Django perfectly with Kubernetes.

bing、google、baidu搜索引擎爬虫。python3.6 and scrapy

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

基于python开发的一套内容管理系统

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

简单、免费、高效的百度地图poi采集和分析工具。

一些简单有趣的Python小Demo

虎扑步行街爬虫

Web framework plugins for apispec (formally in apispec.ext).

With Selenium headless browsing and CAPTCHA solving

Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter

Inventus is a spider designed to find subdomains of a specific domain by crawling it and any subdomains it discovers.

Websocket client application example built on top of Tornado.

Scrapy downloader middleware that stores response HTMLs to disk.

A Tornado based Python 2 client for NATS

Classificador de poemas do Fernando Pessoa de acordo com os seus heterônimos

Matlab implementation to simulate the non-linear dynamics of a fixed-wing unmanned areal glider. Includes tools to calculate aerodynamic coefficients using a vortex lattice method implementation, and to extract longitudinal and lateral linear systems around the trimmed gliding state.

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

🎊 Design and implement of lightweight crawler framework.

Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).

Python分布式爬虫打造搜索引擎

Tornado Oauth 2 client

Scrapy project boilerplate done right

My code for scraping financial data in Vietnam

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

GitHub trending API powered by Python Tornado.

🔥🔥🔥 fastposter海报生成器，电商海报编辑器，电商海报设计器，fast快速生成海报 自定义海报制作 海报开发。二维码海报，图片海报，分享海报，二维码推广海报，支持Java Python PHP Go JS 小程序。基于Vue 和Pillow 演示地址：https://poster.prodapi.cn/

【Souvenir】Python 使用 Tornado 框架实现 WebHook 自动部署 Git 项目。