309 Open source projects that are alternatives of or similar to factory

Personal Data Engineering Projects

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Scraping Ebay's products using Scrapy Web Crawling Framework

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

Bangumi小工具

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Document Search Engine Tool

10 photo website spiders, 10 个国外图库的 scrapy 爬虫代码