4 open source projects by my8100

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO 👉

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.