18 open source projects by scrapy

Fill HTML login forms automatically

CSS Selectors for Python

Collection of persistent (disk-based) queues

A service daemon to run Scrapy spiders

A pure-python HTML screen-scraping library

Scrapy project to scrape public web directories (educational) [DEPRECATED]

Scrapy, a fast high-level web crawling & scraping framework for Python.

This is a sample Scrapy project for educational purposes

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Command line client for Scrapyd server

Python library of web-related functions

A fork of http://pydispatcher.sourceforge.net/ with PyPy support

Library to populate items using XPath and CSS with a convenient API

The scrapy.org website

No description, website, or topics provided.

Performance-focused replacement for Python urllib

Common interface for data container classes

A pure-Python robots.txt parser with support for modern conventions.