GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → vinta → BlackWidow

vinta / BlackWidow

Licence: other
Web crawler using Scrapy

Programming Languages

python
139335 projects - #7 most used programming language

BlackWidow

Web crawler for HeelsFetishism

Install

$ sudo apt-get install python-dev libxml2-dev libxslt1-dev
$ pip install -r requirements.txt

Usage

$ scrapy crawl atlanticpacific
$ scrapy crawl beautylegmm
$ scrapy crawl fancy
$ scrapy crawl garypeppergirl
$ scrapy crawl itscamilleco
$ scrapy crawl madamejulietta
$ scrapy crawl ohmyvogue
$ scrapy crawl pinterest
$ scrapy crawl sayhellomax
$ scrapy crawl tvcclub
$ scrapy crawl wendyslookbook

Bitdeli Badge

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].