xiuren mzitu
秀人网爬虫 55156爬虫 mzitu
使用Python3.6的版本
安装
pip install scrapy
如果遇到有些模块在windos装不上，到这个网站下载相应的模块，然后用pip安装。
运行
python run.py
默认是爬取的55156 还可以在run.py里面去掉注释爬取mzitu
sujianqingfeng / scrapy_xiuren
Licence: Apache-2.0 License
秀人网爬虫 55156爬虫
Stars: ✭ 43
Programming Languages
python
139335 projects - #7 most used programming language
Projects that are alternatives of or similar to scrapy xiuren
scraping-ebay
Scraping Ebay's products using Scrapy Web Crawling Framework
Stars: ✭ 79 (+83.72%)
Mutual labels: scrapy
BOC FER Spider
Use Scrapy crawl foreign exchange rate from BOC (Bank of China)
Stars: ✭ 18 (-58.14%)
Mutual labels: scrapy
IMDB-Scraper
Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.
Stars: ✭ 37 (-13.95%)
Mutual labels: scrapy
ImageGrabber
A Scrapy demo : Download all images from a site
Stars: ✭ 33 (-23.26%)
Mutual labels: scrapy
proxi
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
Stars: ✭ 32 (-25.58%)
Mutual labels: scrapy
python-spider
python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答
Stars: ✭ 45 (+4.65%)
Mutual labels: scrapy
logparser
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
Stars: ✭ 70 (+62.79%)
Mutual labels: scrapy
hk0weather
Web scraper project to collect the useful Hong Kong weather data from HKO website
Stars: ✭ 49 (+13.95%)
Mutual labels: scrapy
scrapy-distributed
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Stars: ✭ 38 (-11.63%)
Mutual labels: scrapy
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-48.84%)
Mutual labels: scrapy
restaurant-finder-featureReviews
Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).
Stars: ✭ 21 (-51.16%)
Mutual labels: scrapy
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].