GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → KopLyf → GPlayCrawler

KopLyf / GPlayCrawler

Licence: other
No description or website provided.

Programming Languages

python
139335 projects - #7 most used programming language

Labels

crawlerscrapygoogleplay

Projects that are alternatives of or similar to GPlayCrawler

bgmtools
Bangumi小工具
Stars: ✭ 66 (+40.43%)
Mutual labels:  scrapy
JustDownlink
基于Scrapy+Elasticsearch+Django搭建的分布式电影搜索
Stars: ✭ 28 (-40.43%)
Mutual labels:  scrapy
V2EX Spider
V2EX爬虫
Stars: ✭ 21 (-55.32%)
Mutual labels:  scrapy
scraping-ebay
Scraping Ebay's products using Scrapy Web Crawling Framework
Stars: ✭ 79 (+68.09%)
Mutual labels:  scrapy
python-fxxk-spider
收集各种免费的 Python 爬虫项目
Stars: ✭ 184 (+291.49%)
Mutual labels:  scrapy
BOC FER Spider
Use Scrapy crawl foreign exchange rate from BOC (Bank of China)
Stars: ✭ 18 (-61.7%)
Mutual labels:  scrapy
IMDB-Scraper
Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.
Stars: ✭ 37 (-21.28%)
Mutual labels:  scrapy
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-53.19%)
Mutual labels:  scrapy
scrapy plus
scrapy 常用爬网必备工具包
Stars: ✭ 18 (-61.7%)
Mutual labels:  scrapy
ImageGrabber
A Scrapy demo : Download all images from a site
Stars: ✭ 33 (-29.79%)
Mutual labels:  scrapy
proxi
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
Stars: ✭ 32 (-31.91%)
Mutual labels:  scrapy
python-spider
python爬虫小项目【持续更新】【笔趣阁小说下载、Tweet数据抓取、天气查询、网易云音乐逆向、天天基金网查询、微博数据抓取（生成cookie）、有道翻译逆向、企查查免登陆爬虫、大众点评svg加密破解、B站用户爬虫、拉钩免登录爬虫、自如租房字体加密、知乎问答
Stars: ✭ 45 (-4.26%)
Mutual labels:  scrapy
Scrapy-Spiders
一个基于Scrapy的数据采集爬虫代码库
Stars: ✭ 34 (-27.66%)
Mutual labels:  scrapy
logparser
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
Stars: ✭ 70 (+48.94%)
Mutual labels:  scrapy
hk0weather
Web scraper project to collect the useful Hong Kong weather data from HKO website
Stars: ✭ 49 (+4.26%)
Mutual labels:  scrapy
scrapy-distributed
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Stars: ✭ 38 (-19.15%)
Mutual labels:  scrapy
NovelCrawler
基于Scrapy的爬虫demo
Stars: ✭ 15 (-68.09%)
Mutual labels:  scrapy
scrapy-admin
A django admin site for scrapy
Stars: ✭ 44 (-6.38%)
Mutual labels:  scrapy
GooglePlay2
GooglePlay2.0，基本修复所有bug，应用市场，一款应用下载软件，框架式编程，使用ButterKnife，okHttp网络请求，glide图片加载，联动ToolBar。
Stars: ✭ 20 (-57.45%)
Mutual labels:  googleplay
restaurant-finder-featureReviews
Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).
Stars: ✭ 21 (-55.32%)
Mutual labels:  scrapy
View All Similar Projects ➔

A crawler based on Scrapy used to crawl App's information in Google Play

Results include information below:

  • Url
  • App'ID
  • Score
  • Publish Date
  • File Size
  • Number of Downloads
  • Software Version
  • Pperating Systems
  • Content Rating
  • Thumbs
  • Icon
  • Description
  • Reviews(include author, date, content and rating)
  • Permissions

Requirements:

  • MongoDB 3.4
  • Python 2.7
  • Scrapy 1.3

Usage:

shell command: scrapy crawl google

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].