All Projects → Yangzhedi → pythonSpider

Yangzhedi / pythonSpider

Licence: other
🕷️some python spiders with BeautifulSoup or scarpy

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to pythonSpider

Scrapple
A framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+1557.14%)
Mutual labels:  scrapy, beautifulsoup
Easy Scraping Tutorial
Simple but useful Python web scraping tutorial code.
Stars: ✭ 583 (+1982.14%)
Mutual labels:  scrapy, beautifulsoup
Hive
lots of spider (很多爬虫)
Stars: ✭ 110 (+292.86%)
Mutual labels:  scrapy, beautifulsoup
newspaper3 usage overview
This repository provides usage examples for the Python module Newspaper3k.
Stars: ✭ 78 (+178.57%)
Mutual labels:  beautifulsoup
NovelCrawler
基于Scrapy的爬虫demo
Stars: ✭ 15 (-46.43%)
Mutual labels:  scrapy
kick-off-web-scraping-python-selenium-beautifulsoup
A tutorial-based introduction to web scraping with Python.
Stars: ✭ 18 (-35.71%)
Mutual labels:  beautifulsoup
Inshorts-API
An Inshorts API which provides news for different categories from the Inshorts Website. Built using Flask and Beautiful Soup.
Stars: ✭ 45 (+60.71%)
Mutual labels:  beautifulsoup
scrapy plus
scrapy 常用爬网必备工具包
Stars: ✭ 18 (-35.71%)
Mutual labels:  scrapy
scrapy xiuren
秀人网爬虫 55156爬虫
Stars: ✭ 43 (+53.57%)
Mutual labels:  scrapy
V2EX Spider
V2EX爬虫
Stars: ✭ 21 (-25%)
Mutual labels:  scrapy
ImageGrabber
A Scrapy demo : Download all images from a site
Stars: ✭ 33 (+17.86%)
Mutual labels:  scrapy
BOC FER Spider
Use Scrapy crawl foreign exchange rate from BOC (Bank of China)
Stars: ✭ 18 (-35.71%)
Mutual labels:  scrapy
scrapy facebooker
Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-21.43%)
Mutual labels:  scrapy
JustDownlink
基于Scrapy+Elasticsearch+Django搭建的分布式电影搜索
Stars: ✭ 28 (+0%)
Mutual labels:  scrapy
XMQ-BackUp
小密圈备份,圈子/话题/图片/文件。
Stars: ✭ 22 (-21.43%)
Mutual labels:  scrapy
SJS DROPS
Script using requests module to register accounts to Slam Jam Socialism raffles.
Stars: ✭ 21 (-25%)
Mutual labels:  beautifulsoup
GPlayCrawler
No description or website provided.
Stars: ✭ 47 (+67.86%)
Mutual labels:  scrapy
Scraper-Projects
🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-10.71%)
Mutual labels:  beautifulsoup
restaurant-finder-featureReviews
Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).
Stars: ✭ 21 (-25%)
Mutual labels:  scrapy
hk0weather
Web scraper project to collect the useful Hong Kong weather data from HKO website
Stars: ✭ 49 (+75%)
Mutual labels:  scrapy

pythonSpider

some python spiders with BeautifulSoup & requests or scrapy

##by-bs4

github

58同城

豆瓣

知乎

股票交易数据

  • 获取该支股票的指定年度指定季度的数据并写入csv stock2csv.py
  • 获取该支股票的所有交易数据并写入txt stock2txt.py
  • 获取该支股票的所有交易数据并写入以其股票代码命名的csv中 stock2csvALL.py
  • 获取该支股票的所有交易数据并写入以其股票代码和名字命名的csv中 stock2csvALLWithName.py

##scrapy

wiki

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].