GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → rjstyles → StackOverflow-Crawler

rjstyles / StackOverflow-Crawler

Licence: other
It is a web crawler which crawls the stackoverfolw website (http://stackoverflow.com/) and finds the most popular technologies at current point of time by getting the tags info of the newest questions asked on the website.

Programming Languages

python
139335 projects - #7 most used programming language

Labels

web-crawlerstackoverflow-crawlerstackoverfolw-website

Projects that are alternatives of or similar to StackOverflow-Crawler

Infinitycrawler
A simple but powerful web crawler library for .NET
Stars: ✭ 97 (+288%)
Mutual labels:  web-crawler
Crawler Commons
A set of reusable Java components that implement functionality common to any web crawler
Stars: ✭ 173 (+592%)
Mutual labels:  web-crawler
Market-Trend-Prediction
This is a project of build knowledge graph course. The project leverages historical stock price, and integrates social media listening from customers to predict market Trend On Dow Jones Industrial Average (DJIA).
Stars: ✭ 57 (+128%)
Mutual labels:  web-crawler
Pspider
简单易用的Python爬虫框架，QQ交流群：597510560
Stars: ✭ 1,611 (+6344%)
Mutual labels:  web-crawler
Awesome Web Scraper
A collection of awesome web scaper, crawler.
Stars: ✭ 147 (+488%)
Mutual labels:  web-crawler
Nutch
Apache Nutch is an extensible and scalable web crawler
Stars: ✭ 2,277 (+9008%)
Mutual labels:  web-crawler
Ospider
开源矢量地理数据获取与预处理工具(POI/AOI/行政区/路网/土地利用)
Stars: ✭ 74 (+196%)
Mutual labels:  web-crawler
Raspagem-de-dados-para-iniciantes
Raspagem de dados para iniciante usando Scrapy e outras libs básicas
Stars: ✭ 113 (+352%)
Mutual labels:  web-crawler
Abot
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.
Stars: ✭ 1,961 (+7744%)
Mutual labels:  web-crawler
Strong Web Crawler
基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。
Stars: ✭ 238 (+852%)
Mutual labels:  web-crawler
Crawlab Lite
Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
Stars: ✭ 122 (+388%)
Mutual labels:  web-crawler
Collector Http
Norconex HTTP Collector is a flexible web crawler for collecting, parsing, and manipulating data from the Internet (or Intranet) to various data repositories such as search engines.
Stars: ✭ 130 (+420%)
Mutual labels:  web-crawler
Antch
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Stars: ✭ 198 (+692%)
Mutual labels:  web-crawler
Pulsar
Turn large Web sites into tables and charts using simple SQLs.
Stars: ✭ 100 (+300%)
Mutual labels:  web-crawler
doc crawler.py
Explore a website recursively and download all the wanted documents (PDF, ODT…)
Stars: ✭ 22 (-12%)
Mutual labels:  web-crawler
Ultimate Dork
Web Crawler
Stars: ✭ 79 (+216%)
Mutual labels:  web-crawler
Zhihu Crawler People
A simple distributed crawler for zhihu && data analysis
Stars: ✭ 182 (+628%)
Mutual labels:  web-crawler
WeReadScan
扫描“微信读书”已购图书并下载本地PDF的爬虫
Stars: ✭ 273 (+992%)
Mutual labels:  web-crawler
ant
A web crawler for Go
Stars: ✭ 264 (+956%)
Mutual labels:  web-crawler
Kochat
Opensource Korean chatbot framework
Stars: ✭ 204 (+716%)
Mutual labels:  web-crawler
View All Similar Projects ➔

StackOverflow-Crawler

It is a web crawler written in python3.5 which crawls the stackoverflow website and finds the most popular technologies at current point of time by getting the tags info of the newest questions asked on the website.

Required python3 modules:

urllib3, requests, bs4, zlib, operator, os, sys

How to run:

1: Download the repository to your machine

2: Change the directory to where you downloaded the crawler

3: Type the following command in a terminal to run the script:

 python3 main.py
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].