All Projects → rohithasrk → Gsoc Organisation Scraper

rohithasrk / Gsoc Organisation Scraper

Licence: mit
Scrape GSoC organisations using a single script.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Gsoc Organisation Scraper

SJS DROPS
Script using requests module to register accounts to Slam Jam Socialism raffles.
Stars: ✭ 21 (-82.64%)
Mutual labels:  requests, beautifulsoup
Tieba-Birthday-Spider
百度贴吧生日爬虫,可抓取贴吧内吧友生日,并且在对应日期自动发送祝福
Stars: ✭ 28 (-76.86%)
Mutual labels:  requests, beautifulsoup
Requests Html
Pythonic HTML Parsing for Humans™
Stars: ✭ 12,268 (+10038.84%)
Mutual labels:  requests, beautifulsoup
Pitchfork
🎶 Unofficial python API for pitchfork.com reviews.
Stars: ✭ 67 (-44.63%)
Mutual labels:  requests, beautifulsoup
Mechanicalsoup
A Python library for automating interaction with websites.
Stars: ✭ 3,863 (+3092.56%)
Mutual labels:  requests, beautifulsoup
tiktok-downloader
Tiktok Downloader/Scraper using requests & bs4
Stars: ✭ 47 (-61.16%)
Mutual labels:  requests, beautifulsoup
SD-streams
Anime streaming without ads using Beautifulsoup and requests Python
Stars: ✭ 18 (-85.12%)
Mutual labels:  requests, beautifulsoup
Turkce Python Kaynaklari
Türkçe olarak hazırlanmış Python programlama dili ile ilgili içeriklerin derlendiği sayfa.
Stars: ✭ 295 (+143.8%)
Mutual labels:  requests, beautifulsoup
Easy Scraping Tutorial
Simple but useful Python web scraping tutorial code.
Stars: ✭ 583 (+381.82%)
Mutual labels:  requests, beautifulsoup
Languagepod101 Scraper
Python scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Stars: ✭ 104 (-14.05%)
Mutual labels:  requests, beautifulsoup
Termion
Mirror of https://gitlab.redox-os.org/redox-os/termion
Stars: ✭ 1,654 (+1266.94%)
Mutual labels:  terminal
Termy
A terminal with autocomplete
Stars: ✭ 112 (-7.44%)
Mutual labels:  terminal
Decryptlogin
APIs for loginning some websites by using requests.
Stars: ✭ 1,861 (+1438.02%)
Mutual labels:  requests
Ervy
Bring charts to terminal.
Stars: ✭ 1,530 (+1164.46%)
Mutual labels:  terminal
Openterm
OpenTerm is a sandboxed command line interface for iOS.
Stars: ✭ 1,504 (+1142.98%)
Mutual labels:  terminal
Vte
Parser for virtual terminal emulators
Stars: ✭ 117 (-3.31%)
Mutual labels:  terminal
Bilibili member crawler
B站用户爬虫 好耶~是爬虫
Stars: ✭ 115 (-4.96%)
Mutual labels:  requests
Emacs Application Framework
A free/libre and open-source extensible framework that revolutionizes the graphical capabilities of Emacs, the key to ultimately Live in Emacs
Stars: ✭ 1,932 (+1496.69%)
Mutual labels:  terminal
Tizonia Openmax Il
Command-line cloud music player for Linux with support for Spotify, Google Play Music, YouTube, SoundCloud, TuneIn, iHeartRadio, Plex servers and Chromecast devices.
Stars: ✭ 1,556 (+1185.95%)
Mutual labels:  terminal
Rxios
A RxJS wrapper for axios
Stars: ✭ 119 (-1.65%)
Mutual labels:  requests

GSoC Organisation Scraper

Makes life easier by scraping instead of searching for each and every organisation by name. Also shows number of times that an organisation has appeared in GSoC. Used Requests library of python and BeautifulSoup

Use Python-2.7

Requirements :

  • BeautifulSoup
  • Requests

Instructions :

# Clone this repository
git clone https://github.com/rohithasrk/GSoC-Organisation-Scraper.git

# Go into the repository
cd GSoC-Organisation-Scraper

# Install dependencies
[sudo] pip2 install -r requirements.txt

# Run the app without giving technology as a command line argument 
python2 scrape.py

# Enter the technology of preference when prompted.
# Example: python

# Run the app by giving technology as a command line argument 
python2 scrape.py javascript

#To store the output to a text file use pipe
python2 scrape.py ruby > ruby_orgs

Screenshots :

When browsed for javascript and ruby, some of the results are as shown below.

Python orgs 1

Python orgs 2

TODOs :

  • Make the code run faster.
  • Remove multiple results.

Contributing :

  • Fork the repo.
  • Create a new branch named <your_feature>
  • Commit changes and make a PR.
  • PRs are welcome.

This program uses PyTerm-Colors : https://github.com/vinamarora8/PyTerm-Colors.git

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].