SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (+2377.94%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+5895.59%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (-69.12%)
newsembleAPI for fetching data from news websites.
Stars: ✭ 42 (-38.24%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-63.24%)
InstagoDownload/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Stars: ✭ 59 (-13.24%)
fBrowserHelpful Selenium functions to make web-scraping easier and faster
Stars: ✭ 16 (-76.47%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (-4.41%)
Linkedin-ClientWeb scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (-38.24%)
XidelCommand line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Stars: ✭ 335 (+392.65%)
Pitchfork🎶 Unofficial python API for pitchfork.com reviews.
Stars: ✭ 67 (-1.47%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (+36.76%)
grailerweb scraping tool for grailed.com
Stars: ✭ 30 (-55.88%)
extractnetA Dragnet that also extract author, headline, date, keywords from context
Stars: ✭ 52 (-23.53%)
R Web Scraping Cheat SheetGuide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
Stars: ✭ 207 (+204.41%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-70.59%)
rymscraperPython API to extract data from rateyourmusic.com.
Stars: ✭ 63 (-7.35%)
newspaperjsNews extraction and scraping. Article Parsing
Stars: ✭ 59 (-13.24%)
TrackPurchase단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!
Stars: ✭ 19 (-72.06%)
Instagram-Scraper-2021Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (-16.18%)
RcrawlerAn R web crawler and scraper
Stars: ✭ 274 (+302.94%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+864.71%)
ZillowZillow Scraper for Python using Selenium
Stars: ✭ 141 (+107.35%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+111.76%)
super-anime-downloaderA program which takes an Anime name or URL and downloads the specified range of episodes.
Stars: ✭ 26 (-61.76%)
Data-Wrangling-with-PythonSimplify your ETL processes with these hands-on data sanitation tips, tricks, and best practices
Stars: ✭ 90 (+32.35%)
iowebWeb Scraping Framework
Stars: ✭ 31 (-54.41%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+582.35%)
Sig To GooglecalendarA python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Stars: ✭ 14 (-79.41%)
Bet On SibylMachine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
Stars: ✭ 190 (+179.41%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (+26.47%)
OkanimeDownloaderScrape your favorite Anime from Okanime.com without effort
Stars: ✭ 13 (-80.88%)
TikTokDownloader PyWebIO🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具,支持API调用,在线批量解析及下载。
Stars: ✭ 919 (+1251.47%)
savedditBulk Downloader for Reddit
Stars: ✭ 130 (+91.18%)
GoodReadsScraper📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Stars: ✭ 36 (-47.06%)
Mimo-CrawlerA web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Stars: ✭ 22 (-67.65%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-77.94%)
metacritic apiPHP Metacritic API - Mirrored by my GitLab
Stars: ✭ 31 (-54.41%)
PacPawPawn package manager for SA-MP
Stars: ✭ 14 (-79.41%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-64.71%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-77.94%)
Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+251.47%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-64.71%)
HuginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Stars: ✭ 33,694 (+49450%)
Hoomanhttp interceptor to hoomanize cloudflare requests
Stars: ✭ 82 (+20.59%)
bing-ip2hostsbingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+45.59%)
JobfunnelScrape job websites into a single spreadsheet with no duplicates.
Stars: ✭ 1,528 (+2147.06%)
CoWin-Vaccine-NotifierAutomated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
Stars: ✭ 102 (+50%)
RodA Devtools driver for web automation and scraping
Stars: ✭ 1,392 (+1947.06%)
non-api-fb-scraperScrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Stars: ✭ 40 (-41.18%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (+47.06%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+117.65%)
PoliteBe nice on the web
Stars: ✭ 253 (+272.06%)
tinyPornManagerMade for pornhub. Fork from tinyMediaManager v3
Stars: ✭ 57 (-16.18%)