robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (-2.99%)
iowebWeb Scraping Framework
Stars: ✭ 31 (-53.73%)
supervised-machine-learningThis repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using…
Stars: ✭ 34 (-49.25%)
gotorThis program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
Stars: ✭ 97 (+44.78%)
CoWin-Vaccine-NotifierAutomated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
Stars: ✭ 102 (+52.24%)
Android-Web-ScraperAndroid Web Scraper is a simple library for android web automation. You can perform web task in background to fetch website data programmatically.
Stars: ✭ 38 (-43.28%)
metacritic apiPHP Metacritic API - Mirrored by my GitLab
Stars: ✭ 31 (-53.73%)
zim-toolsVarious ZIM command line tools
Stars: ✭ 75 (+11.94%)
extractnetA Dragnet that also extract author, headline, date, keywords from context
Stars: ✭ 52 (-22.39%)
gutenbergScraper for downloading the entire ebooks repository of project Gutenberg
Stars: ✭ 100 (+49.25%)
Mimo-CrawlerA web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Stars: ✭ 22 (-67.16%)
CourseDownloaderGUI app for downloading whole online courses with folder structure from one url
Stars: ✭ 20 (-70.15%)
koishiPython wrapper for the unofficial scraped API of the satori testing system.
Stars: ✭ 13 (-80.6%)
non-api-fb-scraperScrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Stars: ✭ 40 (-40.3%)
irProjeto de calculo de Imposto de Renda em operacoes na bovespa automaticamente. Tags:canal eletronico do investidor, CEI, selenium, bovespa, IRPF, IR, imposto de renda, finance, yahoo finance, acao, fii, etf, python, crawler, webscraping, calculadora ir
Stars: ✭ 120 (+79.1%)
bing-ip2hostsbingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+47.76%)
android-web-scraping-app-jsoupSometimes we need to scrap web data from our Android App. To achieve this goal jsoup library is a good option. I wrote a blog post on this topic in my personal blog. If you know Bengali language then you can visit this link.
Stars: ✭ 26 (-61.19%)
image-crawlerAn image scraper that scraps images from unsplash.com
Stars: ✭ 12 (-82.09%)
google scraper live viewApplication for extracting large amounts of data from the Google search results page
Stars: ✭ 17 (-74.63%)
requestsRR interface to Python requests module
Stars: ✭ 12 (-82.09%)
CatalystA VS code Extension to accelerate the process of solving problems on Codeforces.
Stars: ✭ 69 (+2.99%)
mirror-mirrorA library to get images from social media
Stars: ✭ 15 (-77.61%)
newspaperjsNews extraction and scraping. Article Parsing
Stars: ✭ 59 (-11.94%)
ebayMarketAnalyzerScrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Stars: ✭ 116 (+73.13%)
hk0weatherWeb scraper project to collect the useful Hong Kong weather data from HKO website
Stars: ✭ 49 (-26.87%)
youtube-audioextract videos from youtube in audio format using webscraping techniques 🎶
Stars: ✭ 68 (+1.49%)
node-libzimBinding to libzim, read/write ZIM files in Javascript
Stars: ✭ 23 (-65.67%)
browser-automation-apiBrowser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (-64.18%)
phomberPhomber is infomation grathering tool that reverse search phone numbers and get their details, written in python3.
Stars: ✭ 59 (-11.94%)
sotokiStackExchange websites to ZIM scraper
Stars: ✭ 64 (-4.48%)
ZimpediaOffline reader for Wikipedia
Stars: ✭ 18 (-73.13%)
TrackPurchase단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!
Stars: ✭ 19 (-71.64%)
Sneakers ProjectUsing Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.
Stars: ✭ 32 (-52.24%)
chesfCHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Stars: ✭ 18 (-73.13%)
OkanimeDownloaderScrape your favorite Anime from Okanime.com without effort
Stars: ✭ 13 (-80.6%)
fBrowserHelpful Selenium functions to make web-scraping easier and faster
Stars: ✭ 16 (-76.12%)
VideoRecognition-realtime-autotrainer-alertsState of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.
Stars: ✭ 36 (-46.27%)
animeflvAnimeflv is a custom API that has the entire catalog of the animeflv.net website. You can enjoy all the content with subtitles in Spanish and the latest in the world of anime for free.
Stars: ✭ 37 (-44.78%)
scrapisma work-in-progress guide to web scraping as an artistic and critical practice
Stars: ✭ 43 (-35.82%)
gitProvides nice git aliases and functions.
Stars: ✭ 26 (-61.19%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (-68.66%)
NYTimes-iOS🗽 NY Times is an Minimal News 🗞 iOS app 📱 built to describe the use of SwiftSoup and CoreData with SwiftUI🔥
Stars: ✭ 152 (+126.87%)
toronto-apartment-finder[really old and probably doesn't work] Slack bot to post relevant Toronto apartment listings from Kijiji & Craigslist
Stars: ✭ 23 (-65.67%)
youtubeCreate a ZIM file from a Youtube channel/username/playlist
Stars: ✭ 25 (-62.69%)
super-anime-downloaderA program which takes an Anime name or URL and downloads the specified range of episodes.
Stars: ✭ 26 (-61.19%)
newsembleAPI for fetching data from news websites.
Stars: ✭ 42 (-37.31%)
Email-Crawler-Lead-GeneratorThis email crawler will visit all pages of a provided website and parse and save emails found to a csv file.
Stars: ✭ 47 (-29.85%)
allitebooks.comDownload all the ebooks with indexed csv of "allitebooks.com"
Stars: ✭ 24 (-64.18%)
FisherManCLI program that collects information from facebook user profiles via Selenium.
Stars: ✭ 117 (+74.63%)
Bitcoin-BarPhysical Bitcoin Stat Ticker
Stars: ✭ 32 (-52.24%)
repository.colossusColossus Repository for Kodi Addons - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA:
[email protected] Stars: ✭ 13 (-80.6%)
PacPawPawn package manager for SA-MP
Stars: ✭ 14 (-79.1%)