FalkorOpen Source web scraping API. Falkor turns web pages into queryable JSON
Stars: ✭ 184 (+1315.38%)
Anirip🎬 A Crunchyroll show/season ripper
Stars: ✭ 127 (+876.92%)
CrosslinkedLinkedIn enumeration tool to extract valid employee names from an organization through search engine scraping
Stars: ✭ 223 (+1615.38%)
Udemy botAn automation bot for free Udemy courses
Stars: ✭ 91 (+600%)
fBrowserHelpful Selenium functions to make web-scraping easier and faster
Stars: ✭ 16 (+23.08%)
StardoxGithub stargazers information gathering tool
Stars: ✭ 130 (+900%)
browser-automation-apiBrowser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (+84.62%)
NytcrosswordAn exploration of New York Times crossword answers from 1994-2017, i.e. the Will Shortz era.
Stars: ✭ 117 (+800%)
super-anime-downloaderA program which takes an Anime name or URL and downloads the specified range of episodes.
Stars: ✭ 26 (+100%)
PoliteBe nice on the web
Stars: ✭ 253 (+1846.15%)
Tradingview Data ScraperExtract price and indicator data from TradingView charts to create ML datasets
Stars: ✭ 203 (+1461.54%)
youtube-audioextract videos from youtube in audio format using webscraping techniques 🎶
Stars: ✭ 68 (+423.08%)
DecryptrAn extensible API for breaking captchas
Stars: ✭ 154 (+1084.62%)
animeflvAnimeflv is a custom API that has the entire catalog of the animeflv.net website. You can enjoy all the content with subtitles in Spanish and the latest in the world of anime for free.
Stars: ✭ 37 (+184.62%)
Ralgerralger makes it easy to scrape a website. Built on the shoulders of titans: rvest, xml2.
Stars: ✭ 130 (+900%)
PacPawPawn package manager for SA-MP
Stars: ✭ 14 (+7.69%)
toronto-apartment-finder[really old and probably doesn't work] Slack bot to post relevant Toronto apartment listings from Kijiji & Craigslist
Stars: ✭ 23 (+76.92%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+669.23%)
non-api-fb-scraperScrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Stars: ✭ 40 (+207.69%)
Covid 19 jhu data web scrap and cleaningThis repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/
Stars: ✭ 80 (+515.38%)
mirror-mirrorA library to get images from social media
Stars: ✭ 15 (+15.38%)
aws-pdf-textract-pipeline🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
Stars: ✭ 141 (+984.62%)
Fifa Fut DataWeb-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
Stars: ✭ 55 (+323.08%)
Nytimes App🗽 A Simple Demonstration of the New York Times App 📱 using Jsoup web crawler with MVVM Architecture 🔥
Stars: ✭ 246 (+1792.31%)
gotorThis program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
Stars: ✭ 97 (+646.15%)
R Web Scraping Cheat SheetGuide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
Stars: ✭ 207 (+1492.31%)
iowebWeb Scraping Framework
Stars: ✭ 31 (+138.46%)
InstascrapePowerful and flexible Instagram scraping library for Python, providing easy-to-use and expressive tools for accessing data programmatically
Stars: ✭ 202 (+1453.85%)
Email-Crawler-Lead-GeneratorThis email crawler will visit all pages of a provided website and parse and save emails found to a csv file.
Stars: ✭ 47 (+261.54%)
Hq bot📲 Bot to help solve HQ trivia
Stars: ✭ 167 (+1184.62%)
android-web-scraping-app-jsoupSometimes we need to scrap web data from our Android App. To achieve this goal jsoup library is a good option. I wrote a blog post on this topic in my personal blog. If you know Bengali language then you can visit this link.
Stars: ✭ 26 (+100%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (+1007.69%)
CourseDownloaderGUI app for downloading whole online courses with folder structure from one url
Stars: ✭ 20 (+53.85%)
TiktokbotA TikTokBot that downloads trending tiktok videos and compiles them using FFmpeg
Stars: ✭ 126 (+869.23%)
extractnetA Dragnet that also extract author, headline, date, keywords from context
Stars: ✭ 52 (+300%)
SoupWeb Scraper in Go, similar to BeautifulSoup
Stars: ✭ 1,685 (+12861.54%)
CoWin-Vaccine-NotifierAutomated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
Stars: ✭ 102 (+684.62%)
Php CrawlerA php crawler that finds emails on the internets
Stars: ✭ 119 (+815.38%)
robotstxtrobots.txt file parsing and checking for R
Stars: ✭ 65 (+400%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (+761.54%)
google scraper live viewApplication for extracting large amounts of data from the Google search results page
Stars: ✭ 17 (+30.77%)
ImghashPerceptual image hashing for Node.js
Stars: ✭ 98 (+653.85%)
CatalystA VS code Extension to accelerate the process of solving problems on Codeforces.
Stars: ✭ 69 (+430.77%)
Clock可视化任务调度系统,精简到一个二进制文件 (Web visual task scheduler system , yes ! just one binary solve all the problems !)
Stars: ✭ 86 (+561.54%)
InstagoDownload/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
Stars: ✭ 59 (+353.85%)
GoodReadsScraper📚 A GoodReads.com Scraper script to get books reviews including text and rating.
Stars: ✭ 36 (+176.92%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (+61.54%)
requestsRR interface to Python requests module
Stars: ✭ 12 (-7.69%)
ebayMarketAnalyzerScrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Stars: ✭ 116 (+792.31%)
Sneakers ProjectUsing Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.
Stars: ✭ 32 (+146.15%)
NordVPN-switcherRotate between different NordVPN servers with ease. Works both on Linux and Windows without any required changes to your code!
Stars: ✭ 143 (+1000%)