peeling-onionsA repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.
Stars: ✭ 18 (-55%)
ogcheckr-apiAn api to check social media username availability on a variety of services
Stars: ✭ 18 (-55%)
opensea-scraperScrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info
Stars: ✭ 129 (+222.5%)
arachnodHigh performance crawler for Nodejs
Stars: ✭ 17 (-57.5%)
awesome-interfaceAngularJS SPA interface for awesome lists. Awesome lists parsed using python.
Stars: ✭ 25 (-37.5%)
scoopi-scraperScoopi Web Scraper is a heavy duty tool to extract data from HTML pages.
Stars: ✭ 18 (-55%)
genius-lyrics-apiA library for fetching song lyrics & album art from genius.com 🎶🌈
Stars: ✭ 129 (+222.5%)
newspaperjsNews extraction and scraping. Article Parsing
Stars: ✭ 59 (+47.5%)
Android-Apps-Downloader📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
Stars: ✭ 16 (-60%)
plugin.video.covenantCovenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA:
[email protected] Stars: ✭ 24 (-40%)
metacritic apiPHP Metacritic API - Mirrored by my GitLab
Stars: ✭ 31 (-22.5%)
spiderMultithreaded Web spider crawler written in Rust.
Stars: ✭ 81 (+102.5%)
wishlistRead an Amazon wishlist programmatically with Python
Stars: ✭ 44 (+10%)
AzurLaneWikiScrapersA console application that can scrape the Azur Lane wiki and export the data to Json files
Stars: ✭ 12 (-70%)
newsembleAPI for fetching data from news websites.
Stars: ✭ 42 (+5%)
extract-cssExtract all CSS from a webpage, packaged as a Now V2 Lambda
Stars: ✭ 23 (-42.5%)
arxiv leaksWhisper of the arxiv: read comments in tex of papers
Stars: ✭ 22 (-45%)
fb-page-chat-downloadPython script to download messages from a Facebook page to a CSV file
Stars: ✭ 51 (+27.5%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-45%)
Mimo-CrawlerA web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Stars: ✭ 22 (-45%)
evineInteractive CLI Web Crawler
Stars: ✭ 140 (+250%)
mongodb-scraperScraps for publicly accessible MongoDB instances and dumps user passwords
Stars: ✭ 33 (-17.5%)
patreon-scraperWIP Patreon attachment download written in TypeScript
Stars: ✭ 25 (-37.5%)
discord-musicDiscord music bot written in Typescript
Stars: ✭ 12 (-70%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-37.5%)
ZeiverA Scraper, Downloader, & Recorder for static open directories.
Stars: ✭ 14 (-65%)
gtfs-utilsUtilities to process GTFS data sets.
Stars: ✭ 19 (-52.5%)
linkyYet Another LInkedIn Scraper...
Stars: ✭ 44 (+10%)
covid-19Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.
Stars: ✭ 15 (-62.5%)
botCompletely free and open-source human-like Instagram bot. Powered by UIAutomator2 and compatible with basically any Android device 5.0+ that can run Instagram - real or emulated.
Stars: ✭ 321 (+702.5%)
subwayclockDisplay clock for NYC subways
Stars: ✭ 29 (-27.5%)
linkedinscraperLinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (-45%)
CoinstaA Python package for acquiring both historical and current data of cryptocurrencies
Stars: ✭ 47 (+17.5%)
RPICovidScraperscraper for Rensselaer Polytechnic Institute (RPI)'s Covid Dashboard
Stars: ✭ 12 (-70%)
imdb-scraper🎬 An attempt at the most complete IMDb API
Stars: ✭ 24 (-40%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-40%)
transitland-atlasan open directory of mobility feeds and operators — powers both Transitland v1 and v2
Stars: ✭ 55 (+37.5%)
bing-ip2hostsbingip2hosts is a Bing.com web scraper that discovers websites by IP address
Stars: ✭ 99 (+147.5%)
transitimeTheTransitClock real-time transit information system
Stars: ✭ 60 (+50%)
TorScrapperA Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)
Stars: ✭ 24 (-40%)
Captcha-ToolsAll-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!
Stars: ✭ 23 (-42.5%)
WaGpScraperA Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.
Stars: ✭ 18 (-55%)
berlin corona casesScraper for the official dashboard with current Corona case numbers, traffic light indicators ("Corona-Ampel") and vaccination situation for Berlin.
Stars: ✭ 19 (-52.5%)
metafetchNodeJS package that fetches a given URL's title, description, images, links etc.
Stars: ✭ 21 (-47.5%)
html2rss-web🕸 Generates and delivers RSS feeds via HTTP. Create your own feeds or get started quickly with the included configs.
Stars: ✭ 36 (-10%)
dm tomatrixledDisplay (real-time) public transport departures using Raspberry Pi and LED matrices
Stars: ✭ 17 (-57.5%)
quoters📝 Random quotes generator package. Available on npm and PyPi
Stars: ✭ 17 (-57.5%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-62.5%)
transit modelManaging transit data with Rust
Stars: ✭ 33 (-17.5%)