Instagram-to-discordMonitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Stars: β 113 (+841.67%)
Mutual labels: scraper, monitor, scraping, scraping-websites, monitoring-scripts
scrapmanRetrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs
Stars: β 21 (+75%)
Mutual labels: scraper, scraping, scraping-websites
websitechangesAlerts you via email about a website change.
Stars: β 43 (+258.33%)
Mutual labels: website-monitor, change-detection, website-change-monitor
FerretDeclarative web scraping
Stars: β 4,837 (+40208.33%)
Mutual labels: scraper, scraping, scraping-websites
proxycrawl-pythonProxyCrawl Python library for scraping and crawling
Stars: β 51 (+325%)
Mutual labels: scraper, scraping, scraping-websites
document-dlCommand line program to download documents from web portals.
Stars: β 14 (+16.67%)
Mutual labels: scraper, scraping, scraping-websites
ExDeMonA general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...
Stars: β 19 (+58.33%)
Mutual labels: monitor, monitoring-application, monitoring-tool
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: β 148 (+1133.33%)
Mutual labels: scraper, scraping
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: β 153 (+1175%)
Mutual labels: scraper, scraping
Anime DlAnime-dl is a command-line program to download anime from CrunchyRoll and Funimation.
Stars: β 190 (+1483.33%)
Mutual labels: scraper, scraping
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: β 211 (+1658.33%)
Mutual labels: scraper, scraping
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: β 137 (+1041.67%)
Mutual labels: scraper, scraping
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: β 117 (+875%)
Mutual labels: scraper, scraping
Linkedin Profile Scraperπ΅οΈββοΈ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: β 171 (+1325%)
Mutual labels: scraper, scraping
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: β 1,246 (+10283.33%)
Mutual labels: scraper, scraping
CollyElegant Scraper and Crawler Framework for Golang
Stars: β 15,535 (+129358.33%)
Mutual labels: scraper, scraping
Email ExtractorThe main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrΓ³nicos de una o varias Url
Stars: β 81 (+575%)
Mutual labels: scraper, scraping
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: β 196 (+1533.33%)
Mutual labels: scraper, scraping
crawler-chrome-extensionsη¬θ«ε·₯η¨εΈεΈΈη¨η Chrome ζδ»Ά | Chrome extensions used by crawler developer
Stars: β 53 (+341.67%)
Mutual labels: scraper, scraping
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: β 64 (+433.33%)
Mutual labels: scraper, scraping-websites
Fast, scalable, easy to use website changes tracker
