Linkedin-ClientWeb scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (-82.43%)
PhpscraperPHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (-38.08%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (-51.05%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (-58.16%)
LinkedinLinkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
Stars: ✭ 309 (+29.29%)
Instagram-Giveaways-WinnerInstagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!
Stars: ✭ 95 (-60.25%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-93.72%)
bots-zooNo description or website provided.
Stars: ✭ 59 (-75.31%)
ScrappleA framework for creating semi-automatic web content extractors
Stars: ✭ 464 (+94.14%)
Detect CmsPHP Library for detecting CMS
Stars: ✭ 78 (-67.36%)
PantherA browser testing and web crawling library for PHP and Symfony
Stars: ✭ 2,480 (+937.66%)
top-github-scraperScape top GitHub repositories and users based on keywords
Stars: ✭ 40 (-83.26%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (-42.68%)
30 Days Of PythonLearn Python for the next 30 (or so) Days.
Stars: ✭ 1,748 (+631.38%)
ZillowZillow Scraper for Python using Selenium
Stars: ✭ 141 (-41%)
Linkedin Profile Scraper🕵️♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (-28.45%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-93.72%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+1605.86%)
SpidrA versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+174.48%)
CabbieWebDriver for the masses
Stars: ✭ 70 (-70.71%)
CfseleniumA native Selenium WebDriver binding for ColdFusion
Stars: ✭ 77 (-67.78%)
Cdp4jcdp4j - Chrome DevTools Protocol for Java
Stars: ✭ 232 (-2.93%)
InstaloctrackAn Instagram OSINT tool to collect all the geotagged locations available on an Instagram profile in order to plot them on a map, and dump them in a JSON.
Stars: ✭ 85 (-64.44%)
Spam Bot 3000Social media research and promotion, semi-autonomous CLI bot
Stars: ✭ 79 (-66.95%)
DaftlistingsA library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.
Stars: ✭ 86 (-64.02%)
HumanoidNode.js package to bypass CloudFlare's anti-bot JavaScript challenges
Stars: ✭ 88 (-63.18%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+6400%)
ArachnidPowerful web scraping framework for Crystal
Stars: ✭ 68 (-71.55%)
CascadiaGo cascadia package command line CSS selector
Stars: ✭ 67 (-71.97%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+421.34%)
Email ExtractorThe main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Stars: ✭ 81 (-66.11%)
PyleniumioBring the best of Selenium and Cypress into a single Python package
Stars: ✭ 61 (-74.48%)
Selenium Python HeliumSelenium-python but lighter: Helium is the best Python library for web automation.
Stars: ✭ 2,732 (+1043.1%)
PulsarTurn large Web sites into tables and charts using simple SQLs.
Stars: ✭ 100 (-58.16%)
RodA Devtools driver for web automation and scraping
Stars: ✭ 1,392 (+482.43%)
Splashr💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R
Stars: ✭ 93 (-61.09%)
WhatsappbotSend messages to any person in any time how much you want.
Stars: ✭ 104 (-56.49%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (-61.09%)
MoonAn efficient Selenium protocol implementation running everything in Kubernetes or Openshift
Stars: ✭ 116 (-51.46%)
Csharp.webdriverBrowser test automation using Selenium WebDriver in C#
Stars: ✭ 115 (-51.88%)
StewardPHP libraries that makes Selenium WebDriver + PHPUnit functional testing easy and robust
Stars: ✭ 215 (-10.04%)
WebdriverextensionsMake your WebDriver based Selenium tests more readable, reusability and maintainable by using WebDriver Extensions!
Stars: ✭ 89 (-62.76%)
Frameworkium CoreFramework for writing maintainable Selenium and REST API tests in Java.
Stars: ✭ 107 (-55.23%)
MarionetteSelenium alternative for Crystal. Browser manipulation without the Java overhead.
Stars: ✭ 119 (-50.21%)
GetsyA simple browser/client-side web scraper.
Stars: ✭ 238 (-0.42%)
Html MetadataMetaData html scraper and parser for Node.js (supports Promises and callback style)
Stars: ✭ 129 (-46.03%)
Java.webdriverBrowser test automation using Selenium WebDriver in Java
Stars: ✭ 135 (-43.51%)
Jsonframe Cheeriosimple multi-level scraper json input/output for Cheerio
Stars: ✭ 196 (-17.99%)
Horn3tPowerful Visual Subdomain Enumeration at the Click of a Mouse
Stars: ✭ 120 (-49.79%)
Instagram BotAn Instagram bot developed using the Selenium Framework
Stars: ✭ 138 (-42.26%)
Selenium extensionsTools that will make writing tests, bots and scrapers using Selenium much easier
Stars: ✭ 140 (-41.42%)
WebiumWebium is a Page Object pattern implementation library for Python (http://martinfowler.com/bliki/PageObject.html). It allows you to extend WebElement class to your custom controls like Link, Button and group them as pages.
Stars: ✭ 144 (-39.75%)
SqrapeSimple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Stars: ✭ 144 (-39.75%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (-11.72%)
AyespyA performant visual regression testing tool
Stars: ✭ 150 (-37.24%)
Scrapysharpreborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (-5.44%)
SelenoidSelenium Hub successor running browsers within containers. Scalable, immutable, self hosted Selenium-Grid on any platform with single binary.
Stars: ✭ 2,065 (+764.02%)