Scrape Linkedin Selenium`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+1227.78%)
image-crawlerAn image scraper that scraps images from unsplash.com
Stars: ✭ 12 (-33.33%)
Instagram-Scraper-2021Scrape Instagram content and stories anonymously, using a new technique based on the har file (No Token + No public API).
Stars: ✭ 57 (+216.67%)
bots-zooNo description or website provided.
Stars: ✭ 59 (+227.78%)
fBrowserHelpful Selenium functions to make web-scraping easier and faster
Stars: ✭ 16 (-11.11%)
Cdp4jcdp4j - Chrome DevTools Protocol for Java
Stars: ✭ 232 (+1188.89%)
RARBG-scraperWith Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (+111.11%)
SeleniumcrawlerAn example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
Stars: ✭ 117 (+550%)
Undetected ChromedriverCustom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Stars: ✭ 365 (+1927.78%)
PantherA browser testing and web crawling library for PHP and Symfony
Stars: ✭ 2,480 (+13677.78%)
UdemycoursegrabberYour will to enroll in Udemy course is here, but the money isn't? Search no more! This python program searches for your desired course in more than [insert big number here] websites, compares the last updated date, and gives you the download link of the latest one back, but you also have the choice to see the other ones as well!
Stars: ✭ 137 (+661.11%)
Sneakers ProjectUsing Selenium, Neha scraped data about 35 top selling sneakers of Nike and Adidas from stockx.com. She used this data to draw insights about sneaker resales.
Stars: ✭ 32 (+77.78%)
ConfigsPublic, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores
Stars: ✭ 37 (+105.56%)
anime-scraper[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (+16.67%)
ARGUSARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
Stars: ✭ 68 (+277.78%)
AutoscraperA Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+22550%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+455.56%)
Gazpacho🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+2816.67%)
InstaBotSimple and friendly Bot for Instagram, using Selenium and Scrapy with Python.
Stars: ✭ 32 (+77.78%)
iowebWeb Scraping Framework
Stars: ✭ 31 (+72.22%)
WswpCode for the second edition Web Scraping with Python book by Packt Publications
Stars: ✭ 112 (+522.22%)
docker-selenium-lambdaThe simplest demo of chrome automation by python and selenium in AWS Lambda
Stars: ✭ 172 (+855.56%)
ThalGetting started with Puppeteer and Chrome Headless for Web Scraping
Stars: ✭ 2,345 (+12927.78%)
non-api-fb-scraperScrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access
Stars: ✭ 40 (+122.22%)
browser-automation-apiBrowser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (+33.33%)
sg-food-mlThis script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.
Stars: ✭ 18 (+0%)
Selenium-FoundationSelenium Foundation is an automation framework designed to extend and enhance the capabilities provided by Selenium (WebDriver).
Stars: ✭ 51 (+183.33%)
fb auto-commenterFacebook auto comment script, without using API (BETA)
Stars: ✭ 25 (+38.89%)
PhpScreenRecorderA slim PHP wrapper around ffmpeg to record screen,best for recording your acceptance test using selenium, easy to use and clean OOP interface
Stars: ✭ 44 (+144.44%)
duskerStand alone Laravel Dusk test suit, which do not require Laravel framework itself
Stars: ✭ 28 (+55.56%)
scribd-dlCommand-line program to download Scribd documents in pdf format
Stars: ✭ 23 (+27.78%)
DeepLTranslatorThe DeepL Translator is an API written in Java that translates via the DeepL website sentences. Without API key.
Stars: ✭ 45 (+150%)
torchestratorSpin up Tor containers and then proxy HTTP requests via these Tor instances
Stars: ✭ 32 (+77.78%)
browser-poolA Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (+294.44%)
rubiumRubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby
Stars: ✭ 65 (+261.11%)
scavengerScrape and take screenshots of dynamic and static webpages
Stars: ✭ 14 (-22.22%)
Crawler pubg.op.ggThis is a web crawler for pubg.op.gg, written by Ruichong Liu. 绝地求生游戏数据抓取
Stars: ✭ 15 (-16.67%)
selenifiedThe Selenified Test Framework provides mechanisms for simply testing applications at multiple tiers while easily integrating into DevOps build environments. Selenified provides traceable reporting for both web and API testing, wraps and extends Selenium calls to more appropriately handle testing errors, and supports testing over multiple browser…
Stars: ✭ 38 (+111.11%)
thewaiterA Waiter library for Selenium tests
Stars: ✭ 52 (+188.89%)
supervised-machine-learningThis repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using…
Stars: ✭ 34 (+88.89%)
whatsapp-botMade with Python and Selenium, can be used to send multiple messages and send messages as characters made of emojis
Stars: ✭ 34 (+88.89%)
testbenchVaadin TestBench is a tool for automated user interface testing of Vaadin Framework applications.
Stars: ✭ 20 (+11.11%)
SeleniumDemoSelenium automation test framework
Stars: ✭ 84 (+366.67%)
ScrappingMastering the art of scrapping 🎓
Stars: ✭ 24 (+33.33%)
extractnetA Dragnet that also extract author, headline, date, keywords from context
Stars: ✭ 52 (+188.89%)
TinySeleniumVBAA tiny Selenium wrapper written in pure VBA
Stars: ✭ 29 (+61.11%)
people-also-askPeople also ask Google scraper. Get as many questions as you need to optimize your site for voice or new content ideas or answering questions about your desired topic.
Stars: ✭ 39 (+116.67%)
SWETSelenium WebDriver Page Test / workflow recorder (successor to SWD recorder)
Stars: ✭ 34 (+88.89%)
Insta-BotPython bot using Selenium increasing Instagram Followers.
Stars: ✭ 62 (+244.44%)
copycatA PHP Scraping Class
Stars: ✭ 70 (+288.89%)