yt-videos-listCreate and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
Stars: ✭ 64 (-53.28%)
RARBG-scraperWith Selenium headless browsing and CAPTCHA solving
Stars: ✭ 38 (-72.26%)
SerpscrapSEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type from searchresults for given keywords. Detect Ads or make automated screenshots. You can also fetch text content of urls provided in searchresults or by your own. It's usefull for SEO and business related research tasks.
Stars: ✭ 153 (+11.68%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+809.49%)
Scrapysharpreborn of https://bitbucket.org/rflechner/scrapysharp
Stars: ✭ 226 (+64.96%)
TinderBotzAutomated Tinder bot and scraper using selenium in python.
Stars: ✭ 265 (+93.43%)
scrapersscrapers for building your own image databases
Stars: ✭ 46 (-66.42%)
scraperNodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
Stars: ✭ 37 (-72.99%)
Imagescraper✂️ High performance, multi-threaded image scraper
Stars: ✭ 630 (+359.85%)
Botvid 19Messenger Bot that scrapes for COVID-19 data and periodically updates subscribers via Facebook Messages. Created using Python/Flask, MYSQL, HTML, Heroku
Stars: ✭ 34 (-75.18%)
MarionetteSelenium alternative for Crystal. Browser manipulation without the Java overhead.
Stars: ✭ 119 (-13.14%)
WhatsappbotSend messages to any person in any time how much you want.
Stars: ✭ 104 (-24.09%)
Languagepod101 ScraperPython scraper for Language Pods such as Japanesepod101.com 👹 🗾 🍣 Compatible with Japanese, Chinese, French, German, Italian, Korean, Portuguese, Russian, Spanish and many more! ✨
Stars: ✭ 104 (-24.09%)
Selenese Runner JavaSelenium IDE native format (selenese and side) interpreter.
Stars: ✭ 125 (-8.76%)
SouqscraperSimple scriptes for Level UP your scraping Skills, and source code for Level UP playlist on Youtube
Stars: ✭ 118 (-13.87%)
WatirWatir Powered By Selenium
Stars: ✭ 1,386 (+911.68%)
Wdio Screenshot A WebdriverIO plugin. Additional commands for taking screenshots with WebdriverIO.
Stars: ✭ 101 (-26.28%)
Vuejs CinemaSource code for the case-study project from the course Build A Vue.js Single-Page App with Vue Router
Stars: ✭ 101 (-26.28%)
UniumAutomation for Unity games
Stars: ✭ 132 (-3.65%)
Selenium IdeOpen Source record and playback test automation for the web.
Stars: ✭ 1,815 (+1224.82%)
Cumcomic updater, mangafied
Stars: ✭ 117 (-14.6%)
PulsarTurn large Web sites into tables and charts using simple SQLs.
Stars: ✭ 100 (-27.01%)
DotnetcrawlerDotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (-27.01%)
Gemini💀💀💀[DEPRECATED] Use hermione
Stars: ✭ 1,505 (+998.54%)
Flutter Free CoursesThe best Courses and Series about Flutter and Dart 💙 available. Totally free 🆓!
Stars: ✭ 100 (-27.01%)
AetAET - a system that detects visual changes on web sites and performs basic page health checks
Stars: ✭ 100 (-27.01%)
RequestiumIntegration layer between Requests and Selenium for automation of web actions.
Stars: ✭ 1,618 (+1081.02%)
MoonAn efficient Selenium protocol implementation running everything in Kubernetes or Openshift
Stars: ✭ 116 (-15.33%)
Vuejs CalendarSource code for Build A Professional Vue App with Vuex & Server-Side Rendering
Stars: ✭ 100 (-27.01%)
Ridereceipts🚕 Simple automation desktop app to download and organize your receipts from Uber/Lyft. Try out our new Ride Receipts PRO !
Stars: ✭ 117 (-14.6%)
Hsac Fitnesse FixturesAn environment to define and run integration tests. It contains Fitnesse fixture (base) classes and a baseline FitNesse installation.
Stars: ✭ 99 (-27.74%)
GrawlerGrawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.
Stars: ✭ 98 (-28.47%)
NightwatchEnd-to-end testing framework written in Node.js and using the Webdriver API
Stars: ✭ 10,912 (+7864.96%)
Examples Of Web Crawlers一些非常有趣的python爬虫例子,对新手比较友好,主要爬取淘宝、天猫、微信、豆瓣、QQ等网站。(Some interesting examples of python crawlers that are friendly to beginners. )
Stars: ✭ 10,724 (+7727.74%)
ImagesBrowser images for Selenoid and Moon
Stars: ✭ 116 (-15.33%)
TaffyTest Automation Framework Based On Nosetests. ✨🍰✨
Stars: ✭ 94 (-31.39%)
NintendealsLibrary with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).
Stars: ✭ 94 (-31.39%)
HtmlsqlhtmlSQL is a experimental PHP library which allows you to access HTML values by an SQL like syntax.
Stars: ✭ 120 (-12.41%)
Vuejs Poster ShopSource code for "The Ultimate Vue.js Developers Course"
Stars: ✭ 116 (-15.33%)
Laravel ScavengerThe most integrated web scraper package for Laravel.
Stars: ✭ 91 (-33.58%)
ScrapoxyScrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Stars: ✭ 1,322 (+864.96%)
Csharp.webdriverBrowser test automation using Selenium WebDriver in C#
Stars: ✭ 115 (-16.06%)
Awesome Dl This is a list of repositories and libraries that allow for scripted downloading of online content.
Stars: ✭ 93 (-32.12%)
MwofflinerScrape any online Mediawiki motorised wiki (like Wikipedia) to your local filesystem
Stars: ✭ 121 (-11.68%)
SeleniumjavacourseSelenium Java Code for all selenium sessions - WebDriver, TestNG, POI, etc...
Stars: ✭ 115 (-16.06%)
Splashr💦 Tools to Work with the 'Splash' JavaScript Rendering Service in R
Stars: ✭ 93 (-32.12%)
Hockey ScraperPython Package for scraping NHL Play-by-Play and Shift data
Stars: ✭ 93 (-32.12%)
Query Selector Shadow DomquerySelector that can pierce Shadow DOM roots without knowing the path through nested shadow roots. Useful for automated testing of Web Components. Production use is not advised, this is for test environments/tools such as Web Driver, Playwright, Puppeteer
Stars: ✭ 115 (-16.06%)
Udemy botAn automation bot for free Udemy courses
Stars: ✭ 91 (-33.58%)