Puppeteer Extra💯 Teach puppeteer new tricks through plugins.
Stars: ✭ 3,397 (+1660.1%)
Puppeteer RecorderRecord animations using puppeteer. Based on electron-recorder.
Stars: ✭ 169 (-12.44%)
CollyElegant Scraper and Crawler Framework for Golang
Stars: ✭ 15,535 (+7949.22%)
Goose ParserUniversal scrapping tool, which allows you to extract data using multiple environments
Stars: ✭ 211 (+9.33%)
Element💦Load test your app using real web browsers
Stars: ✭ 204 (+5.7%)
Annie👾 Fast and simple video download library and CLI tool written in Go
Stars: ✭ 16,369 (+8381.35%)
PoliteBe nice on the web
Stars: ✭ 253 (+31.09%)
Ruiji.netcrawler framework, distributed crawler extractor
Stars: ✭ 220 (+13.99%)
puppeteer-loadtestload test puppeteer (Headless Chrome API) script using node
Stars: ✭ 107 (-44.56%)
barclayscrapeA small app to programmatically mainpulate Barclays online banking
Stars: ✭ 57 (-70.47%)
site-audit-seoWeb service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.
Stars: ✭ 91 (-52.85%)
Puppeteer RendererPuppeteer(Chrome headless node API) based web page renderer
Stars: ✭ 214 (+10.88%)
arachnodHigh performance crawler for Nodejs
Stars: ✭ 17 (-91.19%)
SillyniumAutomate the creation of Python Selenium Scripts by drawing coloured boxes on webpage elements
Stars: ✭ 100 (-48.19%)
Node FrontendNode.js Docker image with all Puppeteer dependencies installed for frontend Chrome Headless testing and default Nginx config, for multi-stage Docker building
Stars: ✭ 104 (-46.11%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-92.23%)
Docker Headless ShellMinimal container for Chrome's headless shell, useful for automating / driving the web
Stars: ✭ 272 (+40.93%)
Weibo terminator workflowUpdate Version of weibo_terminator, This is Workflow Version aim at Get Job Done!
Stars: ✭ 259 (+34.2%)
Webshot FactoryWeb Screenshots at scale based on headless chrome
Stars: ✭ 288 (+49.22%)
Whatspup🔳 WhatsApp chat from commandline/console/cli using GoogleChrome puppeteer
Stars: ✭ 310 (+60.62%)
SinglefileWeb Extension for Firefox/Chrome/MS Edge and CLI tool to save a faithful copy of an entire web page in a single HTML file
Stars: ✭ 4,417 (+2188.6%)
Freshonions TorscraperFresh Onions is an open source TOR spider / hidden service onion crawler hosted at zlal32teyptf4tvi.onion
Stars: ✭ 348 (+80.31%)
Hquery.phpAn extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.
Stars: ✭ 295 (+52.85%)
Linkedin scraperA library that scrapes Linkedin for user data
Stars: ✭ 413 (+113.99%)
GosintOSINT Swiss Army Knife
Stars: ✭ 401 (+107.77%)
BookcorpusCrawl BookCorpus
Stars: ✭ 443 (+129.53%)
ThalGetting started with Puppeteer and Chrome Headless for Web Scraping
Stars: ✭ 2,345 (+1115.03%)
Awesome CrawlerA collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+2383.42%)
RodA Devtools driver for web automation and scraping
Stars: ✭ 1,392 (+621.24%)
HeadlesschromeA Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.
Stars: ✭ 112 (-41.97%)
Sushi Browser Sushi Browser is the next generation browser which mounts the multi-panel and the video support function and so on. Its goal is to be as fantastic as sushi. 🍣
Stars: ✭ 116 (-39.9%)
Alpine ChromeChrome Headless docker images built upon alpine official image
Stars: ✭ 754 (+290.67%)
Lulu[Unmaintained] A simple and clean video/music/image downloader 👾
Stars: ✭ 789 (+308.81%)
Chromdaλ 🖼️ Chromda is an AWS Lambda function for capturing screenshots of websites.
Stars: ✭ 481 (+149.22%)
Chart To AwsMicroservice to generate screenshot from a webpage and upload it to a AWS S3 Bucket.
Stars: ✭ 43 (-77.72%)
PypergrabberFetches PubMed article IDs (PMIDs) from email inbox, then crawls PubMed, Google Scholar and Sci-Hub for respective PDF files.
Stars: ✭ 14 (-92.75%)
Social ScraperTổng hợp script crawl dữ liệu từ các mạng xã hội & website tiếng Việt
Stars: ✭ 47 (-75.65%)
Jd AutobuyPython爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,174 (+508.29%)
ScrapoxyScrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!
Stars: ✭ 1,322 (+584.97%)
Roam Research Private ApiPrivate API to enable API access for Roam Research. Now you can connect Roam to your other projects.
Stars: ✭ 88 (-54.4%)
Puppeteer WebperfAutomating Web Performance testing with Puppeteer 🎪
Stars: ✭ 1,392 (+621.24%)
GeziyorGeziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Stars: ✭ 1,246 (+545.6%)
Google Play ScraperGoogle play scraper for Python inspired by <facundoolano/google-play-scraper>
Stars: ✭ 143 (-25.91%)
WombatLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
Stars: ✭ 1,220 (+532.12%)
OnegramThis repository is no longer maintained.
Stars: ✭ 137 (-29.02%)
Youtube ProjectsThis repository contains all the code I use in my YouTube tutorials.
Stars: ✭ 144 (-25.39%)
ScrapedinLinkedIn Scraper (currently working 2020)
Stars: ✭ 453 (+134.72%)
NewspaperNews, full-text, and article metadata extraction in Python 3. Advanced docs:
Stars: ✭ 11,545 (+5881.87%)
RizeHigh-level, fluent and chainable API provided library for puppeteer.
Stars: ✭ 147 (-23.83%)
Whatsapp BotBOT - WhatsApp Web in TypeScript
Stars: ✭ 170 (-11.92%)