All Projects → transitive-bullshit → Awesome Puppeteer

transitive-bullshit / Awesome Puppeteer

A curated list of awesome puppeteer resources.

Projects that are alternatives of or similar to Awesome Puppeteer

Apify Js
Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+82.52%)
Mutual labels:  automation, scraping, crawling, puppeteer, headless-chrome
Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Stars: ✭ 5,129 (+196.82%)
Mutual labels:  scraping, crawling, puppeteer, headless-chrome
Puphpeteer
A Puppeteer bridge for PHP, supporting the entire API.
Stars: ✭ 1,014 (-41.32%)
Mutual labels:  automation, puppeteer, headless-chrome
Phantomas
Headless Chromium-based web performance metrics collector and monitoring tool
Stars: ✭ 2,191 (+26.79%)
Mutual labels:  automation, puppeteer, headless-chrome
Api Store
Contains all the public APIs listed in Phantombuster's API store. Pull requests welcome!
Stars: ✭ 69 (-96.01%)
Mutual labels:  automation, scraping, headless-chrome
Squidwarc
Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
Stars: ✭ 125 (-92.77%)
Mutual labels:  crawling, puppeteer, headless-chrome
Deno Puppeteer
A port of puppeteer running on Deno
Stars: ✭ 128 (-92.59%)
Mutual labels:  automation, puppeteer, headless-chrome
puppet-master
Puppeteer as a service hosted on Saasify.
Stars: ✭ 25 (-98.55%)
Mutual labels:  crawling, headless-chrome, puppeteer
Linkedin Profile Scraper
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (-90.1%)
Mutual labels:  scraping, crawling, puppeteer
bots-zoo
No description or website provided.
Stars: ✭ 59 (-96.59%)
Mutual labels:  scraping, crawling, puppeteer
Grawler
Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.
Stars: ✭ 98 (-94.33%)
Mutual labels:  automation, scraping, crawling
Puppeteer Extra
💯 Teach puppeteer new tricks through plugins.
Stars: ✭ 3,397 (+96.59%)
Mutual labels:  automation, puppeteer, headless-chrome
double-agent
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Stars: ✭ 123 (-92.88%)
Mutual labels:  scraping, crawling, puppeteer
Webster
a reliable high-level web crawling & scraping framework for Node.js.
Stars: ✭ 364 (-78.94%)
Mutual labels:  crawling, puppeteer, headless-chrome
Nickjs
Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)
Stars: ✭ 494 (-71.41%)
Mutual labels:  automation, scraping, headless-chrome
Puppeteer Sharp Extra
Plugin framework for PuppeteerSharp
Stars: ✭ 39 (-97.74%)
Mutual labels:  puppeteer, headless-chrome
Navalia
A bullet-proof, fast, and reliable headless browser API
Stars: ✭ 950 (-45.02%)
Mutual labels:  automation, headless-chrome
Ferrum
Headless Chrome Ruby API
Stars: ✭ 1,009 (-41.61%)
Mutual labels:  automation, headless-chrome
Url To Pdf Api
Web page PDF/PNG rendering done right. Self-hosted service for rendering receipts, invoices, or any content.
Stars: ✭ 6,544 (+278.7%)
Mutual labels:  puppeteer, headless-chrome
Ayakashi
⚡️ Ayakashi.io - The next generation web scraping framework
Stars: ✭ 117 (-93.23%)
Mutual labels:  automation, headless-chrome

Awesome Puppeteer Awesome

A curated list of awesome puppeteer resources for controlling headless Chrome (or Chromium) over the DevTools Protocol.

Puppeteer Logo

Contents

Official

Packages

Rendering and web scraping

  • headless-chrome-crawler - Distributed crawler powered by Headless Chrome.
  • decktape - PDF exporter for HTML presentation frameworks.
  • Puppetron - Demo site that shows how to use Puppeteer and Headless Chrome to render pages. Inspired by GoogleChrome/rendertron.
  • puppeteer-renderer - Generic web page renderer.
  • ReedD/crawler - BFS site crawler.
  • pupperender - Express middleware that renders PWAs for bots using puppeteer.
  • prerenderer - Framework-agnostic prerendering for sites and SPAs.
  • Apify SDK - Scalable web crawling and scraping library. 🕷️
  • webgif - Easily generate animated GIFs from websites.
  • whatspup - WhatsApp chat from commandline/console/cli.
  • Wbot - Configurable Whatsapp auto reply bot.
  • BrowserGap - Remote browser webview powered by Headless Chrome.

Testing

  • jest-puppeteer - Run your tests using Jest & Puppeteer.
  • mocha-headless-chrome - Run client-side mocha tests in the command line through Puppeteer.
  • angular-puppeteer-demo - Demos how to use Puppeteer in Karma.
  • expect-puppeteer - Assertion library for Puppeteer.
  • storybook-chrome-screenshot - Storybook addon to save screenshots of your stories via puppeteer.
  • e2e - End-to-end testing.
  • rize - High-level, fluent and chainable API provided library for puppeteer.
  • mochify - TDD with Browserify, Mocha, Headless Chrome and WebDriver.
  • tupe - A generic unit-testing runner for front-end.
  • puppetry - Scriptless E2E test automation tool.
  • wendigo - Puppeteer wrapper to ease test development.

Services

  • Puppeteer Sandbox - Puppeteer sandbox environment as a service. Runs Puppeteer scripts and allows saving and embedding them in external sites and markdown files.
  • checkly - Monitoring SaaS that uses Puppeteer to check availability and correctness of web pages and apps.
  • url-to-pdf-api - Web page PDF rendering done right. Self-hosted service for rendering.
  • browserless - Headless Chrome as a service letting you execute Puppeteer scripts remotely.
  • FusionExport - Export dashboards or charts to PDF or images. Looks mature.
  • ProxyCrawl - Headless Chrome as a service.
  • microlink.io – Turns any site into data.
  • HeadlessTesting – Headless Chrome testing with Puppeteer in the Cloud.
  • FloodRunner - Open-source monitoring solution using puppeteer tests

Examples

Articles

Guides

  • theheadless.dev - Practical guides and runnable examples on Puppeteer (and Playwright).

Related

Contribute

Contributions welcome! Please read the contributing guideline first.

License

CC0

To the extent possible under law, Travis Fischer has waived all copyright and related or neighboring rights to this work.

Support my OSS work by following me on twitter twitter

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].