All Projects β†’ theolampert β†’ naos

theolampert / naos

Licence: other
πŸ“‰ Uptime and error monitoring CLI

Programming Languages

typescript
32286 projects
javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to naos

Headless Chrome Crawler
Distributed crawler powered by Headless Chrome
Stars: ✭ 5,129 (+16996.67%)
Mutual labels:  scraping, puppeteer
Linkedin Profile Scraper
πŸ•΅οΈβ€β™‚οΈ LinkedIn profile scraper returning structured profile data in JSON. Works in 2020.
Stars: ✭ 171 (+470%)
Mutual labels:  scraping, puppeteer
Awesome Puppeteer
A curated list of awesome puppeteer resources.
Stars: ✭ 1,728 (+5660%)
Mutual labels:  scraping, puppeteer
bots-zoo
No description or website provided.
Stars: ✭ 59 (+96.67%)
Mutual labels:  scraping, puppeteer
LInkedIn-Reverese-Lookup
πŸ”ŽSearch LinkedIn profile by email addressπŸ“§
Stars: ✭ 20 (-33.33%)
Mutual labels:  scraping, puppeteer
Tinking
🧢 Extract data from any website without code, just clicks.
Stars: ✭ 331 (+1003.33%)
Mutual labels:  scraping, puppeteer
Secret Agent
The web browser that's built for scraping.
Stars: ✭ 151 (+403.33%)
Mutual labels:  scraping, puppeteer
Apify Js
Apify SDK β€” The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
Stars: ✭ 3,154 (+10413.33%)
Mutual labels:  scraping, puppeteer
double-agent
A test suite of common scraper detection techniques. See how detectable your scraper stack is.
Stars: ✭ 123 (+310%)
Mutual labels:  scraping, puppeteer
Whatsapp-Net
Generate a network graph of connections from your WhatsApp groups data
Stars: ✭ 75 (+150%)
Mutual labels:  scraping, puppeteer
whatsapp-tracking
Scraping the status of WhatsApp contacts
Stars: ✭ 49 (+63.33%)
Mutual labels:  scraping, puppeteer
browser-automation-api
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (-20%)
Mutual labels:  scraping, puppeteer
Educative.io Downloader
πŸ“– This tool is to download course from educative.io for offline usage. It uses your login credentials and download the course.
Stars: ✭ 139 (+363.33%)
Mutual labels:  scraping, puppeteer
Thal
Getting started with Puppeteer and Chrome Headless for Web Scraping
Stars: ✭ 2,345 (+7716.67%)
Mutual labels:  scraping, puppeteer
puppeteer-botcheck
πŸ•΅β€β™‚ Bot detection tests for Puppeteer. Hide and seek!
Stars: ✭ 42 (+40%)
Mutual labels:  scraping, puppeteer
browser-pool
A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.
Stars: ✭ 71 (+136.67%)
Mutual labels:  scraping, puppeteer
feedsearch-crawler
Crawl sites for RSS, Atom, and JSON feeds.
Stars: ✭ 23 (-23.33%)
Mutual labels:  scraping
xstate-marionettist
Model based testing with Jest, XState and Puppeteer or Playwright made easy
Stars: ✭ 23 (-23.33%)
Mutual labels:  puppeteer
Captcha-Tools
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!
Stars: ✭ 23 (-23.33%)
Mutual labels:  scraping
ferenda
Transform unstructured document collections to structured Linked Data
Stars: ✭ 22 (-26.67%)
Mutual labels:  scraping

Naos ✨ ⛡️

Dead simple command line monitoring and debugging tool, based on Puppeteer.

Whats it do?

Specify an array of urls to scrape and naos will evaluate them through Puppeteer, returning you a status code and any browser console warnings or errors it finds.

Why?

Puppeteer is awesome and allows you to build very advanced integration test suites, however sometimes you don't need or don't have time to write anything more advanced than making sure your routes return a 200 and the console doesn't throw any errors. This can be very useful as a quick and basic regression checking tool.

Installation

npm install -g naos

Running

First create a config.json file like so:

{
  "protocol": "https",
  "host": "www.nytimes.com",
  "port": 443,

  "paths": [
    "/",
    "/section/world/"
  ]
}

And begin scraping:

naos --config ./config.json

With JSON output instead:

naos --config ./config.json --format json
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].