12 open source projects by apify

Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

JavaScript / Node.js library to stream data into an XLSX file

House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

NodeJs package for generating browser-like headers.

Generates realistic browser fingerprints

You can use this act to monitor any page's content and get a notification when content changes.

Base Docker images for Apify actors.

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.