GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → NikolaiT → scrapeulous

NikolaiT / scrapeulous

Licence: other
Cloud crawler functions for scrapeulous

Programming Languages

javascript
184084 projects - #8 most used programming language

Cloud Crawler

This repository contains crawler functions used by scrapeulous.com.

If you want to add your own crawler function to be used within the crawling infrastructure of scrapeulous, please contact us at contact.

There are three different endpoints for the API:

  • /crawl - This endpoint allows you to get the HTML from any url. You may use a browser or a plain HTTP requests.
  • /serp - This endpoint allows you to scrape several different seach engines such as Google, Bing or Amazon.
  • /custom - This endpoint allows you to specify your own crawler logic in a custom Puppeteer class.

For the complete documentation, please visit the API docs page.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].