1082 Open source projects that are alternatives of or similar to Scrapyd Cluster On Heroku

Keep your free servers, clusters, dynos awaken (ex: heroku, mongodb, etc.)

Scrape, standardize and share public meetings from local government websites

Scraping Ebay's products using Scrapy Web Crawling Framework

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

Scrapy Training companion code

Build a Flask web application to help users retrieve key restaurant information and feature-based reviews (generated by applying market-basket model – Apriori algorithm and NLP on user reviews).

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Netflix like full-stack application with SPA client and backend implemented in service oriented architecture

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Scrapy crawler to collect data on the back catalog of songs listed for sale.

Faster requests on Python 3

A framework for creating semi-automatic web content extractors

Random User-Agent middleware based on fake-useragent

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Unofficial API for generating beautiful images of your source code using Carbon.

Postgres high-availability cluster with auto-failover and automated cluster recovery.

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

HyperTrack Placeline web application sample using NextJS, Ant-Design, Styled-Components, and Heroku

Turn large Web sites into tables and charts using simple SQLs.

Queue-worker for OpenFaaS with NATS Streaming

A library that enables programmatic interaction with daft.ie. Daft.ie has nationwide coverage and contains about 80% of the total available properties in Ireland.

😴 Keep your free Heroku dynos awake

Ecommerce application back-end codes

Scrapy-based Crawlers for news of Taiwan

The source code for some of the orbs published by CircleCI

Getting Started with Ruby on Heroku

A Custom discord.js Sharding Library inspired by eris-sharder.

Some research experiments

Multiple node presto cluster on docker container

Heroku buildpack that makes it possible to use Poetry with the official Python buildpack

Certificate authority and access plane for SSH, Kubernetes, web apps, databases and desktops

Distributed Gatling

Jupiter是一款性能非常不错的, 轻量级的分布式服务框架

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

🤖 Making a Reddit Bot using Python, Heroku and Heroku Postgres.

A Simple NodeJS API Wrapper for WhatsApp

A Devtools driver for web automation and scraping

Generate Heroku-like random names to use in your python applications

A CLI tool providing you with status & configuration of a Kubernetes cluster fleet

Simple web scraping for R

Integrate Kubernetes and pfSense

A PHP extension for Redis

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

Terraform for AWS EKS

土巴兔和谷居装修网站爬虫

Deploying a Flask App To Heroku Tutorial

An index & manager of Onedrive based on serverless. Can be deployed to Heroku/Glitch/SCF/FG/FC/CFC/PHP web hosting/VPS.

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Heroku buildpack for Hugo, the static site generator - https://github.com/spf13/hugo

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c

an awesome public proxy server crawler based on scrapy framework

A docker based multi machine render setup

Web torrent downloader and cloud storage.

Scrapoxy hides your scraper behind a cloud. It starts a pool of proxies to send your requests. Now, you can crawl without thinking about blacklisting!

PHP Library for detecting CMS

ASP.NET Core demo app with webpack bundle

The OWASP NodeGoat project provides an environment to learn how OWASP Top 10 security risks apply to web applications developed using Node.js and how to effectively address them.

🦠 Django + Plotly Coronavirus dashboard. Powerful data driven Python web-app, with an awesome UI. Contributions welcomed! Featured on 🕶Awesome-list

Raspberry Pi Kubernetes cluster that runs HA/HP Drupal 8

Yeoman generator for a Django REST/GraphQL API, an optional React SPA & lots more!