738 Open source projects that are alternatives of or similar to web-scraping-engine

A collection of useful utility functions

[a]synchronous functional programming

Parallel Searching and Crawling Data from PTT 🚀

100% Vanilla Javascript Multithreading & Parallel Execution Library

🚀 Run tape tests concurrently with tap-spec output

A pytest plugin for parallel and concurrent testing

Cloe programming language

a tiny function that "parallelizes" work in NodeJS

🌇 🌆 🌉 Advanced, user-friendly, language-agnostic, super-high-performance test runner. http://sumanjs.org

🏃⛰ Ultra fast monorepo script runner and build tool

Yet Another Concurrency Library

Códigos feitos para o curso de Multithreading com Java, no canal RinaldoDev do YouTube.

Scrapes VK user's photos

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Examples for https://github.com/optuna/optuna

A Go scraper that validates security.txt files and outputs them in the disclose.io JSON format.

Command line program to download documents from web portals.

Data-parallelism on CUDA using Transducers.jl and for loops (FLoops.jl)

Scrapers for many e-SAJ systems

100% Safe Rust OpenEXR file library

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

provides utilities to perform common tasks on goroutines

Javascript BDD UI Automation Framework. Exclusive LWC Shadow DOM Support. Playwright, Webdriver.io, Appium, Saucelabs.

A visual working example of a Thread Pool pattern, based on a known blog article.

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

Code relating to scraping public police data.

A PHP Scraping Class

A monadic web scraping library

Download Impartus lectures, convert to mkv for offline viewing.

A free TVTime API based on scraping TVTime website. No API key required

An open source webapp for scraping: towards a public service for webscraping

dbaTDPMon - Troubleshoot Database Performance and Monitoring

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

Anonymous Plurk Cross-matching Tool - Plurk偷偷說交叉比對工具

百度贴吧分布式爬虫，用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析

Massively Scalable Clustering

No description or website provided.

No description or website provided.

JDK source code reading

Page metadata as a service

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

OpenVPN VPN Gate Client for Linux, connects you to a random Free VPN in a country of your choice by country code.

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

京东App自动登录，在线商品自动下单

A simple web scraper built around the JavaFX WebEngine

Create a ZIM file from a Youtube channel/username/playlist

Robust and efficient library for management of asynchronous operations in C#/.Net.

ReactPHP bindings around ext-parallel

NAS Parallel Benchmark Kernels in C/C++. The parallel versions are in FastFlow, TBB, and OpenMP.

An efficient unidirectional remote backup daemon for CephFS.

No description or website provided.

Lwt-enabled distributed computing library

Monitors for restocks

There was no free Dictionary API on the web when I wanted one for my friend, so I created one.

On demand Debian Linux (Tor) Hotspot setup tool

A web scraper starter project

Socrata Open Data API (SODA) GET client for Golang

8bit parallel TFT & 4-line resistance touch screen Driver for esp-idf using i2s paralell mode

Open bank data for Leumi bank and Leumi card credit card

Search and download mangas from the command line