755 Open source projects that are alternatives of or similar to Crawling Projects

Генератор сырых дампов пользователей VK.

Simple WEB gui for infrastructure management by ansible playbooks or modules. This is only mirror with bins in releases.

Create you virus in termux!

A bullet-proof, fast, and reliable headless browser API

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

A simple, cross-platform GUI automation module for Python and Rust.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Bot for vk.com competitions

Web crawling and scraping framework for Golang

Tools for various online judges. Downloading sample cases, generating additional test cases, testing your code, and submitting it.

Fetch, store and access user agent strings for different browsers

UI test automation library for QtQuick/QML Apps

An open source web crawling platform

Flexible test automation for Python

Easily crawl news portals or blog sites using Storm Crawler.

Bernard is a voice assistant developed with gTTS. It can fulfill basic and simple tasks you give.

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Lightweight full-featured typescript/javascript WhatsApp Web API

A dataset for textual analysis on arguably the best written comedy television show ever.

📹 Data-driven render automation for After Effects

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

Automated image Editing, Optimization and Analysis via CLI and a web interface. You give to lepto your input and output directories, the plugins you want to use and their options. Then lepto does his job, you keep your original files and the structure of the input directory. Some plugins can even collect data (like primary colors) from your images and save them in a JSON file.

github repo for MyAnimeList analysis. Also links to the MAL dataset.

Cisco IOS diff tool

The complete web scraping toolkit for PHP.

AutoHotkey - macro-creation and automation-oriented scripting utility for Windows.

PHP library to find podcasts

A program to monitor and control 8 variables of a hydroponic gardening system

SimFin's open source PDF crawler

A community-developed, free, open source, microservices API automation and load testing framework built using JUnit core runners for Http REST, SOAP, Security, Database, Kafka and much more. Zerocode Open Source enables you to create, change, orchestrate and maintain your automated test cases declaratively with absolute ease.

Headless Chrome Node.js API

A command line visual file manager for linux

Cross platform input simulation in Rust

Nginx with automatic let's encrypt (docker image)

Digital Rebar Provision is a simple and powerful Golang executable that provides a complete API-driven DHCP/PXE/TFTP provisioning system.

Ansible based Homeserver setup using Docker

A node.js library for testing modern web applications

A GitHub action to create a pull request for changes to your repository in the actions workspace

Travis-like Jenkins job generation using Job DSL plugin groovy scripts. Reads .travis.yml and generates a job in Jenkins.

pre-commit git hooks to take care of Terraform configurations

My solutions for the projects in automate the boring stuff with python

💩⭐️🚀A #app with cutting edge technology to #minimize windows-10 telemetry and #maximize privacy plus many more

A Ruby interface to nmap, the exploration tool and security / port scanner. Allows automating nmap and parsing nmap XML files.

A Puppeteer bridge for PHP, supporting the entire API.

[DEPRECATED] Cucumber.js plugin for Nightwatch.js.

Build powerful pipelines in any programming language.

Docker-powered usenet pipeline

A Scrapy Spider for downloading PDF files from a webpage.

A GitHub action that facilitates "ChatOps" by creating repository dispatch events for slash commands

Anno-Mage: A Semi Automatic Image Annotation Tool which helps you in annotating images by suggesting you annotations for 80 object classes using a pre-trained model

The Unix Shell

The simplest way to de-Google your life and business: Inbox, Calendar, Files, Contacts & much more

Native UI testing / controlling with node

Install and manage a high performance WordPress stack with a few keystrokes

BeGoneAds is a script that puts some popular hosts file lists into the systems hosts file as a adblocker measure.

Continuous Auditing & Configuration

Automated script for Whole Foods and Amazon Fresh delivery slot

A Mac tool that finds available delivery slots for Amazon's Whole Foods delivery and Amazon Fresh services

Automate and relate multiple processes.

Terraform for setting up my personal infrastructure