888 Open source projects that are alternatives of or similar to torchestrator

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

Python library for IP2Proxy database lookup. It can be used to find the IP addresses which are used as VPN anonymizer, open proxies, web proxies and Tor exits.

With Selenium headless browsing and CAPTCHA solving

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

An easy to use open-source, multithreaded Proxy Checker. Allows you to quickly check HTTP and SOCKS proxies in a user friendly GUI, for Windows, Mac OS, Linux.

a class that uses scraped proxies to make http GET/POST requests (Python requests)

免费、高速的 V2Ray 代理和订阅。

List of libraries, tools and APIs for web scraping and data processing.

Tiny Library for get random proxy (free).

A test suite of common scraper detection techniques. See how detectable your scraper stack is.

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to scrape both normal and onion links. Happy Scraping :)

A Scrapy extension to log items coverage when the spider shuts down

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

A framework for creating semi-automatic web content extractors

Containerized pool of multiple Tor instances with load balancing and HTTP proxy.

IP2Proxy Java Component.It can be used to find the IP addresses which are used as VPN anonymizer, open proxies, web proxies and Tor exits.

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Go Mod Repository, Go Vanity Server and Proxy Server

A web search engine built with Python which uses TF-IDF and PageRank to sort search results.

Tor v3 onion services (hidden services) for Docker containers

An HTTP proxy server written in C# and targeting .NET Core 3.

Scrapy project boilerplate done right

high-performance minimal HTTP reverse proxy

Python分布式爬虫打造搜索引擎

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star

The Red Rabbit project is just what a hacker needs for everyday automation. Red Rabbit unlike most frameworks out there does not automate other peoples tools like the aircrack suite or the wifite framework, it rather has its own code and is raw source with over 270+ options. This framework might just be your everyday key to your workflow

A Web Crawler that scrapes using YAML and python code.

extract videos from youtube in audio format using webscraping techniques 🎶

Easily crawl news portals or blog sites using Storm Crawler.

NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider

A Python 3 standalone Windows 10 / Linux Rootkit using Tor.

👍 京东爬虫（大量注释，对刚入门爬虫者极度友好）

A simple way to create a Tor onion service for existing Docker containers.

Experiences in extracting data from Facebook with these 3 methods: Facebook Graph API, Automation tools, DevTools Console

JAVA实现的IP代理池，支持HTTP与HTTPS两种方式

Custom security distro for remote penetration testing

A Prometheus proxy that performs SpiceDB permission checks based on labels

this is a python module that contains functions and classes which are used to test the security of web/network applications. it's coded on pure python and it's very intelligent tool ! It can easily detect: XSS (relected/stored), RCE (Remote Code/Command Execution), SSTI, SSRF, CORS Misconfigurations, File Upload, CSRF, Path Traversal,.... Also, …

Download images from reddit

OpenVPN client with killswitch and proxy servers; built on Alpine

A repository of Tor hidden services.

EasyList Tracker and Adblocks to Proxy Auto Configuration (PAC) File and Privoxy Actions and Filters

At present contains scraped data from around 1500 problems present on the site. More to follow....

古汉语(文言文)字典-爬取文言文字典网,制作Kindle字典.

The simplest demo of chrome automation by python and selenium in AWS Lambda

爬虫学习仓库，适合零基础的人学习，对新手比较友好

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

爬取拉勾、BOSS直聘、智联招聘、51job、赶集招聘、58招聘等职位信息

A simple and fast anti-censorship tool written in Go

Command-line utility to convert HTML tables into CSV files

VPN AutoScript

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Using Scrapy to crawl Autohome, storage into MonogDB, simple analysis and NLP coming soon

A windows port of Privoxy project

TOR Server Docker image

UFC bout winner prediction using neural nets.

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.