447 Open source projects that are alternatives of or similar to scavenger

Command line program to download documents from web portals.

🦀 Scraping & crawling websites using Rust, and ReasonML

A CLI for Mozilla Readability. Get clean, uncluttered, ready-to-read HTML from any webpage!

Declarative web scraping

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

ProxyCrawl Python library for scraping and crawling

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

**[ARCHIVED]** website changes tracker 🔍

Easily crawl news portals or blog sites using Storm Crawler.

Dynamic field for Laravel Nova

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel

Download images from reddit

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

A jQuery plugin that dynamically points one element at another ~

Dynamic class reloading for java。Java代码热更新，支持本地、远程

The dynamic queue

Modern Minimalistic Window Manager

Simulation Toolkit for Electrical Power Systems

extract videos from youtube in audio format using webscraping techniques 🎶

Kotlin Wrapper for Jsoup

Python (asyncio) wrapper for hackernews api

A website dedicated to making recipes from any website easy to read.

Dynamic Wallpapers for Linux

Form Bundle for handling Dynamic and Symfony Forms in https://sulu.io

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Dynamic loading library for C/C++

A Scrapy extension to log items coverage when the spider shuts down

📝 A template engine.

The simplest demo of chrome automation by python and selenium in AWS Lambda

a dynamic Agile.NET string decryptor that relies on invoke by wwh1004 | Version : 6.X

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Python port of R's Comprehensive Dynamic Time Warp algorithms package

The Angular CMS Framework for building fully-featured SPA sites powered by NodeJS and MongoDB with TypeScript

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Overwatch API library for player details and career stats

An open source web crawling platform

A easy, extensible and dynamic flutter form framework. Support for custom selectors, validators and widgets. Support form verification, insert, delete and so on.

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

Web Scraping Framework

No description or website provided.

At present contains scraped data from around 1500 problems present on the site. More to follow....

An standalone execution trace library built on DynamoRIO.

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

With Selenium headless browsing and CAPTCHA solving

RECSM-UPF Summer School: Social Media and Big Data Research

extract data from html table

λ Construct Linq queries using strings.

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

Leaflet.minichart is a leaflet plugin for adding to a leaflet map small animated charts

Telescope is an engine for efficiently creating meaningful visualizations

Generate dynamic webpack bundle output names from known or unknown entry files

Dynamic Project Builder

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

A URL shortener with protection against malicious redirects

Cards for your readme