240 Open source projects that are alternatives of or similar to internet-affordability

Download images from reddit

A website dedicated to making recipes from any website easy to read.

ProxyCrawl Python library for scraping and crawling

🔎Search LinkedIn profile by email address📧

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Open Graph Protocol Parser for Node.js

With Selenium headless browsing and CAPTCHA solving

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

scrapers for building your own image databases

Scrape and take screenshots of dynamic and static webpages

Easily crawl news portals or blog sites using Storm Crawler.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Python (asyncio) wrapper for hackernews api

Namecoin full node + wallet based on the current Bitcoin Core codebase.

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

A Selenium-driven tool for automated website interaction and scraping.

Red Hat Dependency Analytics extension

👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.

An open source web crawling platform

extract data from html table

📊 Python tool to scrape real-time information about ETFs from the web and mixing them together by proportionally distributing their assets allocation

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Mastering the art of scrapping 🎓

🦀 Scraping & crawling websites using Rust, and ReasonML

Command line program to download documents from web portals.

The simplest demo of chrome automation by python and selenium in AWS Lambda

A PHP Scraping Class

An open encyclopedia of Internet censorship

💡👀 Read EPUB books with built-in insights from wikis, definitions, translations, and Google.

Overwatch API library for player details and career stats

Scrapping Facebook with JavaScript.

Web Scraping Framework

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

A Scrapy extension to log items coverage when the spider shuts down

Project Lockdown (an initiative from The IO Foundation) is a civic tech, interactive platform providing an overview of the state of Human and Digital Rights around the globe. It evaluates policies obtained from official sources that may impact their observance. It provides, among other tools, a layered map interface that allows for a visual repr…

nrql-simple provides a convenient way to interact with the New Relic Insights query API.

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

Command-line utility to convert HTML tables into CSV files

Generate JSON representations of HTML tables

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

🌱 Get insights into the current state of Veganism around the world based on global news

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

No description or website provided.

Kotlin Wrapper for Jsoup

Gain insights about thenewboston digital crypto currency network by doing some analysis

Your good mornings ☀️

Web crawling and scraping framework for Golang

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs