622 Open source projects that are alternatives of or similar to chirps

Schedules tweets using TweetDeck

Social media scraping / data collection library for Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

📇 Extract social media profiles and more with regular expressions

Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🔎Search LinkedIn profile by email address📧

Transform unstructured document collections to structured Linked Data

No description or website provided.

Download images from reddit

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

An open source web crawling platform

Crawl sites for RSS, Atom, and JSON feeds.

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

Open Graph Protocol Parser for Node.js

Easily crawl news portals or blog sites using Storm Crawler.

Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as Airbyte, dbt, or Great Expectations together in one intuitive interface built with React Flow. In addition we provide third-party data into data sc…

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

Overwatch API library for player details and career stats

Web Scraping Framework

🌍 Dataset that shows the Internet affordability by country (a shocking reality!)

Mastering the art of scrapping 🎓

A Scrapy extension to log items coverage when the spider shuts down

ProxyCrawl Python library for scraping and crawling

Command line program to download documents from web portals.

Command-line utility to convert HTML tables into CSV files

Library to download subtitles from subscene.com

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

Web crawling and scraping framework for Golang

Kotlin Wrapper for Jsoup

Easily download the main content of a web page in html, markdown, and/or epub format from command line.

extract data from html table

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.

🦀 Scraping & crawling websites using Rust, and ReasonML

🕸 List of mini projects that involve web scraping 🕸

The simplest demo of chrome automation by python and selenium in AWS Lambda

Spin up Tor containers and then proxy HTTP requests via these Tor instances

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Python (asyncio) wrapper for hackernews api

Scrape and take screenshots of dynamic and static webpages

A website dedicated to making recipes from any website easy to read.

HTML parsing and processing tool for PowerShell.

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

With Selenium headless browsing and CAPTCHA solving

The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

A PHP Scraping Class

A Selenium-driven tool for automated website interaction and scraping.

Generate JSON representations of HTML tables

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Download images from Google Image Search