391 Open source projects that are alternatives of or similar to scraper

web scraping extension

Extract emails from a given website

...Just a place for me to share my various YT-DLP & related bash scripts.

NTU CEIBA 資料下載工具

Scraping Visually Similar Images from Pinterest

NodeJS application for scraping recent top posts from Instagram by hashtag without API access.

Bulk Downloader for Reddit

StackExchange websites to ZIM scraper

Unofficial client to access your Itaú bank data

Automated Tinder bot and scraper using selenium in python.

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音|TikTok数据爬取工具，支持API调用，在线批量解析及下载。

Parallel Searching and Crawling Data from PTT 🚀

在线爬虫，online web scraper

Continuously search imageboards threads for images/webms and download them

Download public videos on TikTok using Python with Selenium

图片爬取下载工具，极速爬取下载 站酷https://www.zcool.com.cn/, CNU 视觉 http://www.cnu.cc/ 设计师/用户 上传的 图片/照片/插画。

👾 Fast and simple video download library and CLI tool written in Go

Scrape boards and threads from 4chan (8kun WIP). Downloads images, videos and HTML if desired.

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

A web crawler for Go

An easiest crawling and scraping module for NestJS

Twitter High level scraper for humans.

Download subreddit comments

scraper for facebook, gab, google and tiktok

A extensible app for scraping property listings

Scripts to maintain German law git repository

🌎 🏨 Scrape Booking.com 🏨 🌎

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets

Extract rich metadata from URLs

A LinkedIn Scraper to scrape up to 10k LinkedIn profiles from company profile links and save their e-mail addresses if available!

Python API to extract data from rateyourmusic.com.

A JS package for scraping recipes from the web.

❄️ Extract links, ids, and names from a youtube playlist

Easily allows for scraping a VSCO

Simple Flickr Image Scraper

Converts website to json using jQuery selectors

robots.txt file parsing and checking for R

Aviation charts

Extract all employees from LinkedIn. Especially useful for companies with thousands of employees.

Grabs all of the audio files from all of the Blinkist books

Using this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.

[Deprecated - Maintenance mode - use APIs directly please!] The official Diffbot client library

Automation for updating an index of live George Floyd protest streams

Essential PHP library that scrapes HTTP(S) and UDP trackers for torrent information.

Scrape all the media from an OnlyFans account - Updated regularly

Analyse all kinds of data for a TV series

A scraper for videos that are trending on YouTube (https://www.youtube.com/feed/trending)

Proof of concept for a security issue (in my opinion) that I found in accounts.google.com

Tools for downloading agendas, minutes and other documents produced by local government

A scraper for obtaining information on the workings of the Belgian Federal Parliament.

Fast concurrent image scraper

Web scraping using python, requests and selenium

Instagram get images 🌄 (hashtags, account, locations) with puppeteer

Scrape everything you can from MyAnimeList.net

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

At present contains scraped data from around 1500 problems present on the site. More to follow....

By serving course 📚 data that is more "edible" 🍰 for developers, we hope CourseCake offers a smooth approach to build useful tools for students.

💾 YouTube video metadata archiver written in Golang

A Python class that scrapes ESRI Rest Endpoints and exports data to a geodatabase