700 Open source projects that are alternatives of or similar to gutenberg

Scrape all the media from an OnlyFans account - Updated regularly

localForage中文仓库，localForage改进了离线存储，提供简洁健壮的API，包括 IndexedDB, WebSQL, 和 localStorage。

Declarative DOM extraction expression evaluator. 👨‍⚕️

NodeJS application for scraping recent top posts from Instagram by hashtag without API access.

HTTP API for Scrapy spiders

Pahe.ph [Pahe.in] Movies Website Scraper

✂️ High performance, multi-threaded image scraper

Bulk Downloader for Reddit

Distributed crawler powered by Headless Chrome

Python爬虫，京东自动登录，在线抢购商品

A Facebook crawler

Using Azure SQL Change Tracking API to Sync mobile Apps data with the Cloud

Unofficial MyAnimeList PHP+REST API which provides functions other than the official API

⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥

Scrapes Reddit to download media of your choice.

Scrape boards and threads from 4chan (8kun WIP). Downloads images, videos and HTML if desired.

Unofficial API for finviz.com

Get all videos from a youtube channel, get all videos from a playlist, get all videos that match a search

Declarative web scraping

👾 Fast and simple video download library and CLI tool written in Go

Extract structured data from web sites. Web sites scraping.

Search as you type in Zim, in similar manner to OneNote Ctrl+E.

Crawl BookCorpus

Extract emails from a given website

A social networking service scraper in Python

This class can retrieve search results from Google.

OSINT Swiss Army Knife

robots.txt file parsing and checking for R

📊 Financial markets data library implemented in go.

Implementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021

Information Gathering Instagram.

WordPress block editor framework

A tiny Node.js microservice to scrape open graph data with joy.

🏠 a.k.a 591 rent scraper（591 租屋網爬蟲）

A Python Tool For google Hacking

Extract all employees from LinkedIn. Especially useful for companies with thousands of employees.

快速、简洁且强大的PHP爬虫框架

Scrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!

JavGo是一个集合影片管理，影片刮削，视频处理，资源搜索等综合一体的全功能影音软件，支持爬取javbus，jav321，javdb，javlibrary进行刮削，支持db，bus的磁力搜索，支持获取library的影片评论。

14k offline-capable journaling PWA using preact, node, MySQL, and IndexedDB.

Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy

A script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku

An extremely fast web scraper that parses megabytes of invalid HTML in a blink of an eye. PHP5.3+, no dependencies.

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Ruby gem to inspect completely a web page. It scrapes a given URL, and returns you its meta, links, images more.

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

An R web crawler and scraper

A web crawler for Go

🍭 epub generator for (light)novels (轻) 小说 epub 生成器，支持站点：轻之国度、轻小说文库

A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.

A Simple Proxy Scraper

Automation for updating an index of live George Floyd protest streams

An API to easily get data from the University of Pittsburgh

reborn of https://bitbucket.org/rflechner/scrapysharp

ProxyCrawl Python library for scraping and crawling

Node.js based scraper using headless chrome

At present contains scraped data from around 1500 problems present on the site. More to follow....

A Gutenberg-ready WordPress theme.

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

kainstall tools offline file