309 Open source projects that are alternatives of or similar to subscene_scraper

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

🦀 Scraping & crawling websites using Rust, and ReasonML

[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3

Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.

视频硬字幕提取，生成srt文件。无需申请第三方API，本地实现文本识别。基于深度学习的视频字幕提取框架，包含字幕区域检测、字幕内容提取。A GUI tool for extracting hard-coded subtitle (hardsub) from videos and generating srt files.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

Scrapping Facebook with JavaScript.

Command-line utility to convert HTML tables into CSV files

Tool for extracting comments or subtitles from youtube video's

This script is used to scrap images from the Internet to classify 5 common noodle "mee" dishes in Singapore. Wanton Mee, Bak Chor Mee, Lor Mee, Prawn Mee and Mee Siam.

golang library to read and write various subtitle formats

Your good mornings ☀️

Subox是一个基于 Electron 开发的以媒体资源文件为基础的字幕搜索桌面应用。可根据设定的搜索目录和忽略路径索引所有可播放的资源文件，并且以文件名为基础索引字幕文件或者辅助搜索字幕文件并下载。

Scrape and take screenshots of dynamic and static webpages

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

Subtitle editor for Emacs

Fix Arabic and Persian subtitles by converting them into UTF-8

Overwatch API library for player details and career stats

A tool for converting Web Video Text Tracks Format (WebVTT) subtitle to srt one. As most of video players support srt subtitles and can't open vtt subtitles, We should convert vtt to srt or sub subtitles but it's not easy to do that.

Web Scraping Framework

subtitle merger is a tool for merging two or more subtitles for videos.

No description or website provided.

A Scrapy extension to log items coverage when the spider shuts down

Open Graph Protocol Parser for Node.js

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

An open source web crawling platform

No description or website provided.

Kotlin Wrapper for Jsoup

Transform unstructured document collections to structured Linked Data

extract data from html table

A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!

Command line program to download documents from web portals.

🔎Search LinkedIn profile by email address📧

Mastering the art of scrapping 🎓

Easily crawl news portals or blog sites using Storm Crawler.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Download images from reddit

A PHP Scraping Class

The simplest demo of chrome automation by python and selenium in AWS Lambda

Web crawling and scraping framework for Golang

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Simple and friendly Bot for Instagram, using Selenium and Scrapy with Python.

Toolkit for supporting the EBU-TT Live specification

🌍 Dataset that shows the Internet affordability by country (a shocking reality!)

Python (asyncio) wrapper for hackernews api

This is an subtitle package for flutter video player.

A website dedicated to making recipes from any website easy to read.

Rubium is a lightweight alternative to Selenium/Capybara/Watir if you need to perform some operations (like web scraping) using Headless Chromium and Ruby

ProxyCrawl Python library for scraping and crawling

Crawl sites for RSS, Atom, and JSON feeds.

Stage display viewer in java for propresenter

koustMoviePlayer is similar netflix player. Almost , available all features on koustMoviePlayer

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!