429 Open source projects that are alternatives of or similar to metafetch

Command line program to download documents from web portals.

Implementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Declarative web scraping

Scraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based ⚡️

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs

**[ARCHIVED]** website changes tracker 🔍

🎬 An attempt at the most complete IMDb API

A tutorial-based introduction to web scraping with Python.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

At present contains scraped data from around 1500 problems present on the site. More to follow....

ProxyCrawl Python library for scraping and crawling

Get Aliexpress product details in JSON

Instagram comment scraper using python and selenium. Save the comments into excel.

An open source webapp for scraping: towards a public service for webscraping

A web scraper starter project

PHP Metacritic API - Mirrored by my GitLab

Generate HTML meta tags from JSON data.

Download Impartus lectures, convert to mkv for offline viewing.

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info

No description or website provided.

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

WIP Patreon attachment download written in TypeScript

Read an Amazon wishlist programmatically with Python

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

A simple web scraper built around the JavaFX WebEngine

百度贴吧分布式爬虫，用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析

A console application that can scrape the Azur Lane wiki and export the data to Json files

A repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

AngularJS SPA interface for awesome lists. Awesome lists parsed using python.

Access parts of your account unavailable through normal YouTube API access.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.

Scrapes VK user's photos

API for fetching data from news websites.

Laravel Assets manager

Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

This repository provides usage examples for the Python module Newspaper3k.

Code relating to scraping public police data.

A library for fetching song lyrics & album art from genius.com 🎶🌈

Search and download mangas from the command line

Whisper of the arxiv: read comments in tex of papers

A monadic web scraping library

A Python package for acquiring both historical and current data of cryptocurrencies

A free TVTime API based on scraping TVTime website. No API key required

News extraction and scraping. Article Parsing

A Go scraper that validates security.txt files and outputs them in the disclose.io JSON format.

Scrapers for many e-SAJ systems

Covenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

client for https://ammobin.ca

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

No description or website provided.

Spin up Tor containers and then proxy HTTP requests via these Tor instances

A web spider for shodan.io without using the Developer API.

Page metadata as a service

Scrape and take screenshots of dynamic and static webpages

A simple web scraping engine supporting concurrent and anonymous scraping