443 Open source projects that are alternatives of or similar to Android-Apps-Downloader

Whisper of the arxiv: read comments in tex of papers

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

A repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.

API for fetching data from news websites.

A web scraper starter project

A tutorial-based introduction to web scraping with Python.

A handbook for those who want to start coordinating Hacky Hour events in their University/Institute

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

Get Aliexpress product details in JSON

A Python package for acquiring both historical and current data of cryptocurrencies

AngularJS SPA interface for awesome lists. Awesome lists parsed using python.

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

A library for fetching song lyrics & album art from genius.com 🎶🌈

Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info

Scraping the Un–scrapable™

News extraction and scraping. Article Parsing

Covenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA: [email protected]

The Proyecto26 github homepage.

LinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.

百度贴吧分布式爬虫，用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析

Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.

Command line program to download documents from web portals.

Instagram application for Django.

Download Impartus lectures, convert to mkv for offline viewing.

🎬 An attempt at the most complete IMDb API

Instagram comment scraper using python and selenium. Save the comments into excel.

No description or website provided.

Collection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.

A React.js based web-app to find repositories containing 'good first issues' open source contribution. Any kind of contribution and suggestions are highly appreciated!

LiqPay integration extension for Magento 2

Julia package for network research

Interactive CLI Web Crawler

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

Multithreaded Web spider crawler written in Rust.

A Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.

WIP Patreon attachment download written in TypeScript

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

Automatic problem solver based on circuit-like representation and genetic programming

A web spider for shodan.io without using the Developer API.

🕸 List of mini projects that involve web scraping 🕸

A simple web scraping engine supporting concurrent and anonymous scraping

Scraping the status of WhatsApp contacts

Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news

PHP Metacritic API - Mirrored by my GitLab

The QuantGov Library

Scoopi Web Scraper is a heavy duty tool to extract data from HTML pages.

An open source webapp for scraping: towards a public service for webscraping

Read an Amazon wishlist programmatically with Python

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

An api to check social media username availability on a variety of services

Access parts of your account unavailable through normal YouTube API access.

client for https://ammobin.ca

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Python script to download messages from a Facebook page to a CSV file

A console application that can scrape the Azur Lane wiki and export the data to Json files

Discord music bot written in Typescript

Yet Another LInkedIn Scraper...

🚆This web scraper builds a dataset for São Paulo subway operation status

NodeJS package that fetches a given URL's title, description, images, links etc.

Self-hosted music sheet organizing software