424 Open source projects that are alternatives of or similar to AzurLaneWikiScrapers

PHP Scraper - an highly opinionated web-interface for PHP

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

A list of scrapers from around the web.

📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

A collection of awesome web crawler,spider in different languages

A simple browser/client-side web scraper.

Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.

Scrapes VK user's photos

Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.

No description or website provided.

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC compression and URL-agnostic deduplication.

An open source webapp for scraping: towards a public service for webscraping

A Go scraper that validates security.txt files and outputs them in the disclose.io JSON format.

A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.

A simple yet comprehensive web scraper for kenpom.com.

Access parts of your account unavailable through normal YouTube API access.

京东App自动登录，在线商品自动下单

No description or website provided.

All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!

A web spider for shodan.io without using the Developer API.

Download Impartus lectures, convert to mkv for offline viewing.

There was no free Dictionary API on the web when I wanted one for my friend, so I created one.

Open bank data for Leumi bank and Leumi card credit card

Scraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)

ProxyCrawl Python library for scraping and crawling

Search and download mangas from the command line

Get Aliexpress product details in JSON

A monadic web scraping library

News extraction and scraping. Article Parsing

A free TVTime API based on scraping TVTime website. No API key required

Command line program to download documents from web portals.

Scrapers for many e-SAJ systems

Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info

Page metadata as a service

A web scraper starter project

A PHP Scraping Class

A command line program to download hentai videos and images from multiple websites

Create a ZIM file from a Youtube channel/username/playlist

Instagram Bot which when given a post url will spam mentions to increase the chances of winning. Win Instagram Giveaways!

Monitors for restocks

AngularJS SPA interface for awesome lists. Awesome lists parsed using python.

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!

Scraper for downloading the entire ebooks repository of project Gutenberg

A simple web scraping engine supporting concurrent and anonymous scraping

Node.js based scraper using headless chrome

State of the art object detection in real-time using YOLOV3 algorithm. Augmented with a process that allows easy training of the classifier as a plug & play solution . Provides alert if an item in an alert list is detected.

Whisper of the arxiv: read comments in tex of papers

Using this tool you can easily add so many members from any group to your group. Less than 2 minutes. Super easy. Time saver. But this tool is only for educational purpose. You could be banned from Telegram. So be careful. Recommanded to use this tool only on Termux.

A crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.

No description or website provided.

Open Source Unofficial json based api that returns Azur Lane data

At present contains scraped data from around 1500 problems present on the site. More to follow....

Web service and CLI tool for SEO site audit: crawl site, lighthouse all pages, view public reports in browser. Also output to console, json, csv, xlsx, Google Drive.

❄️ Extract links, ids, and names from a youtube playlist

Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

Twitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news

🔎 A simple yet powerful module to retrieve organic search results and much more from Google.

Tools for downloading agendas, minutes and other documents produced by local government