Functions to be implemented before release
- Download all ship data
- Download all ship images
- Download all event data
- Download all event images
- (In Progress) Download all equipment data
- (In Progress) Download all equipment images
Myuuiii / AzurLaneWikiScrapers
Licence: other
A console application that can scrape the Azur Lane wiki and export the data to Json files
Stars: ✭ 12
Programming Languages
C#
18002 projects
Projects that are alternatives of or similar to AzurLaneWikiScrapers
Linkedin-Client
Web scraper for grabing data from Linkedin profiles or company pages (personal project)
Stars: ✭ 42 (+250%)
Mutual labels: scraper, web-scraper
Awesome Crawler
A collection of awesome web crawler,spider in different languages
Stars: ✭ 4,793 (+39841.67%)
Mutual labels: scraper, web-scraper
Scrapers
A list of scrapers from around the web.
Stars: ✭ 366 (+2950%)
Mutual labels: scraper, web-scraper
Phpscraper
PHP Scraper - an highly opinionated web-interface for PHP
Stars: ✭ 148 (+1133.33%)
Mutual labels: scraper, web-scraper
Scrape Linkedin Selenium
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Stars: ✭ 239 (+1891.67%)
Mutual labels: scraper, web-scraper
Getsy
A simple browser/client-side web scraper.
Stars: ✭ 238 (+1883.33%)
Mutual labels: scraper, web-scraper
Spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
Stars: ✭ 656 (+5366.67%)
Mutual labels: scraper, web-scraper
yellowpages-scraper
Yellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (+366.67%)
Mutual labels: scraper, web-scraper
OLX Scraper
📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (+25%)
Mutual labels: scraper, web-scraper
OpenScraper
An open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (+566.67%)
Mutual labels: scraper
Mimo-Crawler
A web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Stars: ✭ 22 (+83.33%)
Mutual labels: scraper
yt-videos-list
Create and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
Stars: ✭ 64 (+433.33%)
Mutual labels: scraper
newspaperjs
News extraction and scraping. Article Parsing
Stars: ✭ 59 (+391.67%)
Mutual labels: scraper
document-dl
Command line program to download documents from web portals.
Stars: ✭ 14 (+16.67%)
Mutual labels: scraper
opensea-scraper
Scrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info
Stars: ✭ 129 (+975%)
Mutual labels: scraper
youtube-unofficial
Access parts of your account unavailable through normal YouTube API access.
Stars: ✭ 33 (+175%)
Mutual labels: scraper
awesome-interface
AngularJS SPA interface for awesome lists. Awesome lists parsed using python.
Stars: ✭ 25 (+108.33%)
Mutual labels: scraper
Captcha-Tools
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!
Stars: ✭ 23 (+91.67%)
Mutual labels: scraper
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].