JavgoJavGo是一个集合影片管理,影片刮削,视频处理,资源搜索等综合一体的全功能影音软件,支持爬取javbus,jav321,javdb,javlibrary进行刮削,支持db,bus的磁力搜索,支持获取library的影片评论。
Stars: ✭ 338 (+279.78%)
opensea-scraperScrapes nft floor prices and additional information from opensea. Used for https://nftfloorprice.info
Stars: ✭ 129 (+44.94%)
docker-amvdAMVD is a Lidarr companion script to automatically download and tag Music Videos for use in other video applications (plex/kodi/jellyfin/emby)
Stars: ✭ 58 (-34.83%)
SpydanA web spider for shodan.io without using the Developer API.
Stars: ✭ 30 (-66.29%)
AzurLaneWikiScrapersA console application that can scrape the Azur Lane wiki and export the data to Json files
Stars: ✭ 12 (-86.52%)
metafetchNodeJS package that fetches a given URL's title, description, images, links etc.
Stars: ✭ 21 (-76.4%)
WaGpScraperA Python Oriented tool to Scrap WhatsApp Group Link using Google Dork it Scraps Whatsapp Group Links From Google Results And Gives Working Links.
Stars: ✭ 18 (-79.78%)
ogcheckr-apiAn api to check social media username availability on a variety of services
Stars: ✭ 18 (-79.78%)
tieba-zhuaqu百度贴吧分布式爬虫,用于贴吧数据挖掘。从贴吧维度和用户维度进行数据分析
Stars: ✭ 56 (-37.08%)
Scraper-Projects🕸 List of mini projects that involve web scraping 🕸
Stars: ✭ 25 (-71.91%)
yt-videos-listCreate and **automatically** update a list of all videos on a YouTube channel (in txt/csv/md form) via YouTube bot with end-to-end web scraping - no API tokens required. Multi-threaded support for YouTube videos list updates.
Stars: ✭ 64 (-28.09%)
awesome-interfaceAngularJS SPA interface for awesome lists. Awesome lists parsed using python.
Stars: ✭ 25 (-71.91%)
spiderMultithreaded Web spider crawler written in Rust.
Stars: ✭ 81 (-8.99%)
docker-amtdAMTD is a Radarr companion script to automatically download movie trailers and extras for use in other video applications (plex/kodi/jellyfin/emby)
Stars: ✭ 78 (-12.36%)
genius-lyrics-apiA library for fetching song lyrics & album art from genius.com 🎶🌈
Stars: ✭ 129 (+44.94%)
Mimo-CrawlerA web crawler that uses Firefox and js injection to interact with webpages and crawl their content, written in nodejs.
Stars: ✭ 22 (-75.28%)
Android-Apps-Downloader📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
Stars: ✭ 16 (-82.02%)
crawlkitA crawler based on Phantom. Allows discovery of dynamic content and supports custom scrapers.
Stars: ✭ 23 (-74.16%)
patreon-scraperWIP Patreon attachment download written in TypeScript
Stars: ✭ 25 (-71.91%)
OpenScraperAn open source webapp for scraping: towards a public service for webscraping
Stars: ✭ 80 (-10.11%)
sp-subway-scraper🚆This web scraper builds a dataset for São Paulo subway operation status
Stars: ✭ 24 (-73.03%)
youtube-unofficialAccess parts of your account unavailable through normal YouTube API access.
Stars: ✭ 33 (-62.92%)
metacritic apiPHP Metacritic API - Mirrored by my GitLab
Stars: ✭ 31 (-65.17%)
OLX Scraper📻 An OLX Scraper using Scrapy + MongoDB. It Scrapes recent ads posted regarding requested product and dumps to NOSQL MONGODB.
Stars: ✭ 15 (-83.15%)
CoinstaA Python package for acquiring both historical and current data of cryptocurrencies
Stars: ✭ 47 (-47.19%)
scoopi-scraperScoopi Web Scraper is a heavy duty tool to extract data from HTML pages.
Stars: ✭ 18 (-79.78%)
imdb-scraper🎬 An attempt at the most complete IMDb API
Stars: ✭ 24 (-73.03%)
linkyYet Another LInkedIn Scraper...
Stars: ✭ 44 (-50.56%)
Instagram-Comments-ScraperInstagram comment scraper using python and selenium. Save the comments into excel.
Stars: ✭ 73 (-17.98%)
fb-page-chat-downloadPython script to download messages from a Facebook page to a CSV file
Stars: ✭ 51 (-42.7%)
newsembleAPI for fetching data from news websites.
Stars: ✭ 42 (-52.81%)
Captcha-ToolsAll-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha and Anticaptcha API's!
Stars: ✭ 23 (-74.16%)
scrapy facebookerCollection of scrapy spiders which can scrape posts, images, and so on from public Facebook Pages.
Stars: ✭ 22 (-75.28%)
arxiv leaksWhisper of the arxiv: read comments in tex of papers
Stars: ✭ 22 (-75.28%)
linkedinscraperLinkedinScraper is an another information gathering tool written in python. You can scrape employees of companies on Linkedin.com and then create these employee names, titles and emails.
Stars: ✭ 22 (-75.28%)
newspaperjsNews extraction and scraping. Article Parsing
Stars: ✭ 59 (-33.71%)
evineInteractive CLI Web Crawler
Stars: ✭ 140 (+57.3%)
rename-keysModify/rename the keys of the own enumerable properties of an object.
Stars: ✭ 28 (-68.54%)
berlin corona casesScraper for the official dashboard with current Corona case numbers, traffic light indicators ("Corona-Ampel") and vaccination situation for Berlin.
Stars: ✭ 19 (-78.65%)
web-scraping-engineA simple web scraping engine supporting concurrent and anonymous scraping
Stars: ✭ 27 (-69.66%)
TrollHunterTwitter Troll & Fake News Hunter - Crawls news websites and twitter to identify fake news
Stars: ✭ 38 (-57.3%)
UniBorgPluggable Telegram bot and userbot based on Telethon
Stars: ✭ 196 (+120.22%)
aliexscrapeGet Aliexpress product details in JSON
Stars: ✭ 80 (-10.11%)
plugin.video.covenantCovenant Kodi Addon Development - Kodi is a registered trademark of the XBMC Foundation. We are not connected to or in any other way affiliated with Kodi - DMCA:
[email protected] Stars: ✭ 24 (-73.03%)
document-dlCommand line program to download documents from web portals.
Stars: ✭ 14 (-84.27%)
discord-musicDiscord music bot written in Typescript
Stars: ✭ 12 (-86.52%)
scraperA web scraper starter project
Stars: ✭ 18 (-79.78%)
peeling-onionsA repository to store Deep Web (onion domain) crawler, scraper, and NLP tools for Tor network.
Stars: ✭ 18 (-79.78%)
impartus-downloaderDownload Impartus lectures, convert to mkv for offline viewing.
Stars: ✭ 19 (-78.65%)
pysoundcloudScraping the Un–scrapable™
Stars: ✭ 63 (-29.21%)
stock-market-scraperScraps historical stock market data from Yahoo Finance (https://finance.yahoo.com/)
Stars: ✭ 110 (+23.6%)
covid-19Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.
Stars: ✭ 15 (-83.15%)
extract-cssExtract all CSS from a webpage, packaged as a Now V2 Lambda
Stars: ✭ 23 (-74.16%)
papercutPapercut is a scraping/crawling library for Node.js built on top of JSDOM. It provides basic selector features together with features like Page Caching and Geosearch.
Stars: ✭ 15 (-83.15%)