scoopi-scraperScoopi Web Scraper is a heavy duty tool to extract data from HTML pages.
Stars: ✭ 18 (-68.42%)
unfurlExtract rich metadata from URLs
Stars: ✭ 41 (-28.07%)
YouTube-MA💾 YouTube video metadata archiver written in Golang
Stars: ✭ 17 (-70.18%)
Skrape.itA Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion.
Stars: ✭ 231 (+305.26%)
Geeknews📚A pure reading App based on Material Design + MVP + RxJava2 + Retrofit + Dagger2 + Realm + Glide
Stars: ✭ 3,496 (+6033.33%)
SkraperKotlin/Java library and cli tool for scraping posts and media from various sources with neither authorization nor full page rendering (Facebook, Instagram, Twitter, Youtube, Tiktok, Telegram, Twitch, Reddit, 9GAG, Pinterest, Flickr, Tumblr, IFunny, VK, Pikabu)
Stars: ✭ 72 (+26.32%)
ogePage metadata as a service
Stars: ✭ 22 (-61.4%)
Image searchPython Library to download images and metadata from popular search engines.
Stars: ✭ 86 (+50.88%)
scraperScraper example built on Scala, Akka and Jsoup
Stars: ✭ 15 (-73.68%)
UnfurlScraper for oEmbed, Twitter Cards and Open Graph metadata - fast and Promise-based ⚡️
Stars: ✭ 193 (+238.6%)
ScrapeDistributed Scraper
Stars: ✭ 65 (+14.04%)
MangDLThe most inefficient Manga downloader for PC
Stars: ✭ 40 (-29.82%)
jd-autobuyPython爬虫,京东自动登录,在线抢购商品
Stars: ✭ 1,262 (+2114.04%)
rexiv2Rust library for read/write access to media-file metadata (Exif, XMP, and IPTC)
Stars: ✭ 64 (+12.28%)
Kaop TsSimple Yet Powerful Library of ES2016 Decorators with Strongly typed method Interceptors like BeforeMethod, AfterMethod, OnException, etc
Stars: ✭ 235 (+312.28%)
Timber Elixir🌲 Great Elixir logging made easy
Stars: ✭ 226 (+296.49%)
just-titAdult video search engine
Stars: ✭ 60 (+5.26%)
FulltextSearch across and get full text for OA & closed journals
Stars: ✭ 221 (+287.72%)
VuvuzelaPrivate messaging system that hides metadata
Stars: ✭ 2,423 (+4150.88%)
lopezCrawling and scraping the Web for fun and profit
Stars: ✭ 20 (-64.91%)
diskover-communityDiskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch
Stars: ✭ 1,257 (+2105.26%)
scrapetubeGet all videos from a youtube channel, get all videos from a playlist, get all videos that match a search
Stars: ✭ 120 (+110.53%)
FrappejsNode + Electron + Vue based metadata web framework (inspired by Frappe)
Stars: ✭ 214 (+275.44%)
awesome-json-nextA Collection of What's Next for Awesome JSON (JavaScript Object Notation) for Structured (Meta) Data in Text - JSON5, HJSON, HanSON, TJSON, SON, CSON, USON, JSONX/JSON11 & Many More
Stars: ✭ 50 (-12.28%)
TwitterScraperScrape a User's Twitter data! Bypass the 3,200 tweet API limit for a User!
Stars: ✭ 80 (+40.35%)
file-extensionsJSON collection of scraped file extensions, along with their description and type, from FileInfo.com
Stars: ✭ 15 (-73.68%)
Node Google PlayGet details and download apps from https://play.google.com by emulating an Android (Nexus 5X) device by default. For a rust version of this library check out https://github.com/dweinstein/rs-google-play
Stars: ✭ 247 (+333.33%)
proxy-scraper⭐️ A proxy scraper made using Protractor | Proxy list Updates every three hour 🔥
Stars: ✭ 201 (+252.63%)
DicoogleDicoogle - Open Source PACS
Stars: ✭ 237 (+315.79%)
SavifyDownload Spotify songs to mp3 with full metadata and cover art!
Stars: ✭ 227 (+298.25%)
RedditExtractorA minimalistic R wrapper for the Reddit API
Stars: ✭ 58 (+1.75%)
LinqitExtend python lists with .NET's LINQ syntax for clean and fast coding. Also known as PINQ.
Stars: ✭ 222 (+289.47%)
attributesPHP Attributes Reader. Subtree split of the Spiral Attributes component (see spiral/framework)
Stars: ✭ 22 (-61.4%)
CodemetaMinimal metadata schemas for science software and code, in JSON-LD
Stars: ✭ 218 (+282.46%)
SfpowerkitA Salesforce DX Plugin with multiple functionalities aimed at improving development and operational workflows
Stars: ✭ 214 (+275.44%)
BiocPkgToolsComputable build reports, package metadata, and download stats from the Bioconductor project
Stars: ✭ 20 (-64.91%)
Structured FilterjQuery UI widget for structured queries like "Contacts where Firstname starts with A and Birthday before 1/1/2000 and State in (CA, NY, FL)"...
Stars: ✭ 213 (+273.68%)
ApolloApollo is a Open-Source music player for playback and organization of audio files on Microsoft Windows, built using Python.
Stars: ✭ 13 (-77.19%)
DatauriGenerate Data-URI scheme via terminal or node.js
Stars: ✭ 212 (+271.93%)
Geoportal ServerGeoportal Server is a standards-based, open source product that enables discovery and use of geospatial resources including data and services.
Stars: ✭ 210 (+268.42%)
siskinTasks around metadata.
Stars: ✭ 20 (-64.91%)
icecast-parserNode.js module for getting and parsing metadata from SHOUTcast/Icecast radio streams
Stars: ✭ 66 (+15.79%)
ShieldsConcise, consistent, and legible badges in SVG and raster format
Stars: ✭ 15,716 (+27471.93%)
Forensic ToolsA collection of tools for forensic analysis
Stars: ✭ 204 (+257.89%)
google-scraperThis class can retrieve search results from Google.
Stars: ✭ 33 (-42.11%)
where-is-resolverПопытка ответить на вопрос о резольверах, проверяющих домены из списка РКН
Stars: ✭ 49 (-14.04%)
metadata-qa-marcQA catalogue – a metadata quality assessment tool for library catalogue records (MARC, PICA)
Stars: ✭ 59 (+3.51%)
yellowpages-scraperYellowpages.com Web Scraper written in Python and LXML to extract business details available based on a particular category and location.
Stars: ✭ 56 (-1.75%)
Seo ManagerSeo Manager Package for Laravel ( with Localization )
Stars: ✭ 192 (+236.84%)
RegistrySchema Registry
Stars: ✭ 184 (+222.81%)
TradeTheEventImplementation of "Trade the Event: Corporate Events Detection for News-Based Event-Driven Trading." In Findings of ACL2021
Stars: ✭ 64 (+12.28%)