100 Open source projects that are alternatives of or similar to parquet-usql

A collection of tools for extracting FHIR resources and analytics services on top of that data.

A application made to extract assets from cache files of H2v using BlamLib by KornnerStudios.

Terraform scripts for deploying Apiary Data Lake

Library to read a subset of Parquet files

A SQLite vtable extension to read Parquet files

Python idiomatic SDK for Cortex™ Data Lake.

(Not actively maintained) A fork of Bregalad's "GBA Mus Riper" program

Enables extraction of measurement data from binary files with extension 'raw' used by proprietary software imcFAMOS/imcSTUDIO and facilitates its storage in open source file formats

Data Preview 🈸 extension for importing 📤 viewing 🔎 slicing 🔪 dicing 🎲 charting 📊 & exporting 📥 large JSON array/config, YAML, Apache Arrow, Avro, Parquet & Excel data files

A collection of Apache Parquet add-on modules

gr-eventstream is a set of GNU Radio blocks for creating precisely timed events and either inserting them into, or extracting them from normal data-streams precisely. It allows for the definition of high speed time-synchronous c++ burst event handlers, as well as bridging to standard GNU Radio Async PDU messages with precise timing easily.

Big Data Toolkit for the JVM

Make record oriented data to columnar format.

A PHP library to extract article text from web pages

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Universal Extractor 2 is a tool to extract files from any type of archive or installer.

proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.

ISx is an InstallShield installer extractor

Python script which extracts and joins audio files from powerpoints

A free program for extracting data (like voicemails) from iPhone and iPad backups.

Albis: High-Performance File Format for Big Data Systems

fully asynchronous, pure JavaScript implementation of the Parquet file format

Collection of Databricks and Jupyter Notebooks

Apache Parquet implementation in Rust

Yet Another ETL in PHP

How to use Parquet in Flink

A large-scale entity and relation database supporting aggregation of properties

RecursiveExtractor is a .NET Standard 2.0 archive extraction Library, and Command Line Tool which can process 7zip, ar, bzip2, deb, gzip, iso, rar, tar, vhd, vhdx, vmdk, wim, xzip, and zip archives and any nested combination of the supported formats.

CSVs sliced, diced & analyzed.

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Extract dates from text

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Qt binary resource (qres) extractor

Julia implementation of Parquet columnar file format reader

SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ...

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

A fast tool to fetch URLs from HTML attributes by crawl-in.

A command line tool to query an ODBC data source and write the result into a parquet file.

an async ETL tool written in Python.

Scalable identity resolution, entity resolution, data mastering and deduplication using ML

Compare your database with WoWHead and find missing data

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

A flexible and powerful Gettext message extractor with support for JavaScript, TypeScript, JSX and HTML.

Extract contents of a container image in a local folder

恋恋のEX兔子版源代码以及KoishiExAPI源代码

Super simple and fast html page meta data extractor with low memory footprint

Manipulate arrays of complex data structures as easily as Numpy.

Mikrotik's NPK files managing tools

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Apiary provides modules which can be combined to create a federated cloud data lake

Simple windows desktop application for viewing & querying Apache Parquet files

A more readable & cleaner feed

A consistent table management library in python

Crash Team Racing (PS1) tools - a C# framework by DCxDemo and a set of tools to parse files found in the original kart racing game by Naughty Dog.

Dinky is an out of the box one-stop real-time computing platform dedicated to the construction and practice of Unified Streaming & Batch and Unified Data Lake & Data Warehouse. Based on Apache Flink, Dinky provides the ability to connect many big data frameworks including OLAP and Data Lake.

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

A modified extractor for the CROHME handwritten math symbols dataset.

Extract recipe ingredients from any recipe website on the internet.

A minimal Electron application to download videos, eg from youtube, and associated captions (optional). Uses youtube-dl under the hood.