420 Open source projects that are alternatives of or similar to Parquet Mr

Apache Parquet

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Big Data Toolkit for the JVM

Simple windows desktop application for viewing & querying Apache Parquet files

Apache Drill is a distributed MPP query layer for self describing data

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Manipulate arrays of complex data structures as easily as Numpy.

A large-scale entity and relation database supporting aggregation of properties

🏐 Apache Parquet for modern .NET

Apache Parquet

Mirror of Apache CarbonData

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

Mirror of Apache OODT

Query engine for TrailDB

Apache Spark Website

Apache Flink shaded artifacts repository

TrailDB is an efficient tool for storing and querying series of events

Mirror of Apache CouchDB

Read and write Neuroglancer datasets programmatically.

Robust, distributed version control for large files.

Source code for the CERN Analysis Preservation portal

ROOT I/O in pure Python and NumPy.

Research on distributed system

Convert and analyze large data sets at light speed, on Mac and iOS.

Measure behavior of Java applications

Apache Kibble - a tool to collect, aggregate and visualize data about any software project

Countly Product Analytics SDK for Cordova, Icenium and Phonegap

Course Website on Macroeconomic Analysis with Machine Learning and Big Data

PredictionIO Recommendation Engine Template (Scala-based parallelized engine)

Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.

Hazelcast IMDG C++ Client

NodeJS module to access apache parquet format files

A Global Scale Network Telemetry Ecosystem

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

Quilt is a self-organizing data hub for S3

The Data Engineering Cookbook

A Java package to automatically detect anomalies in large scale time-series data

Apache Spark 官方文档中文版

Esper instance for TV news analysis

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

An extremely fast Non-crypto-safe AES Based Hash algorithm for Big Data

Text Classification Engine

Bucketing and partitioning system for Parquet

High-throughput gene to knowledge mapping through massive integration of public sequencing data.

Apache Bookkeeper

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

A client interface to the QCArchive Project (read-only image of QCFractal)

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

VerticaPy is a Python library that exposes sci-kit like functionality to conduct data science projects on data stored in Vertica, thus taking advantage Vertica’s speed and built-in analytics and machine learning capabilities.

Apache Spark - A unified analytics engine for large-scale data processing

An admission control policy that safeguards against accidental duplicate claiming of Hosts/Domains.

Apache IoTDB

📢 Ready to learn or review your knowledge!

Mirror of Apache Lens

Mirror of Apache Phoenix

Dremio - the missing link in modern data

YMCache is a lightweight object caching solution for iOS and Mac OS X that is designed for highly parallel access scenarios.

A heterogeneous Apache Spark framework.