420 Open source projects that are alternatives of or similar to Parquet Format

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Simple windows desktop application for viewing & querying Apache Parquet files

A large-scale entity and relation database supporting aggregation of properties

Big Data Toolkit for the JVM

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

Apache Parquet

Apache Parquet

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Apache Drill is a distributed MPP query layer for self describing data

Manipulate arrays of complex data structures as easily as Numpy.

🏐 Apache Parquet for modern .NET

Workflows and interfaces for neuroimaging packages

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

Alex Castrounis' curated set of resources for artificial intelligence (AI), machine learning, data science, internet of things (IoT), and more.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Intel® Scalable Dataframe Compiler for Pandas*

Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++

MockNeat is a Java 8+ library that facilitates the generation of arbitrary data for your applications.

Kafka Connect HDFS connector

Apache Beam is a unified programming model for Batch and Streaming

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Apache Ignite

The most widely used Python to C compiler

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Geo Spatial Data Analytics on Spark

ETL Framework for .NET / c# (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

d3 library to build circular graphs

Reproducible Data Science at Scale!

Server for the ListenBrainz project

Career Resources for Data Science, Machine Learning, Big Data and Business Analytics Career Repository

Source code for the CERN Open Data portal

Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability

CogComp's Natural Language Processing libraries and Demos:

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A SDK/library for decentralized web and distributing computing projects

Arkime (formerly Moloch) is an open source, large scale, full packet capturing, indexing, and database system.

Iceberg is a table format for large, slow-moving tabular data

equivalent to kafka-streams 🐙 for nodejs ✨🐢🚀✨

High performance distributed data processing engine

Single-pass algorithms for statistics

Building Large-Scale AI Applications for Distributed Big Data

📈 Collect customer event data from your apps. (Note that this project only includes the API collector, not the visualization platform)

🏅State-of-the-art learned data structure that enables fast lookup, predecessor, range searches and updates in arrays of billions of items using orders of magnitude less space than traditional indexes

Apache Hive

A fast, log structured key-value store.

A simplified, lightweight ETL Framework based on Apache Spark

Mirror of Apache Oozie

Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Stream computing platform for bigdata

Fast Fourier Transform-accelerated Interpolation-based t-SNE (FIt-SNE)

Mirror of Apache Bigtop

The open big data serving engine. https://vespa.ai

Support content for my blog

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Redis in a python module.

DevOps methodology & roadmap for a devops developer in 2019. Interesting books to learn new technologies.

Mirror of Apache Apex core

Open-source distributed computation and storage platform

Optimized Analytics Package for Spark* Platform