420 Open source projects that are alternatives of or similar to Parquet Cpp

Manipulate arrays of complex data structures as easily as Numpy.

A large-scale entity and relation database supporting aggregation of properties

Apache Parquet

Apache Drill is a distributed MPP query layer for self describing data

Big Data Toolkit for the JVM

Simple windows desktop application for viewing & querying Apache Parquet files

Apache Parquet

Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)

🏐 Apache Parquet for modern .NET

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.

A complete (distributed) BigData stack, running in containers

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

PredictionIO E-Commerce Recommendation Engine Template (Java-based parallelized engine)

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud

A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.

open source tools for interaction with IBM PAIRS:

ACID Data Source for Apache Spark based on Hive ACID

A tool for data sampling, data generation, and data diffing

⚡ Lightning fast density estimation in Julia ⚡

OLAP and ETL of Big Data

Apache Tez

Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.

Mirror of Apache VXQuery

Alluxio Python client - Access Any Data Source with Python

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

An extensible Java framework for building XML and non-XML streaming applications

OONI data processing pipeline

Serverless proxy for Spark cluster

Drools processor for Apache NiFi

Apache Flink is an open source project of The Apache Software Foundation (ASF). The Apache Flink project originated from the Stratosphere research project.

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Fast data store for Pandas time-series data

Mirror of Apache Lens

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Efficient training of deep recommenders on cloud.

Mirror of Apache Helix

PredictionIO Classification Engine Template (Scala-based parallelized engine)

Knowage is the professional open source suite for modern business analytics over traditional sources and big data systems.

🦘 The Grouparoo Monorepo - open source customer data sync framework

Kotlin Bigdata Toolkit

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

PredictionIO PHP SDK

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

PredictionIO Similar Product Engine Template (Scala-based parallelized engine)

The Metadata Platform for the Modern Data Stack

异构存储数据迁移

Code examples for my blog posts

Create full-fledged APIs for static datasets without writing a single line of code.

WebGL Heatmap Viewer for Big Data and Bioinformatics

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

ROOT I/O in pure Python and NumPy.

A tool for batch loading data files (json, parquet, csv, tsv) into ElasticSearch

Enabling queries on compressed data.

Egis - a handy Ruby interface for AWS Athena

Implementation of the k-means algorithm in PyTorch that works for large datasets

R package for statistical tools with big matrices stored on disk.

Java library that sorts very large files of records by splitting into smaller sorted files and merging

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster