919 Open source projects that are alternatives of or similar to Parquet Dotnet

Spark in Action, 2nd edition - chapter 1 - Introduction

A C# library that can emulate Pokémon battles.

Base types for OnlineStats.

Apache Pulsar Adapters

NoSQL providers for EntityFramework Core

Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow

Mirror of Apache Lens

Wrangler Transform: A DMD system for transforming Big Data

Generic file logger for .NET Core (FileLoggerProvider) with minimal dependencies

PredictionIO, a machine learning server for developers and ML engineers.

Efficient training of deep recommenders on cloud.

clusterdock is a framework for creating Docker-based container clusters

The Metadata Platform for the Modern Data Stack

Data validation library for PySpark 3.0.0

PredictionIO Classification Engine Template (Scala-based parallelized engine)

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

ASP.NET Core 6 Web API Clean Architecture Solution Template

🔥 One of the most comprehensive open-source data annotation platform.

OLAP and ETL of Big Data

Basic framework utilities to quickly start writing production ready Apache Spark applications

.NET Event Sourcing library with CosmosDB, EventStoreDB, SqlStreamStore and integration test backends. Focused at stream level; see https://github.com/jet/propulsion for cross-stream projections/subscriptions/reactions

Alluxio Python client - Access Any Data Source with Python

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

Map Reduce Implementation of Connected Component on Apache Spark

🐬 Apache Parquet for modern .Net

Automatically setup a productive development environment with Ansible on macOS

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

Materials for "Machine Learning on Big Data" course

"Byteslice: Pushing the envelop of main memory data processing with a new storage layout" (SIGMOD'15)

PredictionIO PHP SDK

An opinionated HTTP library for Mobile Development

Create full-fledged APIs for static datasets without writing a single line of code.

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Kotlin Bigdata Toolkit

基于Vue、three.js、echarts，数据可视化展示项目，包含三维模型导入交互、三维模型标注等功能

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

PredictionIO Similar Product Engine Template (Scala-based parallelized engine)

Julia implementation of Parquet columnar file format reader

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

异构存储数据迁移

Ppts, códigos y videos de las meetups, data science days, videollamadas y workshops. Data Science Research es una organización sin fines de lucro que busca difundir, descentralizar y difundir los conocimientos en Ciencia de Datos e Inteligencia Artificial en el Perú, dando oportunidades a nuevos talentos mediante MeetUps, Workshops y Semilleros …

A High-Performance Data Science Toolkit for the Earth Sciences

Code examples for my blog posts

☁️ nodejs kafka connect connector for Google BigQuery

Extensible streaming ingestion pipeline on top of Apache Spark

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

TypeScript Bigtable Client with 🔋🔋 included.

WebGL Heatmap Viewer for Big Data and Bioinformatics

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Apache Arrow DataFusion SQL Query Engine

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Win probability predictions for League of Legends matches using neural networks

MATLAB/Octave library for stochastic optimization algorithms: Version 1.0.20

dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.

Egis - a handy Ruby interface for AWS Athena

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

InsightEdge Core

Implementation of the k-means algorithm in PyTorch that works for large datasets

Big Data Visualization

Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful experiment to an automated pipeline of model training, validation, deployment and inference in production. Liminal provides a Domain Specific Language to build ML workflows on top of Apache Airflow.