472 Open source projects that are alternatives of or similar to awesome-bigdata

A project to help people stand in line at the market as little as possible

🦖 Streaming-Serverless Framework for Low-latency Edge Computing applications, running atop QUIC protocol, engaging 5G technology.

大数据采集,抽取平台

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

biglasso: Extending Lasso Model Fitting to Big Data in R

Distributed KV Streams

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

Demos of how to do custom stream processing using the Akka Streams GraphStages API

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

Apache Flink connectors for Pravega.

Plexus - Interactive Emotion Visualization based on Social Media

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

JavaScript library to handle media streams on the command line (Node.js) and in the browser.

An opinionated clojure framework for writing kafka machines

Presto-like CLI tool for AWS Athena

个人笔记集中营，快糙猛的形式记录技术性Notes .. 📚☕️⌨️🎧

Stream Discovery and Stream Orchestration

ROOT I/O in pure Python and NumPy.

an online learning algorithm library for Storm

A library for performing Content-Defined Chunking (CDC) on data streams.

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

High performance data aggregating storage

The streaming database built for IoT data storage and real-time processing in the 5G Era

This is an Open Source PHP Reporting Framework which you can use to write perfect data reports or to construct awesome dashboards using PHP

Collection of stream processing / multiplexing / networking libs in Go

Repository for Online Classes

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Countly Product Analytics SDK for websites and web applications

Power Query M functions for working with Tabular Data Packages (Frictionless Data) in Power BI and Excel

A block explorer for Cosmos

AWS Auto Terminate Idle AWS EMR Clusters Framework is an AWS based solution using AWS CloudWatch and AWS Lambda using a Python script that is using Boto3 to terminate AWS EMR clusters that have been idle for a specified period of time.

Apache Superset is a Data Visualization and Data Exploration Platform

A pure Java HDF5 library

danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Repository which contains various scripts and work with various basketball statistics

java学习和项目中一些典型的应用场景样例代码

C# and F# language binding and extensions to Apache Spark

Query engine for TrailDB

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Runtime for Writing Streaming Applications in Rust.

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Open Source Self-Hosted Business Intelligence Platform

Full featured TypeScript Twitter archive reader and browser

Read data from, write data to, and modify the formatting of Google Sheets

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

(已完结)《极客时间数据分析实战45讲-详细笔记》包含markdown、图片、思维导图、代码 、数据。 可直接阅读代码、测试!

Useful SQL queries for Blockchain ETL datasets in BigQuery.

light, fast, scalable, streaming microservices made easy

Stream Processing Library for Go

An Open Source Distributed Time Series Database with high performance, high compression ratio and high usability.

A stream processing language and compiler for small-scale monitoring

Tidy up Spark and Hadoop tutorials.

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

An example for streaming large files in chunks using StreamingResponseBody in Spring MVC

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Add-ons to Akka Stream