683 Open source projects that are alternatives of or similar to Dpark

An open-source big data platform designed and optimized for the Internet of Things (IoT).

Pluck text in a fast and intuitive way 🐓

A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka.

Spark、Flink等离线任务的调度以及实时任务的监控

Profile and monitor your ML data pipeline end-to-end

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Asynchronous HBase client for NodeJs using REST

Apache Spark (PySpark) Practice on Real Data

Big Data Ecosystem Docker

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

Simple and beautiful card component with an elegant spark line, for VueJS.

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Apache Spark™ and Scala Workshops

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

An open-source toolkit for large-scale genomic analysis

Content for architecting a data science platform for products using Luigi, Spark & Flask.

The Apache Flink SQL Cookbook is a curated collection of examples, patterns, and use cases of Apache Flink SQL. Many of the recipes are completely self-contained and can be run in Ververica Platform as is.

HandySpark - bringing pandas-like capabilities to Spark dataframes

A Clojure dataframe library that runs on Spark

Building event-driven applications the easy way in Go.

The Internals of Spark SQL

Ruby wrapper for Apache Spark

JavaScript library to handle media streams on the command line (Node.js) and in the browser.

LearningApacheSpark

MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1

A scalable nearest neighbor search library in Apache Spark

Monitor Apache Spark from Jupyter Notebook

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

A Spark library for Amazon SageMaker.

Realtime calculation distributed system. AKA distributed lodash

Compile-time Language Integrated Queries for Scala

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

Julia binding for Apache Spark

Simple-IT-English: smart wordbook from community for community

⚡️ 6.824: Distributed Systems (Spring 2017). A course which present abstractions and implementation techniques for engineering distributed systems.

Live-coding the cluster!

面向 OLTP、OLAP、批处理、流处理场景的大一统 SQL 引擎

Distributed t-SNE via Apache Spark

A better compressed bitset in Java

spark ml 算法原理剖析以及具体的源码实现分析

A Spark plugin for reading Excel files via Apache POI

High performance data aggregating storage

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

The streaming database built for IoT data storage and real-time processing in the 5G Era

Fundamentals of Spark with Python (using PySpark), code examples

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Book recommender system using collaborative filtering based on Spark

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Process Common Crawl data with Python and Spark

Apache Avro is a data serialization system.

💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算)；🚀 支持运行过程中增删topic；🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。

Updated repository

Pandas and Spark DataFrame comparison for humans

Unified SQL Analytics Engine Based on SparkSQL

DataStax Spark Cassandra Connector