2813 Open source projects that are alternatives of or similar to Sparta

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

StreamLine - Streaming Analytics

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Apache Spark and Apache Kafka integration example

Source code for the Kafka Streams in Action Book

零基础学习spark，大数据学习

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

大数据入门指南 ⭐

Divolte Collector

Fundamentals of Spark with Python (using PySpark), code examples

Kafka Connect HDFS connector

Utils for streaming large files (S3, HDFS, gzip, bz2...)

C# and F# language binding and extensions to Apache Spark

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Configuration with AWS step functions and lambdas which initiates processing from activity state

Observe and develop serverless apps with confidence on AWS Lambda with Tracing, Metrics, Profiling, Monitoring, and more.

Java生态研究(Spring Boot + Redis + Dubbo + RocketMQ + Elasticsearch)🔥🔥🔥🔥🔥

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Track website visitors with Serverless Analytics using Kinesis, Lambda, and TypeScript.

Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Massively real-time traffic streaming application

Streaming reactive and dataflow graphs in Python

Apache Spark on AWS Lambda

Hyperconverged cloud-edge native database

Fast & numerically stable statistical analysis

DuckDB is an in-process SQL OLAP Database Management System

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Anomaly Detection on Time-Evolving Streams in Real-time. Detecting intrusions (DoS and DDoS attacks), frauds, fake rating anomalies.

Flexible and efficient data processing engine and an evolution of the popular Scramjet Framework based on node.js. Our Transform Hub was designed specifically for data processing and has its own unique algorithms included.

A social and synchronized streaming experience

Beneath is a serverless real-time data platform ⚡️

Minikube for big data with Scala and Spark

Materialize lets you ask questions of your live data, which it answers and then maintains for you as your data continue to change. The moment you need a refreshed answer, you can get it in milliseconds. Materialize is designed to help you interactively explore your streaming data, perform data warehousing analytics against live relational data, or just increase the freshness and reduce the load of your dashboard and monitoring tasks.

Massively real-time city transit streaming application

A complete (distributed) BigData stack, running in containers

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

An open source framework for building data analytic applications.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

An orchestration platform for the development, production, and observation of data assets.

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

ClickHouse Native Protocol JDBC implementation

CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of data in real-time.

酷玩 Spark: Spark 源代码解析、Spark 类库等

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.