399 Open source projects that are alternatives of or similar to Sparkstreaming

dllib is a distributed deep learning library running on Apache Spark

blog entries

ETL Library for Machine Learning - data pipelines, data munging and wrangling

One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)

Type System for Data Analysis in Python

Interactive and Reactive Data Science using Scala and Spark.

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

A library that provides useful extensions to Apache Spark and PySpark.

Distributed scikit-learn meta-estimators in PySpark

Template for Spark Projects

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Create clusters of VMs on the cloud and configure them with Ansible.

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

ClickHouse Native Protocol JDBC implementation

尚硅谷大数据Spark-2019版最新 Spark 学习

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

A simple spark standalone cluster for your testing environment purposses

A compiler for automatically re-targeting sequential Java code to Apache Spark.

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Enabling queries on compressed data.

Profile Photo Camera support for Laravel Spark

Framework of vectorized and distributed data analytics

A curated list of awesome resources related to the Ada and SPARK programming language

本项目收藏这些年来看过或者听过的一些不错的书籍，在整理文件时看见这些，发现删掉有点可惜，放着又太浪费空间，本着分享的原则，就把它们共享出来，一方面给需要的读者提供这些书籍，另一方面也是一种像知识库的积累吧

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark

spark structured streaming via HTTP communication

Connect Spark to HBase for reading and writing data with ease

Kylo integration with PDND (previously DAF).

An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)

UC Berkeley team's submission for RecSys Challenge 2018

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Developing Spark External Data Sources using the V2 API

酷玩 Spark: Spark 源代码解析、Spark 类库等

Minikube for big data with Scala and Spark

Spark RDD to read, write and delete from HBase

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Qubole Sparklens tool for performance tuning Apache Spark

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

The Hunting ELK

Model complex data transformation pipelines easily

Simple framework agnostic UI router for SPAs

A complete (distributed) BigData stack, running in containers

A Data Engineering & Machine Learning Knowledge Hub

HL7 Apache Spark Datasource

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Collection of different demo applications using Apache Spark

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

TPC-H queries in Apache Spark SQL using native DataFrames API

Data Lineage Tracking And Visualization Solution

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

Optimized Analytics Package for Spark* Platform

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

A tool for monitoring and tuning Spark jobs for efficiency.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Spark structured streaming examples with using of version 3.0.0