399 Open source projects that are alternatives of or similar to Sparkstreaming

A curated list of awesome resources related to the Ada and SPARK programming language

ACID Data Source for Apache Spark based on Hive ACID

本项目收藏这些年来看过或者听过的一些不错的书籍，在整理文件时看见这些，发现删掉有点可惜，放着又太浪费空间，本着分享的原则，就把它们共享出来，一方面给需要的读者提供这些书籍，另一方面也是一种像知识库的积累吧

A parallel implementation of word2vec based on Spark

Fair job scheduler on Kubernetes and Mesos for batch workloads and Spark

Autoscaling for Google Cloud Dataproc

spark structured streaming via HTTP communication

Code Library for My Blog

Connect Spark to HBase for reading and writing data with ease

low-level helpers for Apache Spark libraries and tests

Kylo integration with PDND (previously DAF).

Some class materials for a data processing course using PySpark

An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

UC Berkeley team's submission for RecSys Challenge 2018

Open-source distribute workflow schedule tools, also support streaming task.

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

Resources for Spark AR

Developing Spark External Data Sources using the V2 API

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

酷玩 Spark: Spark 源代码解析、Spark 类库等

Spark functions to run popular phonetic and string matching algorithms

Minikube for big data with Scala and Spark

Koalas: pandas API on Apache Spark

Spark RDD to read, write and delete from HBase

A daily digest of the articles or videos I've found interesting, that I want to share with you.

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Qubole Sparklens tool for performance tuning Apache Spark

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

Book recommender system using collaborative filtering based on Spark

The Hunting ELK

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

Model complex data transformation pipelines easily

The Internals of Spark SQL

Simple framework agnostic UI router for SPAs

Applying Data Science and Machine Learning to Solve Real World Business Problems

A complete (distributed) BigData stack, running in containers

Apache Spark™ and Scala Workshops

A Data Engineering & Machine Learning Knowledge Hub

A Spark library for Amazon SageMaker.

HL7 Apache Spark Datasource

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

MLOps Platform

Collection of different demo applications using Apache Spark

k-Nearest Neighbors algorithm on Spark

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Simple and Distributed Machine Learning

TPC-H queries in Apache Spark SQL using native DataFrames API

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

Data Lineage Tracking And Visualization Solution

Framework of vectorized and distributed data analytics

Optimized Analytics Package for Spark* Platform

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

A tool for monitoring and tuning Spark jobs for efficiency.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Spark structured streaming examples with using of version 3.0.0

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .