242 Open source projects that are alternatives of or similar to spark-streaming-visualize

A list about Apache Kafka

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Pure Pony implementation of the ZeroMQ messaging library. 🐴 0️⃣ Ⓜ️ 🍀

PySpark Cheatsheet

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

A Pythonic and ultra fast template engine DSL.

Apache Spark Course Material

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Metaquotes MQL5 - JSON - API

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Basic framework utilities to quickly start writing production ready Apache Spark applications

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

A simple and eloquent workflow for streaming messages to micro-services.

A Distributed Clojure agent for running remote functions

JSON-RPC 2.0 over ZeroMQ in Python

Icicle Streaming Query Language

making conversation between languages

The Internals of Spark SQL

Spark cloud integration: tests, cloud committers and more

Map Reduce Implementation of Connected Component on Apache Spark

Distributed Message Queue based on Raft

Apache Spark for data engineers

Server remediation as a service

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

Communication layer between MetaTrader 4 and your project.

ZeroMQ based distributed patterns

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Twitter Dynamic Dataset Api. Create any dataset YOU want.

A .NET implementation of ZeroRPC

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Spark in Action, 2nd edition - chapter 1 - Introduction

pastaʃ'ʃ = Spaghetti I/O Event Data Processing, Interpolation, Correlation and beyond 🍝

Apache Spark in your IDE with gradle

A curated list of awesome big data frameworks, ressources and other awesomeness.

A Node.js and JavaScript synchronous data pipeline processing, data sharing and stream processing library. Actionable & Transformable Pipeline data processing.

Extensible streaming ingestion pipeline on top of Apache Spark

Massively real-time city transit streaming application

An RPC Transport Library for asyncio

Apache Pulsar Adapters

Cross-vendor normalisation for network syslog messages, following the OpenConfig and IETF YANG models

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Python-based implementation of Desktop Notifications Specification (notification-daemon)

UPDATE 20210705: Adding ZeroMQ functions in to allow full-duplex comms with deep parts of the hosts' cognitive processes, and expose speech recognition background processes, visual processes, etc. ORIGINAL DESCRIPTION >>>This is a working version of the iconic Behavior Pad "Rose Graph" Interface that the Westworld Techs use to set Host Behaviora…

A framework for easy prototyping of distributed reinforcement learning algorithms

Julia interface to ZMQ

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

Spark in Action, 2nd edition - chapter 7 - Ingestion from files

Open Source Oracle database CDC written purely in C++. Reads transactions directly from database redo log files and streams in JSON or Protobuf format to: Kafka, RocketMQ, flat file, network stream (plain TCP/IP or ZeroMQ)

The dynamic queue

Simple and Distributed Machine Learning

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Operator for managing the Spark clusters on Kubernetes and OpenShift.

🚀 Client/Server & Pub/Sub Examples with ZeroMQ & Boost

Base types for OnlineStats.

Sample Applications for Pravega.

Push messages via websocket, based on Tornado and ZeroMQ

MQTT/Mosquitto / ZeroMQ proxy