549 Open source projects that are alternatives of or similar to Spark

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。

HTTP Live Streaming with on-the-fly encoding of any video file for Web/Apple TV/iPhone/iPad/iPod

A configurable RabbitMQ consumer made in Rust, useful for a stable and reliable CLI commands processor.

Hyperconverged cloud-edge native database

Race Control is a standalone, open source F1TV client for Windows, written in C# on the .NET 5 platform.

Plain text table generator for Ruby, with a DRY, column-based API

SQL Parsers for BigData, built with antlr4.

Cast files to Chromecast, web browser or media player app over local network.

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

RTSP player for Android / IP camera viewer

Consume an AWS Kinesis Data Stream to look over the records from a terminal.

Go implementation of the MediaDevices API.

A simple app that lets you stream every live and archived NHL and MLB game from any of your iOS devices.

Mellow can communicate with several APIs like Ombi, Sonarr, Radarr and Tautulli which are related to home streaming to use those services directly in your Discord client.

bring sf to spark in production

Streaming and realtime audio manipulation with AVAudioEngine

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

🔖 Redis client built on top of Cats Effect, Fs2 and Lettuce

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Unified Realtime/API framework for .NET platform and Unity.

Chrome extension which lets you watch WWDC Developer Videos in Google Chrome (thus not having to use Safari)

Streaming & Fast XLSX Spreadsheet Writer for Ruby

RabbitMQ Messaging Polyglot with Java, ColdFusion, CommandBox, Groovy and more

A framework for GPU based high-performance medical image processing and visualization

Enables extraction of measurement data from binary files with extension 'raw' used by proprietary software imcFAMOS/imcSTUDIO and facilitates its storage in open source file formats

Intelligently render media files in the browser

Library to read a subset of Parquet files

dvbtee: a digital television streamer / parser / service information aggregator supporting various interfaces including telnet CLI & http control

Make record oriented data to columnar format.

Apache Pulsar Manager

Stream your applications with Parsec and AWS on the cheap.

Lightweight, fault-tolerant message streams.

Consumer Banking Application

OS X put.io client that acts as handler for magnet: links and .torrent files, and adds them to your put.io download queue

PHP Kafka producer / consumer library with PHP Avro support, based on php-rdkafka

🐦 A personal music streaming server that works.

Implementing a Web Based solution through which farmers can participate in a commodity exchange market

Distributed, masterless, high performance, fault tolerant data processing

A collection of examples of continuous analytics.

Source code for the Kafka Streams in Action Book

🌀 .NET Event Processing library

[Tutorial] Asynchronous Flutter chat client with Go chat server which are powered by gRPC (simple and streaming)

Spark VCF data source implementation for Dataframes

A multi platform Twitch.tv browser for Streamlink

bigdatatutorial

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

Spark Streaming ETL jobs for Mozilla Telemetry

浏览器RTMP推流SDK (A javascript rtmp streamer library)

Apache Pulsar Go Client Library

Easily work with the Twitter Streaming API in a Laravel app

Pulsar Flex is a modern Apache Pulsar client for Node.js, developed to be independent of C++.

How to implement a streaming at scale solution in Azure

betfairlightweight - python wrapper for Betfair API-NG (with streaming)

StreamLine - Streaming Analytics

Cloud ready pure-python streaming data pipeline library

This code creates a Kinesis Firehose in AWS to send CloudWatch log data to S3.

Free and open source streaming software built on OBS and Electron.

OpenMessaging Specification

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

DVR for streaming entertainment