793 Open source projects that are alternatives of or similar to Spark Streaming With Kafka

Process Common Crawl data with Python and Spark

Simple yet powerful live data computation framework

PHP Kafka client is used in PHP-FPM and Swoole. PHP Kafka client supports 50 APIs, which might be one that supports the most message types ever.

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

A easy and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.

A kafka command line browser

Unified SQL Analytics Engine Based on SparkSQL

A search framework and multi-tenant search platform based on java, kafka, kafka connect, elasticsearch

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Kafka ecosystem ... but step by step!

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

A modern Apache Kafka client for node.js

State of the Art Natural Language Processing

Simple and beautiful card component with an elegant spark line, for VueJS.

Pandas and Spark DataFrame comparison for humans

Sample Event Sourcing implementation with .NET Core

An Hexagonal Architecture with DDD + Aggregates + Event Sourcing using .NET Core, Kafka e MongoDB (Blog Engine)

DataStax Spark Cassandra Connector

Simplifying Kafka for ruby apps

Mirus is a cross data-center data replication tool for Apache Kafka

An open-source toolkit for large-scale genomic analysis

Everything about Apache Kafka

Kafka Tutorials microsite

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Apache Kafka on Docker

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

HandySpark - bringing pandas-like capabilities to Spark dataframes

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

本人的RabbitMQ和Kafka详细笔记以及示例代码

Geospatial Raster support for Spark DataFrames

Instagram Clone - Cloning Instagram for learning purpose

light, fast, scalable, streaming microservices made easy

一站式Apache Kafka集群指标监控与运维管控平台

Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

A repository to keep track of all the code that I end up writing for my blog posts.

Confluent's Apache Kafka .NET client

Big Data Toolkit for the JVM

Confluent REST Proxy for Kafka

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

我,请始皇[打钱]是一个前后端分离的工具人系统，项目采用 SpringBoot+Go+Vue 开发，项目加入常见的企业级应用所涉及到的技术点，例如 Redis、RabbitMQ 等(主要是多用用工具多踩踩坑)。

Playground for Kafka/Confluent Docker experimentations

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

A Clojure dataframe library that runs on Spark

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

A RPC framework leveraging Spark RPC module

A Spark/Scala implementation of the isolation forest unsupervised outlier detection algorithm.

Laravel Enqueue message queue extension. Supports AMQP, Amazon SQS, Kafka, Google PubSub, Redis, STOMP, Gearman, Beanstalk and others

Syslog Collector written in Go, streams to Kafka 0.8

Apache Kafka bridge

LearningApacheSpark

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Isolation Forest on Spark

Parallel Apache Kafka client wrapper with client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Apache Spark on AWS Lambda

WaterDrop is a standalone Karafka component library for generating Kafka messages

Monitor Apache Spark from Jupyter Notebook