908 Open source projects that are alternatives of or similar to Spark Structured Streaming Examples

A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)

Automatic instrumentation for 3rd-party libraries in Java applications with OpenTracing.

A modern Apache Kafka client for node.js

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Kafka backed service library.

Webex Bot SDK for Node.js (deprecated in favor of https://github.com/webex/webex-bot-node-framework)

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

type-class based data cleansing library for Apache Spark SQL

Boiler plate framework to use Spark and ZIO together.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Everything about Apache Kafka

Optimize and improve the Label propagation algorithm

Bitnami Docker Image for Cassandra

Type-safe and Schema-safe Scala wrapper for Cassandra driver

Next generation tool for decentralized exchange and transformation of semi-structured data

Learn the Confluent Schema Registry & REST Proxy

Event sourcing with kafka and nodejs

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

vangav open source - backend; a backend generator (generates more than 90% of the code needed for big scale backend services)

Kinesis Connector for Structured Streaming

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

以Kafka为存储介质，提供异步Http RPC的中间件

四川大学拓思爱诺用户session行为数据离线分析项目

docker compose files to create a fully working kafka stack

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

An improved implementation of the classical feature selection method: minimum Redundancy and Maximum Relevance (mRMR).

Kafka Docker for development. Kafka, Zookeeper, Schema Registry, Kafka-Connect, Landoop Tools, 20+ connectors

Apollo graphql subscriptions over Kafka protocol

Updated repository

python通用分布式函数调度框架 pip install function_scheduling_distributed_framework

关于kafka的一些相关使用示例代码。

Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving

KafkaFlow is a .NET framework to consume and produce Kafka messages with multi-threading support. It's very simple to use and very extendable. You just need to install, configure, start/stop the bus with your app and create a middleware/handler to process the messages.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Geospatial Raster support for Spark DataFrames

Word2Vec models with Twitter data using Spark. Blog:

📊 Cube — Open-Source Analytics API for Building Data Apps

大数据分析可视化实践

🌐 Interactive Workshop on GeoAnalysis using PySpark

DEPRECATED—Open source Apache Cassandra running on DC/OS is now replaced by mesosphere/dcos-commons/frameworks/cassandra. This repository will be deleted at the end of 2017.

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

A repository to keep track of all the code that I end up writing for my blog posts.

The AsyncAPI specification allows you to create machine-readable definitions of your asynchronous APIs.

.NET event stream projection and scheduling platform with EventStore, CosmosDb, Equinox and Kafka integrations

Ship changes in Postgres 🐘 to Kafka 📖

❤for real-time DataOps - where the application and data fabric blends - Lenses

Kafka Browser that supports standalone Kafka and Strimzi operator

Big Data Toolkit for the JVM

Azure Event Hubs for Apache Kafka Ecosystems

Custom state store providers for Apache Spark

Karapace - Your Kafka essentials in one tool

Laravel Enqueue message queue extension. Supports AMQP, Amazon SQS, Kafka, Google PubSub, Redis, STOMP, Gearman, Beanstalk and others

Pandas and Spark DataFrame comparison for humans

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Cookbook to install Hadoop 2.0+ using Chef

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.