908 Open source projects that are alternatives of or similar to Spark Structured Streaming Examples

extremely distributed machine learning

A curated list of Pulsar tools, integrations and resources.

Kafka Connect suite of connectors for Cloud storage (Amazon S3)

Flume NG Canal source

This repo contains my notes on working with Go and computer systems.

Apache Spark examples exclusively in Java

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

When Apache Pulsar meets Apache Spark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

DataStax Node.js Driver for Apache Cassandra

GeoTrellis for PySpark

scala、spark使用过程中，各种测试用例以及相关资料整理

Reliable messages resolve distributed transactions

This is a based on playframwork for submit spark app

Syslog Collector written in Go, streams to Kafka 0.8

Kalium: a reactive framework for micro-services

Confluent Schema Registry for Kafka

Natural Korean Processor for Apache Spark

Modern and performant Kafka client library for Ruby based on librdkafka

Schema safe, type-safe, reactive Scala driver for Cassandra/Datastax Enterprise

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

The Internals of Apache Spark

**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector

.NET event stream projection and scheduling platform with EventStore, CosmosDb, Equinox and Kafka integrations

Two-day workshop that covers how to use R to interact databases and Spark

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Demo applications and code examples for Confluent Platform and Apache Kafka

Golang Kafka consumer and producer example

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Apache Spark on AWS Lambda

Azure Event Hubs for Apache Kafka Ecosystems

Custom state store providers for Apache Spark

80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc.

Spark examples

Distributed t-SNE via Apache Spark

RESTful / Secure Management Sidecar for Apache Cassandra

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

💥 A simple multi-purpose connection pool client (Kafka & Hbase & Redis & RMDB & Socket & Http)

Node.js bindings for Apache Spark DataFrame APIs

Karapace - Your Kafka essentials in one tool

Laravel Enqueue message queue extension. Supports AMQP, Amazon SQS, Kafka, Google PubSub, Redis, STOMP, Gearman, Beanstalk and others

Pandas and Spark DataFrame comparison for humans

[https://www.sofineday.com], golang项目开发脚手架,集成最佳实践(gin+gorm+go-redis+mongo+cors+jwt+json日志库zap(支持日志收集到kafka或mongo)+消息队列kafka+微信支付宝支付gopay+api加密+api反向代理+go modules依赖管理+headless爬虫chromedp+makefile+二进制压缩+livereload热加载)

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Profile and monitor your ML data pipeline end-to-end

A library provides consumer/producer to work with kafka, avro and schema registry

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

An opinionated Elixir wrapper around brod, the Erlang Kafka client, that supports encrypted connections to Heroku Kafka out of the box.

零基础学习spark，大数据学习

spark ml 算法原理剖析以及具体的源码实现分析

Cookbook to install Hadoop 2.0+ using Chef

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

Spark job for dependency links

Mirror of Linkedin's Camus

Sample Event Sourcing implementation with .NET Core

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

MLeap: Deploy ML Pipelines to Production