898 Open source projects that are alternatives of or similar to Sparkstreaming

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Code Library for My Blog

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

springboot和dubbo、netty的集成，redis mongodb的nosql模板， kafka rocketmq rabbit的MQ模板， solr solrcloud elasticsearch查询引擎

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Spring Boot 2.x code examples

Production Ready Data Integration Product, documentation：

Data science and Big Data with Python

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

A large-scale entity and relation database supporting aggregation of properties

Avro SerDe for Apache Spark structured APIs.

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Schema Registry

Machine Learning Platform and Recommendation Engine built on Kubernetes

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

基于 scrapy-redis 的通用分布式爬虫框架

Cookbook to install Hadoop 2.0+ using Chef

Apache Spark and Apache Kafka integration example

StreamLine - Streaming Analytics

Write your Spark data to Kafka seamlessly

spark ml 算法原理剖析以及具体的源码实现分析

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Mirus is a cross data-center data replication tool for Apache Kafka

Profile and monitor your ML data pipeline end-to-end

Fundamentals of Spark with Python (using PySpark), code examples

Process Common Crawl data with Python and Spark

🥚 Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

PHP Kafka client is used in PHP-FPM and Swoole. PHP Kafka client supports 50 APIs, which might be one that supports the most message types ever.

light, fast, scalable, streaming microservices made easy

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

A easy and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.

A kafka command line browser

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Kafka ecosystem ... but step by step!

🚀 Azkarra is a lightweight java framework to make it easy to develop, deploy and manage cloud-native streaming microservices based on Apache Kafka Streams.

一站式Apache Kafka集群指标监控与运维管控平台

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar

A modern Apache Kafka client for node.js

camellia framework by netease-im. provider: 1) redis-client; 2) redis-proxy(redis-sentinel/redis-cluster); 3) hbase-client; 4) others

Simple and beautiful card component with an elegant spark line, for VueJS.

Updated repository

Pandas and Spark DataFrame comparison for humans

《Kafka技术内幕》代码

A RPC framework leveraging Spark RPC module

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

An Hexagonal Architecture with DDD + Aggregates + Event Sourcing using .NET Core, Kafka e MongoDB (Blog Engine)

Sample Event Sourcing implementation with .NET Core

An open-source toolkit for large-scale genomic analysis

DataStax Spark Cassandra Connector

Everything about Apache Kafka

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Kafka Tutorials microsite

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

HandySpark - bringing pandas-like capabilities to Spark dataframes

Apache Kafka on Docker