599 Open source projects that are alternatives of or similar to Utils4s

Spark, Spark Streaming and Spark SQL unit testing strategies

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

A daily digest of the articles or videos I've found interesting, that I want to share with you.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

C# and F# language binding and extensions to Apache Spark

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

零基础学习spark，大数据学习

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Open-source IoT Platform - Device management, data collection, processing and visualization.

Scala examples for learning to use Spark

Custom state store providers for Apache Spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

酷玩 Spark: Spark 源代码解析、Spark 类库等

Kinesis Connector for Structured Streaming

Code examples on Apache Spark using python

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Real Time Analytics and Data Pipelines based on Spark Streaming

Production Ready Data Integration Product, documentation：

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Updated repository

Apache Spark and Apache Kafka integration example

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

An open source framework for building data analytic applications.

A Flexible and Powerful Parameter Server for large-scale machine learning

Jupyter magics and kernels for working with remote Spark clusters

Official code repository for GATK versions 4 and up

Bucketing and partitioning system for Parquet

MapReduce, Spark, Java, and Scala for Data Algorithms Book

add-on to Akka Typed that tracks effects for use with Session Types

Apache Spark Connector for Azure Kusto

High performance HBase / Spark SQL engine

Repository for all parts of the Fortis architecture

Python Helper library for Jupyter Notebooks

Apache Spark - A unified analytics engine for large-scale data processing

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Natural Korean Processor for Apache Spark

Emulated PlanetSide 1 world and login server by the PSForever project.

Example usage of the Lagom Framework for writing Java-based microservices

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

A Time Series Library for Apache Spark

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Heimdallr, a Large-scale chat application server based on Redis Pubsub and Akka's actor model.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Urho3D extension library

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Natural Series Database

WAMP - Web Application Messaging Protocol implementation written with Akka

Feature engineering toolkit for Spark MLlib.

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

A heterogeneous Apache Spark framework.

A big data platform for analyzing web access logs

Wormhole is a SPaaS (Stream Processing as a Service) Platform

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.