1035 Open source projects that are alternatives of or similar to Sparkrdma

Spark examples

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Server for the ListenBrainz project

Alluxio, data orchestration for analytics and machine learning in the cloud

Haskell on Apache Spark.

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

电商用户行为分析大数据平台

Natural Korean Processor for Apache Spark

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

When Apache Pulsar meets Apache Spark

Apache Spark 官方文档中文版

Generic Data Ingestion & Dispersal Library for Hadoop

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

A curated list of Pulsar tools, integrations and resources.

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

GeoTrellis for PySpark

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

A big data platform for analyzing web access logs

A heterogeneous Apache Spark framework.

The Internals of Apache Spark

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Simple windows desktop application for viewing & querying Apache Parquet files

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Apache Spark Website

type-class based data cleansing library for Apache Spark SQL

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

A visual ETL development and debugging tool for big data

🚢 Docker image for Apache Spark

Apache Spark Connector for Azure Cosmos DB

Cookbook to install Hadoop 2.0+ using Chef

ROOT I/O in pure Python and NumPy.

Custom state store providers for Apache Spark

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Research on distributed system

A simple Spark-powered ETL framework that just works 🍺

A framework for writing Spark 2.x applications in a pretty way

Spark、Flink等离线任务的调度以及实时任务的监控

Profile and monitor your ML data pipeline end-to-end

🐳 big data study

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Big Data Ecosystem Docker

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Big Data Toolkit for the JVM

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Source code for James Lee's Aparch Spark with Java course

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Distributed Big Data Orchestration Service

extremely distributed machine learning

A pandas-like deferred expression system, with first-class SQL support

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Asakusa Framework

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS