421 Open source projects that are alternatives of or similar to spark3D

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

A command-line tool for launching Apache Spark clusters.

Use the TPC-DS benchmark to test Spark SQL performance

REST web service for the true real-time scoring (<1 ms) of Scikit-Learn, R and Apache Spark models

A connector for Apache Spark and PySpark to Dgraph databases.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Griffon Data Science Virtual Machine

The Internals of Spark Structured Streaming

Notes on Apache Spark (pyspark)

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

酷玩 Spark: Spark 源代码解析、Spark 类库等

A pure Nim k-d tree implementation for efficient spatial querying of point data

Apache Spark docker image

PySpark Cheatsheet

Train and run Pytorch models on Apache Spark.

Example Maven configuration for a Spark, Scala project

Basic framework utilities to quickly start writing production ready Apache Spark applications

Easy to use library to bring Tensorflow on Apache Spark

A framework for writing Spark 2.x applications in a pretty way

Rapid and flexible acquisition, analysis, fitting, and plotting in Python. Designed for scientific laboratories.

Spark structured streaming examples with using of version 3.0.0

Open source platform for the machine learning lifecycle

🐬 Apache Parquet for modern .Net

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

A recommender system for discovering GitHub repos, built with Apache Spark

Spark examples

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

When Apache Pulsar meets Apache Spark

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

A connector for Apache Spark to access Exasol

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

A Spark Atlas connector to track data lineage in Apache Atlas

Spark in Action, 2nd edition - chapter 1 - Introduction

(Deprecated) Scikit-learn integration package for Apache Spark

The Internals of Spark SQL

The Internals of Spark SQL

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Extensible streaming ingestion pipeline on top of Apache Spark

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

No description or website provided.

Distributed Bayesian Entity Resolution in Apache Spark

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Spark cloud integration: tests, cloud committers and more

Simple windows desktop application for viewing & querying Apache Parquet files

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.

Infrastructures™ for Machine Learning Training/Inference in Production.

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Easy CPU Profiling for Apache Spark applications

Spark in Action, 2nd edition - chapter 7 - Ingestion from files

Apache Zeppelin notebooks for Recommendation Engines using Keras and Machine Learning on Apache Spark

A visual ETL development and debugging tool for big data

Plot live-stats as graph from ApacheSpark application using Lightning-viz

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

QGIS visualization workshop materials.