Top 625 spark open source projects

GraphSense Transformation Pipeline

A way for home buyers to know about factors affecting a state

从本地IDEA提交Flink/Spark任务到Yarn/k8s集群

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

(117th place - Top 26%) Deep learning using Keras and Spark for the "Store Item Demand Forecasting" Kaggle competition.

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

Highly performant data storage in C++ for importing, querying and transforming variant data with C/C++/Java/Spark bindings. Used in gatk4.

JSON/JWK/JWS/JWT/Base64 library in SPARK

R Interface to MLeap

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

PipelineAI Kubeflow Distribution

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4

A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

A connector for Apache Spark to access Exasol

Monitor the stability of a Pandas or Spark dataframe ⚙︎

Super-fast Spark RDD for Titan Graph Database on HBase

Código para workshops Spark com ambiente de desenvolvimento em docker

Microsoft's contributions for Spark with Apache Accumulo

Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )

A connector for Apache Spark and PySpark to Dgraph databases.

Spark bindings for Mozilla Telemetry

bigdatatutorial

Adds a notification panel to your Laravel Spark Kiosk, allowing you to send notifications to users.