399 Open source projects that are alternatives of or similar to Spark

A Clojure dataframe library that runs on Spark

Elassandra = Elasticsearch + Apache Cassandra

Geospatial Raster support for Spark DataFrames

📊 Cube — Open-Source Analytics API for Building Data Apps

Spark、Flink等离线任务的调度以及实时任务的监控

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

extremely distributed machine learning

Monitor Apache Spark from Jupyter Notebook

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

Spark Structured Streaming / Kafka / Cassandra / Elastic

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Spark SQL index for Parquet tables

Julia binding for Apache Spark

🐍 Quick reference guide to common patterns & functions in PySpark.

Node.js bindings for Apache Spark DataFrame APIs

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Big Data Ecosystem Docker

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Source code for James Lee's Aparch Spark with Java course

Distributed t-SNE via Apache Spark

Spark Terasort

Avro SerDe for Apache Spark structured APIs.

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

A Scala kernel for Jupyter

Jupyter kernel for scala and spark

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

A large-scale entity and relation database supporting aggregation of properties

spark summit 2017 SanFrancisco

Simple and beautiful card component with an elegant spark line, for VueJS.

Spark on Kubernetes infrastructure Helm charts repo

Feature Store for Machine Learning

Run spark calculations from Ammonite

Fundamentals of Spark with Python (using PySpark), code examples

Spark 2.0 Python Machine Learning examples

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with luv by Data Scientists & Security Analysts from the Cyber Security Industry. [PRE-ALPHA]

A framework for writing Spark 2.x applications in a pretty way

GeoTrellis for PySpark

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Collaborate on privacy-preserving policy for data science projects in Pandas and Apache Spark

Cookbook to install Hadoop 2.0+ using Chef

Updated repository

MLeap: Deploy ML Pipelines to Production

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Hybrid model of Gradient Boosting Trees and Logistic Regression (GBDT+LR) on Spark

Content for architecting a data science platform for products using Luigi, Spark & Flask.

This package contains a generic implementation of greedy Information Theoretic Feature Selection (FS) methods. The implementation is based on the common theoretic framework presented by Gavin Brown. Implementations of mRMR, InfoGain, JMI and other commonly used FS filters are provided.

State of the Art Natural Language Processing

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Apache Spark Connector for Azure Cosmos DB

HandySpark - bringing pandas-like capabilities to Spark dataframes

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Boiler plate framework to use Spark and ZIO together.