435 Open source projects that are alternatives of or similar to Example Spark

Apache Spark and Apache Kafka integration example

酷玩 Spark: Spark 源代码解析、Spark 类库等

Scala examples for learning to use Spark

A Flexible and Powerful Parameter Server for large-scale machine learning

C# and F# language binding and extensions to Apache Spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Code examples on Apache Spark using python

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Real Time Analytics and Data Pipelines based on Spark Streaming

An open source framework for building data analytic applications.

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Custom state store providers for Apache Spark

Updated repository

Production Ready Data Integration Product, documentation：

scala、spark使用过程中，各种测试用例以及相关资料整理

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

零基础学习spark，大数据学习

Kinesis Connector for Structured Streaming

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Content for architecting a data science platform for products using Luigi, Spark & Flask.

A RPC framework leveraging Spark RPC module

A Clojure dataframe library that runs on Spark

Monitor Apache Spark from Jupyter Notebook

Schema Registry

Simple yet powerful live data computation framework

Compile-time Language Integrated Queries for Scala

An open-source toolkit for large-scale genomic analysis

Write your Spark data to Kafka seamlessly

HandySpark - bringing pandas-like capabilities to Spark dataframes

Version 1 of Technical Best Practices of Azure Databricks based on real world Customer and Technical SME inputs

LearningApacheSpark

Firely's open source FHIR server

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Apache Spark (PySpark) Practice on Real Data

Julia binding for Apache Spark

State of the Art Natural Language Processing

Live-coding the cluster!

StreamLine - Streaming Analytics

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Distributed t-SNE via Apache Spark

spark ml 算法原理剖析以及具体的源码实现分析

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Java开发者或者大数据开发者面试知识点整理

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

A better compressed bitset in Java

Spark Structured Streaming / Kafka / Cassandra / Elastic

Fundamentals of Spark with Python (using PySpark), code examples

Isolation Forest on Spark

Process Common Crawl data with Python and Spark

Pandas and Spark DataFrame comparison for humans

GeoTrellis for PySpark

DataStax Spark Cassandra Connector

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

Apache Spark Connector for Azure Cosmos DB

Fast, Scientific and Numerical Computing for the JVM (NDArrays)