Top 625 spark open source projects

something to help you spark

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

🎓 Jupyter notebooks from UFC data science course

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

Code examples on Apache Spark using python

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

A Spark cluster setup running on Docker containers

Code and presentation for Strata Model Serving tutorial

A curated list of Pulsar tools, integrations and resources.

Apache Spark examples exclusively in Java

When Apache Pulsar meets Apache Spark

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

scala、spark使用过程中，各种测试用例以及相关资料整理

This is a based on playframwork for submit spark app

Natural Korean Processor for Apache Spark

The Internals of Apache Spark

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline

Spark examples

Official code repository for GATK versions 4 and up

Apache Spark Connector for Azure Kusto

Python Helper library for Jupyter Notebooks

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

A big data platform for analyzing web access logs

零基础学习spark，大数据学习

Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR

Easy CPU Profiling for Apache Spark applications

Jupyter magics and kernels for working with remote Spark clusters

Bucketing and partitioning system for Parquet

MapReduce, Spark, Java, and Scala for Data Algorithms Book

High performance HBase / Spark SQL engine

Apache Spark - A unified analytics engine for large-scale data processing

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

A Time Series Library for Apache Spark

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Urho3D extension library

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Feature engineering toolkit for Spark MLlib.

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

A heterogeneous Apache Spark framework.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

Efficient variant-call data storage and retrieval library using the TileDB storage library.

Spark (http://sparkjava.com/) support for Swagger (https://swagger.io/)

C# and F# language binding and extensions to Apache Spark

Scala toolchain for InfluxDB

A simple Spark TDD example

Java Convolutional Neural Network example for Hand Writing Digit Recognition

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

A free tutorial for Apache Spark.

Parquet file generator