575 Open source projects that are alternatives of or similar to Docker Spark

Java Convolutional Neural Network example for Hand Writing Digit Recognition

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

The Internals of Apache Spark

A free tutorial for Apache Spark.

Docker containers for Hadoop.

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

Big Data for Data Engineers Coursera Specialization from Yandex

Essential Spark extensions and helper methods ✨😲

Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

An open source framework for building data analytic applications.

An easy way to deploy your Akka services to a distributed environment.

💎🔥大数据学习笔记

Apache Hadoop docker image

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

Jupyter magics and kernels for working with remote Spark clusters

https://www.researchgate.net/profile/Rajah_Iyer

Code examples on Apache Spark using python

Parquet file generator

Axibase Time Series Database Documentation

Research on distributed system

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Coursera's big data course with Scala and Spark

Examples for High Performance Spark

High performance HBase / Spark SQL engine

Tools for handling firmwares of DJI products, with focus on quadcopters.

A Scala feature transformation library for data science and machine learning

Apache Spark Website

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

Sparkling Water provides H2O functionality inside Spark cluster

A curated list of Pulsar tools, integrations and resources.

MySQL to NoSQL real time dataflow

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Word2Vec models with Twitter data using Spark. Blog:

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Apache Ignite

When Apache Pulsar meets Apache Spark

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Optimize and improve the Label propagation algorithm

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

A connector for Spark that allows reading and writing to/from Redis cluster

scala、spark使用过程中，各种测试用例以及相关资料整理

R interface for Apache Spark

List of Data Science Cheatsheets to rule the world

Next generation tool for decentralized exchange and transformation of semi-structured data

Real-time Machine Learning with Apache Spark on Twitter Public Stream

Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline

A Flexible and Powerful Parameter Server for large-scale machine learning

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

Spark examples

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset