575 Open source projects that are alternatives of or similar to Docker Spark

Manage Apache Atlas and Ranger configuration for your Hadoop environment.

Tools for handling firmwares of DJI products, with focus on quadcopters.

Documentation placeholder and utilities for all the other containers.

Code for the deployment of Hadoop clusters, written in Bourne or Bourne Again shell.

A Scala feature transformation library for data science and machine learning

This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

Server for the ListenBrainz project

Apache Spark Website

Hive UDFs for funnel analysis

Apache Spark 官方文档中文版

450+ AWS, Hadoop, Cloud, Kafka, Docker, Elasticsearch, RabbitMQ, Redis, HBase, Solr, Cassandra, ZooKeeper, HDFS, Yarn, Hive, Presto, Drill, Impala, Consul, Spark, Jenkins, Travis CI, Git, MySQL, Linux, DNS, Whois, SSL Certs, Yum Security Updates, Kubernetes, Cloudera etc...

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Minikube for big data with Scala and Spark

UEBA Solution for Insider Security. This repo is archived. Thanks!

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

SQL backend to dplyr for Impala

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Hadoop utility to compact small files

Teradata Distribution of Presto -- A Distributed SQL Query Engine for Big Data

A curated list of Pulsar tools, integrations and resources.

Liquibase extension to add Impala Database support

General Architecture for Text Engineering

MySQL to NoSQL real time dataflow

HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

Kafka Connect HDFS connector

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Prometheus jmx_exporter configurations for Cloudera Hadoop

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Training models with Apache Spark, PySpark for Titanic Kaggle competition

An ORC File Scheme for the Cascading data processing platform.

Apache Ignite

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

When Apache Pulsar meets Apache Spark

[Archive] Intern project - Big Data Exploration using MongoDB - This Repository is NOT a supported MongoDB product

Learn and understand Docker technologies, with real DevOps practice!

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Multi docker container images for main Big Data Tools. (Hadoop, Spark, Kafka, HBase, Cassandra, Zookeeper, Zeppelin, Drill, Flink, Hive, Hue, Mesos, ... )

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

Optimize and improve the Label propagation algorithm

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

Information Inference Service of the OpenAIRE system

基于Hadoop的分布式云存储系统 🌴

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

Companion to Learning Hadoop and Learning Spark courses on Linked In Learning

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

scala、spark使用过程中，各种测试用例以及相关资料整理

Python Helper library for Jupyter Notebooks

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

blog entries

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Model complex data transformation pipelines easily

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

Example project implementing best practices for PySpark ETL jobs and applications.

A library that provides useful extensions to Apache Spark and PySpark.