456 Open source projects that are alternatives of or similar to spark-extension

Server for the ListenBrainz project

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

Generic Data Ingestion & Dispersal Library for Hadoop

Spark Streaming监控平台，支持任务部署与告警、自启动

A luigi powered analytics / warehouse stack

Machine Learning Course @ Santa Clara University

一个大数据架构师应该掌握的技能

Elassandra = Elasticsearch + Apache Cassandra

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

The Internals of Spark SQL

Building Large-Scale AI Applications for Distributed Big Data

Spark RDD with Lucene's query and entity linkage capabilities

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

A compiler for automatically re-targeting sequential Java code to Apache Spark.

This is the development repository of SparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics data.

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

Applying Data Science and Machine Learning to Solve Real World Business Problems

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

Data science and Big Data with Python

Optimized Analytics Package for Spark* Platform

This repo contains commands that data engineers use in day to day work.

A Scala wrapper for Deeplearning4j, inspired by Keras. Scala + DL + Spark + GPUs

Distributed Deep learning with Keras & Spark

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Apache Spark™ and Scala Workshops

A tool for monitoring and tuning Spark jobs for efficiency.

Production Ready Data Integration Product, documentation：

ClickHouse Native Protocol JDBC implementation

Online search advertisement platform & Realtime Campaign Monitoring [Maybe Deprecated]

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Two-day workshop that covers how to use R to interact databases and Spark

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

A Spark library for Amazon SageMaker.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

A distributed data processing framework in Haskell.

No description or website provided.

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Spark Structured Streaming / Kafka / Cassandra / Elastic

Big Data for Data Engineers Coursera Specialization from Yandex

Interactive and Reactive Data Science using Scala and Spark.

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

ETL Library for Machine Learning - data pipelines, data munging and wrangling

Machine Learning Platform and Recommendation Engine built on Kubernetes

A simple spark standalone cluster for your testing environment purposses

基于Spark2.2新闻网大数据实时系统项目

Distributed scikit-learn meta-estimators in PySpark

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Enabling queries on compressed data.

MLOps Platform

四川大学拓思爱诺用户session行为数据离线分析项目

An improved implementation of the classical feature selection method: minimum Redundancy and Maximum Relevance (mRMR).

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

A complete (distributed) BigData stack, running in containers

Asynchronous actions for PySpark

Writing application logic for Spark jobs that can be unit-tested without a SparkContext

Apache Spark docker container image (Standalone mode)

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

Code for my presentation: Using PySpark to Process Boat Loads of Data