201 Open source projects that are alternatives of or similar to learn-by-examples

A boilerplate for writing PySpark Jobs

Apache Spark Connector for Azure Cosmos DB

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Asynchronous actions for PySpark

Apache (Py)Spark type annotations (stub files).

Simple and Distributed Machine Learning

A curated list of awesome Apache Spark packages and resources.

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Fundamentals of Spark with Python (using PySpark), code examples

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Structural Bioinformatics Training Workshop & Hackathon 2018

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

pyspark methods to enhance developer productivity 📣 👯 🎉

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Apache Spark for data engineers

Simple and Distributed Machine Learning

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

A visual ETL development and debugging tool for big data

Infrastructures™ for Machine Learning Training/Inference in Production.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Use the TPC-DS benchmark to test Spark SQL performance

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Griffon Data Science Virtual Machine

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Apache Spark on AWS Lambda

Apache Spark™ and Scala Workshops

Astronomy Broker based on Apache Spark

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Project for James' Apache Spark with Scala course

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

A connector for Apache Spark to access Exasol

Notes on Apache Spark (pyspark)

Apache Spark docker image

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

A framework for writing Spark 2.x applications in a pretty way

Custom state store providers for Apache Spark

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.

Código para workshops Spark com ambiente de desenvolvimento em docker

Train and run Pytorch models on Apache Spark.

Open source platform for the machine learning lifecycle

A curated list of Pulsar tools, integrations and resources.

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

When Apache Pulsar meets Apache Spark

No description or website provided.

PySpark + Scikit-learn = Sparkit-learn

Natural Korean Processor for Apache Spark

Profile and monitor your ML data pipeline end-to-end

(Deprecated) Scikit-learn integration package for Apache Spark

The Internals of Apache Spark

A connector for Apache Spark and PySpark to Dgraph databases.

A Spark Atlas connector to track data lineage in Apache Atlas