200 Open source projects that are alternatives of or similar to Quinn

A boilerplate for writing PySpark Jobs

Apache Spark Connector for Azure Cosmos DB

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

A curated list of awesome Apache Spark packages and resources.

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Apache (Py)Spark type annotations (stub files).

Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …

Asynchronous actions for PySpark

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Real-world Spark pipelines examples

Structural Bioinformatics Training Workshop & Hackathon 2018

Apache Spark for data engineers

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook

Simple and Distributed Machine Learning

Fundamentals of Spark with Python (using PySpark), code examples

Simple and Distributed Machine Learning

Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Project for James' Apache Spark with Scala course

LearningApacheSpark

🐍 Quick reference guide to common patterns & functions in PySpark.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

State of the Art Natural Language Processing

A recommender system for discovering GitHub repos, built with Apache Spark

Apache Spark docker image

A tool for building feature stores.

HandySpark - bringing pandas-like capabilities to Spark dataframes

pyspark🍒🥭 is delicious，just eat it!😋😋

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Relation Extraction using Deep learning(CNN)

Process Common Crawl data with Python and Spark

Isolation Forest on Spark

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Updated repository

PySpark Code for Hands-on Learners

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

Simple windows desktop application for viewing & querying Apache Parquet files

Spark 2.0 Python Machine Learning examples

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Apache Spark (PySpark) Practice on Real Data

A framework for writing Spark 2.x applications in a pretty way

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

Custom state store providers for Apache Spark

Open source platform for the machine learning lifecycle

A visual ETL development and debugging tool for big data

Word2Vec models with Twitter data using Spark. Blog:

🌐 Interactive Workshop on GeoAnalysis using PySpark

Profile and monitor your ML data pipeline end-to-end

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

A curated list of Pulsar tools, integrations and resources.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

When Apache Pulsar meets Apache Spark

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

A Spark Atlas connector to track data lineage in Apache Atlas