6546 Open source projects that are alternatives of or similar to Pyspark Examples

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Fundamentals of Spark with Python (using PySpark), code examples

Updated repository

Custom state store providers for Apache Spark

Word2Vec models with Twitter data using Spark. Blog:

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

A repository to keep track of all the code that I end up writing for my blog posts.

Apache Spark (PySpark) Practice on Real Data

Apache Spark Connector for Azure Cosmos DB

Applying Data Science and Machine Learning to Solve Real World Business Problems

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

🌐 Interactive Workshop on GeoAnalysis using PySpark

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Data science and Big Data with Python

🐍💻📊 All material from the PyCon.DE 2018 Talk "Beyond Jupyter Notebooks - Building your own data science platform with Python & Docker" (incl. Slides, Video, Udemy MOOC & other References)

Big Data Ecosystem Docker

Models and Pipelines for the Spark NLP library

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

酷玩 Spark: Spark 源代码解析、Spark 类库等

Scala examples for learning to use Spark

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

An open source framework for building data analytic applications.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

A Flexible and Powerful Parameter Server for large-scale machine learning

Apache Spark and Apache Kafka integration example

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Spark, Spark Streaming and Spark SQL unit testing strategies

Kinesis Connector for Structured Streaming

🎓 Jupyter notebooks from UFC data science course

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Big Data for Data Engineers Coursera Specialization from Yandex

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

A Scala kernel for Jupyter

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Udacity Data Engineering Nano Degree (DEND)

Jupyter magics and kernels for working with remote Spark clusters

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Content for architecting a data science platform for products using Luigi, Spark & Flask.

HandySpark - bringing pandas-like capabilities to Spark dataframes

Production Ready Data Integration Product, documentation：

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

The Hunting ELK

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

Real Time Analytics and Data Pipelines based on Spark Streaming

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

blog entries

C# and F# language binding and extensions to Apache Spark

A simple Spark TDD example

零基础学习spark，大数据学习

A free tutorial for Apache Spark.

Python Helper library for Jupyter Notebooks

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

scala、spark使用过程中，各种测试用例以及相关资料整理

Text Generation using Bidirectional LSTM and Doc2Vec models