6578 Open source projects that are alternatives of or similar to Spark Tdd Example

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

🌐 Interactive Workshop on GeoAnalysis using PySpark

Fundamentals of Spark with Python (using PySpark), code examples

Word2Vec models with Twitter data using Spark. Blog:

Jupyter magics and kernels for working with remote Spark clusters

Updated repository

Apache Spark (PySpark) Practice on Real Data

HandySpark - bringing pandas-like capabilities to Spark dataframes

Apache Spark Connector for Azure Cosmos DB

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

Python Helper library for Jupyter Notebooks

🎓 Jupyter notebooks from UFC data science course

Big Data for Data Engineers Coursera Specialization from Yandex

PySpark Code for Hands-on Learners

A Scala kernel for Jupyter

Data science and Big Data with Python

A repository to keep track of all the code that I end up writing for my blog posts.

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics

Content for architecting a data science platform for products using Luigi, Spark & Flask.

Big Data Ecosystem Docker

Some class materials for a data processing course using PySpark

🎼 Docker compose files for various kafka stacks

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Simple and Distributed Machine Learning

State of the Art Natural Language Processing

Isolation Forest on Spark

Code examples on Apache Spark using python

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

A library that provides useful extensions to Apache Spark and PySpark.

The Hunting ELK

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

Udacity Data Engineering Nano Degree (DEND)

Models and Pipelines for the Spark NLP library

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

LearningApacheSpark

Example project implementing best practices for PySpark ETL jobs and applications.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Applying Data Science and Machine Learning to Solve Real World Business Problems

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

pyspark🍒🥭 is delicious，just eat it!😋😋

Process Common Crawl data with Python and Spark

This is a repo documenting the best practices in PySpark.

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A free tutorial for Apache Spark.