awesome-spark / Spark Gotchas
Licence: other
Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks
Stars: ✭ 308
Projects that are alternatives of or similar to Spark Gotchas
datalake-etl-pipeline
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
Stars: ✭ 39 (-87.34%)
Mutual labels: apache-spark, pyspark
Spark-for-data-engineers
Apache Spark for data engineers
Stars: ✭ 22 (-92.86%)
Mutual labels: apache-spark, pyspark
Sparkora
Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟
Stars: ✭ 51 (-83.44%)
Mutual labels: apache-spark, pyspark
isarn-sketches-spark
Routines and data structures for using isarn-sketches idiomatically in Apache Spark
Stars: ✭ 28 (-90.91%)
Mutual labels: apache-spark, pyspark
mmtf-workshop-2018
Structural Bioinformatics Training Workshop & Hackathon 2018
Stars: ✭ 50 (-83.77%)
Mutual labels: apache-spark, pyspark
learn-by-examples
Real-world Spark pipelines examples
Stars: ✭ 84 (-72.73%)
Mutual labels: apache-spark, pyspark
SynapseML
Simple and Distributed Machine Learning
Stars: ✭ 3,355 (+989.29%)
Mutual labels: apache-spark, pyspark
Azure Cosmosdb Spark
Apache Spark Connector for Azure Cosmos DB
Stars: ✭ 165 (-46.43%)
Mutual labels: apache-spark, pyspark
pyspark-asyncactions
Asynchronous actions for PySpark
Stars: ✭ 30 (-90.26%)
Mutual labels: apache-spark, pyspark
aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-63.96%)
Mutual labels: apache-spark, pyspark
spark3D
Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteorology, …
Stars: ✭ 23 (-92.53%)
Mutual labels: apache-spark, pyspark
Choo Handbook
🚂✋📖 - Learn the choo framework through a set of exercises
Stars: ✭ 266 (-13.64%)
Mutual labels: book, guide
Mastering Spark Sql Book
The Internals of Spark SQL
Stars: ✭ 234 (-24.03%)
Mutual labels: apache-spark, book
spark-twitter-sentiment-analysis
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
Stars: ✭ 55 (-82.14%)
Mutual labels: apache-spark, pyspark
Quinn
pyspark methods to enhance developer productivity 📣 👯 🎉
Stars: ✭ 217 (-29.55%)
Mutual labels: apache-spark, pyspark
jupyterlab-sparkmonitor
JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
Stars: ✭ 78 (-74.68%)
Mutual labels: apache-spark, pyspark
Pyspark Stubs
Apache (Py)Spark type annotations (stub files).
Stars: ✭ 98 (-68.18%)
Mutual labels: apache-spark, pyspark
Spark With Python
Fundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-51.3%)
Mutual labels: apache-spark, pyspark
pyspark-cheatsheet
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
Stars: ✭ 115 (-62.66%)
Mutual labels: apache-spark, pyspark
Pure Sh Bible
📖 A collection of pure POSIX sh alternatives to external processes.
Stars: ✭ 3,246 (+953.9%)
Mutual labels: book, guide
Spark Gotchas
Table of Contents
- Introduction
- Understanding Spark Architecture
- Spark Application Deployment
- Spark Application Building
- RDD actions and Transformations by Example
- Spark SQL and Dataset API
- Data Preparation
- Iterative Algorithms
- PySpark Applications
- Serialization
License
This work, excluding code examples, is licensed under Creative Commons Attribution-ShareAlike 4.0 International license.
Accompanying code and code snippets are licensed under MIT license.
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].