Spark With PythonFundamentals of Spark with Python (using PySpark), code examples
Stars: ✭ 150 (-9.09%)
Pysparkgeoanalysis🌐 Interactive Workshop on GeoAnalysis using PySpark
Stars: ✭ 63 (-61.82%)
SparkmagicJupyter magics and kernels for working with remote Spark clusters
Stars: ✭ 954 (+478.18%)
Live log analyzer sparkSpark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.
Stars: ✭ 14 (-91.52%)
W2vWord2Vec models with Twitter data using Spark. Blog:
Stars: ✭ 64 (-61.21%)
autThe Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
Stars: ✭ 111 (-32.73%)
Optimus🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark
Stars: ✭ 986 (+497.58%)
Spark PracticeApache Spark (PySpark) Practice on Real Data
Stars: ✭ 200 (+21.21%)
Spark Py NotebooksApache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
Stars: ✭ 1,338 (+710.91%)
HandysparkHandySpark - bringing pandas-like capabilities to Spark dataframes
Stars: ✭ 158 (-4.24%)
Spark Jupyter AwsA guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (+56.97%)
MmlsparkSimple and Distributed Machine Learning
Stars: ✭ 2,899 (+1656.97%)
Agile data code 2Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
Stars: ✭ 413 (+150.3%)
Azure Event Hubs SparkEnabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Stars: ✭ 140 (-15.15%)
Datahacksummit 2017Apache Zeppelin notebooks for Recommendation Engines using Keras and Machine Learning on Apache Spark
Stars: ✭ 30 (-81.82%)
Spark FlamegraphEasy CPU Profiling for Apache Spark applications
Stars: ✭ 30 (-81.82%)
PixiedustPython Helper library for Jupyter Notebooks
Stars: ✭ 998 (+504.85%)
Awesome SparkA curated list of awesome Apache Spark packages and resources.
Stars: ✭ 1,061 (+543.03%)
Spark StatesCustom state store providers for Apache Spark
Stars: ✭ 83 (-49.7%)
Spark Nlp ModelsModels and Pipelines for the Spark NLP library
Stars: ✭ 88 (-46.67%)
TedsdsApache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark
Stars: ✭ 14 (-91.52%)
Pulsar SparkWhen Apache Pulsar meets Apache Spark
Stars: ✭ 55 (-66.67%)
Hops ExamplesExamples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops
Stars: ✭ 84 (-49.09%)
Bitcoin Value Predictor[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin
Stars: ✭ 91 (-44.85%)
Spark TdaSparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.
Stars: ✭ 45 (-72.73%)
Spark NkpNatural Korean Processor for Apache Spark
Stars: ✭ 50 (-69.7%)
Sparkling TitanicTraining models with Apache Spark, PySpark for Titanic Kaggle competition
Stars: ✭ 12 (-92.73%)
Pyspark ExamplesCode examples on Apache Spark using python
Stars: ✭ 58 (-64.85%)
Awesome PulsarA curated list of Pulsar tools, integrations and resources.
Stars: ✭ 57 (-65.45%)
CuesheetA framework for writing Spark 2.x applications in a pretty way
Stars: ✭ 86 (-47.88%)
MobiusC# and F# language binding and extensions to Apache Spark
Stars: ✭ 929 (+463.03%)
Whylogs JavaProfile and monitor your ML data pipeline end-to-end
Stars: ✭ 164 (-0.61%)
SplashSplash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
Stars: ✭ 105 (-36.36%)
AlmondA Scala kernel for Jupyter
Stars: ✭ 1,354 (+720.61%)
Pyspark StubsApache (Py)Spark type annotations (stub files).
Stars: ✭ 98 (-40.61%)
HnswlibJava library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs
Stars: ✭ 108 (-34.55%)
Spark On K8s OperatorKubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
Stars: ✭ 1,780 (+978.79%)
Pyspark Cheatsheet🐍 Quick reference guide to common patterns & functions in PySpark.
Stars: ✭ 108 (-34.55%)
Griffon VmGriffon Data Science Virtual Machine
Stars: ✭ 128 (-22.42%)
Spark.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Stars: ✭ 1,721 (+943.03%)
Python BigdataData science and Big Data with Python
Stars: ✭ 112 (-32.12%)
Repo 2019BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics
Stars: ✭ 133 (-19.39%)
Cc PysparkProcess Common Crawl data with Python and Spark
Stars: ✭ 147 (-10.91%)
Data science blogsA repository to keep track of all the code that I end up writing for my blog posts.
Stars: ✭ 139 (-15.76%)