6452 Open source projects that are alternatives of or similar to Azure Cosmosdb Spark

Models and Pipelines for the Spark NLP library

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Sentiment Analysis of a Twitter Topic with Spark Structured Streaming

Simple and Distributed Machine Learning

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

Apache Spark in your IDE with gradle

Some class materials for a data processing course using PySpark

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A curated list of Pulsar tools, integrations and resources.

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Udacity Data Engineering Nano Degree (DEND)

PySpark Code for Hands-on Learners

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

A library that provides useful extensions to Apache Spark and PySpark.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

This is a repo documenting the best practices in PySpark.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Interactive and Reactive Data Science using Scala and Spark.

Example project implementing best practices for PySpark ETL jobs and applications.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

The MongoDB Spark Connector

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

The Internals of Spark SQL

Easy CPU Profiling for Apache Spark applications

Apache Zeppelin notebooks for Recommendation Engines using Keras and Machine Learning on Apache Spark

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Data science and Big Data with Python

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

A curated list of awesome Apache Spark packages and resources.

Apache Spark - Turbofan Engine Degradation Simulation Data Set example in Apache Spark

BERT, AWS RDS, AWS Forecast, EMR Spark Cluster, Hive, Serverless, Google Assistant + Raspberry Pi, Infrared, Google Cloud Platform Natural Language, Anomaly detection, Tensorflow, Mathematics

📚 Various cheatsheets in PDF

Code examples on Apache Spark using python

Spark 2.0 Python Machine Learning examples

A framework for writing Spark 2.x applications in a pretty way

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

pyspark🍒🥭 is delicious，just eat it!😋😋

Use the TPC-DS benchmark to test Spark SQL performance

Apache Spark on AWS Lambda

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

A Scala kernel for Jupyter

🐍 Quick reference guide to common patterns & functions in PySpark.

Apache (Py)Spark type annotations (stub files).

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Griffon Data Science Virtual Machine

Relation Extraction using Deep learning(CNN)

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Apache Spark™ and Scala Workshops

Training models with Apache Spark, PySpark for Titanic Kaggle competition

A repository to keep track of all the code that I end up writing for my blog posts.

Process Common Crawl data with Python and Spark

LearningApacheSpark