1689 Open source projects that are alternatives of or similar to Spark_python_ml_examples

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Relation Extraction using Deep learning(CNN)

Apache Spark (PySpark) Practice on Real Data

Big Data Processing Framework - Unified Data API or SQL on Any Storage

A library that provides useful extensions to Apache Spark and PySpark.

Example project implementing best practices for PySpark ETL jobs and applications.

HandySpark - bringing pandas-like capabilities to Spark dataframes

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

Apache Spark on AWS Lambda

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Jupyter magics and kernels for working with remote Spark clusters

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Process Common Crawl data with Python and Spark

Fundamentals of Spark with Python (using PySpark), code examples

State of the Art Natural Language Processing

Simple and Distributed Machine Learning

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Some class materials for a data processing course using PySpark

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Machine Learning Platform and Recommendation Engine built on Kubernetes

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

🎼 Docker compose files for various kafka stacks

A Spark library for Amazon SageMaker.

A comprehensive list of Deep Learning / Artificial Intelligence and Machine Learning tutorials - rapidly expanding into areas of AI/Deep Learning / Machine Vision / NLP and industry specific areas such as Climate / Energy, Automotives, Retail, Pharma, Medicine, Healthcare, Policy, Ethics and more.

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

A simple Spark TDD example

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Word2Vec models with Twitter data using Spark. Blog:

Updated repository

pyspark🍒🥭 is delicious，just eat it!😋😋

LearningApacheSpark

🐍 Quick reference guide to common patterns & functions in PySpark.

Isolation Forest on Spark

Apache Spark Connector for Azure Cosmos DB

Udacity Data Engineering Nano Degree (DEND)

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

🌐 Interactive Workshop on GeoAnalysis using PySpark

A luigi powered analytics / warehouse stack

A command-line validation tool for AWS Cloud Formation that allows to conquer the cloud faster!

Terraform module which creates ELB resources on AWS

Classify each facial image into one of the seven facial emotion categories considered using CNN based on https://www.kaggle.com/c/challenges-in-representation-learning-facial-expression-recognition-challenge

Terraform for AWS EKS

A community run, 5-day PyTorch Deep Learning Bootcamp

⚡️ ☁️ Pass Lambda events to the application running on your machine | Debug real traffic locally | Forget about redeployments

MLeap: Deploy ML Pipelines to Production

Visualize data using relative ordering

☁️ 🐳 ⚡️ 🚀 Create environment and deployment pipelines to ECS Fargate with CodePipeline, CodeBuild and Github using Terraform

Hybrid model of Gradient Boosting Trees and Logistic Regression (GBDT+LR) on Spark

AWS automation scripts and lambda functions

This or that - Real-time atomic voting app built with AWS Amplify

There are plenty of courses and tutorials that can help you learn machine learning from scratch but here in GitHub, I want to solve some Kaggle competitions as a comprehensive workflow with python packages. After reading, you can use this workflow to solve other real problems and use it as a template.

Terraform Module for CI/CD with AWS Code Pipeline and Code Build for ECS https://cloudposse.com/

Real-time Collaborative Markdown Editor

Search aggregator for Slack, Google Docs, GitHub, and more 🔍