458 Open source projects that are alternatives of or similar to Sparkling Titanic

Process Common Crawl data with Python and Spark

A simple Spark TDD example

🌐 Interactive Workshop on GeoAnalysis using PySpark

Jupyter magics and kernels for working with remote Spark clusters

Apache Spark (PySpark) Practice on Real Data

🐍 Quick reference guide to common patterns & functions in PySpark.

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Fundamentals of Spark with Python (using PySpark), code examples

Isolation Forest on Spark

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A library that provides useful extensions to Apache Spark and PySpark.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Relation Extraction using Deep learning(CNN)

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Some class materials for a data processing course using PySpark

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Word2Vec models with Twitter data using Spark. Blog:

pyspark🍒🥭 is delicious，just eat it!😋😋

Updated repository

Apache Spark Connector for Azure Cosmos DB

LearningApacheSpark

🎼 Docker compose files for various kafka stacks

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

HandySpark - bringing pandas-like capabilities to Spark dataframes

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

State of the Art Natural Language Processing

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

Example project implementing best practices for PySpark ETL jobs and applications.

Spark 2.0 Python Machine Learning examples

Simple and Distributed Machine Learning

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Scalable genomic data analysis.

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

C# and F# language binding and extensions to Apache Spark

Parquet file generator

电商用户行为分析大数据平台

Coursera's big data course with Scala and Spark

A cohesive & pragmatic framework of FP centric Scala libraries

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

Scala toolchain for InfluxDB

Sparkling Water provides H2O functionality inside Spark cluster

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

DataFusion has now been donated to the Apache Arrow project

深圳地铁大数据客流分析系统🚇🚄🌟

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

The MongoDB Spark Connector

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Alluxio, data orchestration for analytics and machine learning in the cloud

Learning Apache spark,including code and data .Most part can run local.

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Essential Spark extensions and helper methods ✨😲

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu