458 Open source projects that are alternatives of or similar to Eat_pyspark_in_10_days

Simple and Distributed Machine Learning

Spark 2.0 Python Machine Learning examples

Process Common Crawl data with Python and Spark

Spark Application for analysis of Apache Access logs and detect anamolies! Along with Medium Article.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Isolation Forest on Spark

Java library for approximate nearest neighbors search using Hierarchical Navigable Small World graphs

Example project implementing best practices for PySpark ETL jobs and applications.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Jupyter magics and kernels for working with remote Spark clusters

🎼 Docker compose files for various kafka stacks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Apache Spark Connector for Azure Cosmos DB

🐍 Quick reference guide to common patterns & functions in PySpark.

HandySpark - bringing pandas-like capabilities to Spark dataframes

Updated repository

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

State of the Art Natural Language Processing

Apache Spark (PySpark) Practice on Real Data

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A simple Spark TDD example

Training models with Apache Spark, PySpark for Titanic Kaggle competition

Some class materials for a data processing course using PySpark

🌐 Interactive Workshop on GeoAnalysis using PySpark

A library that provides useful extensions to Apache Spark and PySpark.

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Fundamentals of Spark with Python (using PySpark), code examples

Relation Extraction using Deep learning(CNN)

LearningApacheSpark

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Word2Vec models with Twitter data using Spark. Blog:

A Scala kernel for Jupyter

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Apache (Py)Spark type annotations (stub files).

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Two-day workshop that covers how to use R to interact databases and Spark

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Spark SQL index for Parquet tables

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Elassandra = Elasticsearch + Apache Cassandra

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

A distributed data processing framework in Haskell.

spark summit 2017 SanFrancisco

🔧 Use dplyr to analyze Big Data 🐘

Spark on Kubernetes infrastructure Helm charts repo

extremely distributed machine learning

PySpark Code for Hands-on Learners

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

Udacity Data Engineering Nano Degree (DEND)

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Run spark calculations from Ammonite

Spark Streaming监控平台，支持任务部署与告警、自启动

A pandas-like deferred expression system, with first-class SQL support

Data science and Big Data with Python

Machine Learning Platform and Recommendation Engine built on Kubernetes