1055 Open source projects that are alternatives of or similar to pyspark-algorithms

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Fundamentals of Spark with Python (using PySpark), code examples

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

A Clojure dataframe library that runs on Spark

t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

Collection of Databricks and Jupyter Notebooks

SANSA Query Layer

The Distributed Computing library for python implemented using PyCOMPSs programming model for HPC.

Apache Arrow DataFusion SQL Query Engine

Data validation library for PySpark 3.0.0

PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster

Java 程序员进阶学习的思维导图

Structural Bioinformatics Training Workshop & Hackathon 2018

Pyspark in Google Colab: A simple machine learning (Linear Regression) model

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

🍉基于Hadoop和HBase的大规模海量数据去重

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Simple and Distributed Machine Learning

Distributed least squares approximation (dlsa) implemented with Apache Spark

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Open-source distributed computation and storage platform

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Apache IoTDB

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

[NOT MAINTAINED] Predicting Bit coin price using Time series analysis and sentiment analysis of tweets on bitcoin

大数据入门指南 ⭐

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Big Data for Data Engineers Coursera Specialization from Yandex

C# and F# language binding and extensions to Apache Spark

Fast and easy parallel mapreduce on HPC clusters

Simple and Distributed Machine Learning

Big Data Processing Framework - Unified Data API or SQL on Any Storage

MapReduce, Spark, Java, and Scala for Data Algorithms Book

A distributed block-based data storage and compute engine

Bare bone examples of machine learning in TensorFlow

An advanced distributed task flow management on top of Celery

Materials for "Machine Learning on Big Data" course

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Thrill - An EXPERIMENTAL Algorithmic Distributed Big Data Batch Processing Framework in C++

A simplified, lightweight ETL Framework based on Apache Spark

Best Practices and Style Guides in BEEVA

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Asakusa Framework

Koalas: pandas API on Apache Spark

High-scalability analytics database built on immutable merkle-trees

Real-world Spark pipelines examples

cdp数据平台，帮助企业充分了解客户，实现千人千面的精准营销。

A framework called "pinspider" on Apache mesos, to get basic user information from a pinterest page of a user.

DynamoDB access and management for one table designs with NodeJS

elearning linux/mac/db/cache/server/tools/人工智能

(Latest semester at https://github.com/kmader/Quantitative-Big-Imaging-2019) The material for the Quantitative Big Imaging course at ETHZ for the Spring Semester 2018

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

The metrics layer for your data. Join us at https://metriql.com/slack

An R package for large scale estimation with stochastic gradient descent

Web application framework for XSLT and XQuery developers

Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.