201 Open source projects that are alternatives of or similar to pyspark-asyncactions

Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/

The Proxima platform.

Machine Learning Course @ Santa Clara University

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Map Reduce Implementation of Connected Component on Apache Spark

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

An Apache Spark standalone application using the Spark API in Scala. The application uses Simple Build Tool(SBT) for building the project.

Astronomy Broker based on Apache Spark

This repo contains commands that data engineers use in day to day work.

This is a place to put s2i images and utilities for spark application builders for openshift

Use the TPC-DS benchmark to test Spark SQL performance

Extensible streaming ingestion pipeline on top of Apache Spark

Griffon Data Science Virtual Machine

A connector for Apache Spark to access Exasol

Detect common phrases in large amounts of text using a data-driven approach. Size of discovered phrases can be arbitrary. Can be used in languages other than English

No description or website provided.

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Spark cloud integration: tests, cloud committers and more

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

关注AI模型上线、模型部署

Collection of Databricks and Jupyter Notebooks

Project for James' Apache Spark with Scala course

Apache Pulsar Adapters

Automatic feature engineering using Generative Adversarial Networks using Deeplearning4j and Apache Spark.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

No description or website provided.

Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray

Bulletproof Apache Spark jobs with fast root cause analysis of failures.

Simple demonstration of how to build a complex real time machine learning visualization tool.

Profile and monitor your ML data pipeline end-to-end

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

Spark in Action, 2nd edition - chapter 1 - Introduction

A recommender system for discovering GitHub repos, built with Apache Spark

Spark in Action, 2nd edition - chapter 7 - Ingestion from files

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

Scalable Data Science, course sets in big data Using Apache Spark over databricks and their mathematical, statistical and computational foundations using SageMath.

Apache Spark on AWS Lambda

The Internals of Spark SQL

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Apache Spark docker image

Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time

Just a boilerplate for PySpark and Flask

A framework for writing Spark 2.x applications in a pretty way

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark

PySpark Cheatsheet

Open Source Contributor Index

Custom state store providers for Apache Spark

Open source platform for the machine learning lifecycle

A curated list of Pulsar tools, integrations and resources.

A collection of tutorials on Hadoop, MapReduce, Spark, Docker

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2

When Apache Pulsar meets Apache Spark

PySpark + Scikit-learn = Sparkit-learn

Counting Tweets Per User in Real-Time

bring sf to spark in production