9362 Open source projects that are alternatives of or similar to Spark With Python

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

RCS Intro to Databases workshop materials

A Spark cluster setup running on Docker containers

Repository for Docker Image of Apache-Superset. [Docker Image: https://hub.docker.com/r/abhioncbr/docker-superset]

Demo of PySpark and Jupyter Notebook with the Jupyter Docker Stacks

An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Big Data Processing Framework - Unified Data API or SQL on Any Storage

DataFusion has now been donated to the Apache Arrow project

DuckDB is an in-process SQL OLAP Database Management System

Apache Calcite

Support content for my blog

A large-scale entity and relation database supporting aggregation of properties

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Koalas: pandas API on Apache Spark

Real Time Analytics and Data Pipelines based on Spark Streaming

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A simple Spark TDD example

Mirror of Apache Calcite - Avatica

Simple and Distributed Machine Learning

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Apache Spark on AWS Lambda

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

OLAP and ETL of Big Data

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

MapReduce, Spark, Java, and Scala for Data Algorithms Book

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

Building Large-Scale AI Applications for Distributed Big Data

Jupyter magics and kernels for working with remote Spark clusters

MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

Design-of-experiment (DOE) generator for science, engineering, and statistics

一个大数据架构师应该掌握的技能

Distributed "massively parallel" SQL query engine

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Kyuubi is a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark

Carefully curated resource links for data science in one place

🌐 Interactive Workshop on GeoAnalysis using PySpark

Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Best Practices and Style Guides in BEEVA

C# and F# language binding and extensions to Apache Spark

Code examples on Apache Spark using python

Word2Vec models with Twitter data using Spark. Blog:

Apache Spark Website

Massively parallel, high performance analytics database that will rapidly devour all of your data.

Snowflake JDBC Driver

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

GraphJin - Build APIs in 5 minutes with GraphQL. An instant GraphQL to SQL compiler.

Model-driven REST or GraphQL backend for CRUD and more, written in Javascript, using Node.js, Express, and PostgreSQL.

A collection of code examples as well as presentations for training purposes

A framework for writing Spark 2.x applications in a pretty way

Database CRUD Application Built on Electron | MySQL, Postgres, SQLite

Spark 2.0 Python Machine Learning examples

🔥 A well-tested feature-rich modular Firebase implementation for React Native. Supports both iOS & Android platforms for all Firebase services.

Models and Pipelines for the Spark NLP library

Udacity Data Engineering Nano Degree (DEND)

A friendly and lightweight C++ database library for MySQL, PostgreSQL, SQLite and ODBC.

基于wifi抓取信息的大数据查询分析系统