458 Open source projects that are alternatives of or similar to Eat_pyspark_in_10_days

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Research on distributed system

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

A luigi powered analytics / warehouse stack

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

四川大学拓思爱诺用户session行为数据离线分析项目

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Spark SQL index for Parquet tables

Run spark calculations from Ammonite

Code and presentation for Strata Model Serving tutorial

RSparkling: Use H2O Sparkling Water from R (Spark + R + Machine Learning)

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

Elassandra = Elasticsearch + Apache Cassandra

Apache Spark examples exclusively in Java

🔧 Use dplyr to analyze Big Data 🐘

Library for MQL5 (MetaTrader) with Python, Java, Apache Spark, AWS

A pandas-like deferred expression system, with first-class SQL support

Data science and Big Data with Python

Machine Learning Platform and Recommendation Engine built on Kubernetes

When Apache Pulsar meets Apache Spark

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

PySpark Code for Hands-on Learners

extremely distributed machine learning

Code examples on Apache Spark using python

Udacity Data Engineering Nano Degree (DEND)

A Spark cluster setup running on Docker containers

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

A curated list of Pulsar tools, integrations and resources.

Models and Pipelines for the Spark NLP library

Spark Streaming监控平台，支持任务部署与告警、自启动

scala、spark使用过程中，各种测试用例以及相关资料整理

Google Authenticator support for Laravel Spark

This is a based on playframwork for submit spark app

A curated list of awesome Apache Spark packages and resources.

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

A framework for writing Spark 2.x applications in a pretty way

Natural Korean Processor for Apache Spark

Webex Bot SDK for Node.js (deprecated in favor of https://github.com/webex/webex-bot-node-framework)

The Internals of Apache Spark

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

Custom state store providers for Apache Spark

Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline

Spark examples

Source code for James Lee's Aparch Spark with Java course

Cookbook to install Hadoop 2.0+ using Chef

Official code repository for GATK versions 4 and up

Apache Spark Connector for Azure Kusto

Spark job for dependency links

Python Helper library for Jupyter Notebooks

📊 Cube — Open-Source Analytics API for Building Data Apps

Distributed Deep learning with Keras & Spark

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange