418 Open source projects that are alternatives of or similar to spark_learning

Avro SerDe for Apache Spark structured APIs.

Sparkling Water provides H2O functionality inside Spark cluster

Some class materials for a data processing course using PySpark

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Jupyter kernel for scala and spark

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

A Flexible and Powerful Parameter Server for large-scale machine learning

A large-scale entity and relation database supporting aggregation of properties

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

hadoop各组件使用，持续更新

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Expressive types for Spark.

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

电商用户行为分析大数据平台

Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.

A cohesive & pragmatic framework of FP centric Scala libraries

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Alluxio, data orchestration for analytics and machine learning in the cloud

Spark Shuffle Optimization with RDMA+AEP

Essential Spark extensions and helper methods ✨😲

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

▁▂▄▆▇█▇▆▄▂▁

An open source framework for building data analytic applications.

Boiler plate framework to use Spark and ZIO together.

Data validation and organization of metadata for data frames and database tables

Open-source distribute workflow schedule tools, also support streaming task.

Cross-platform real-time collaboration client optimized for business and organizations.

Apache Spark and Apache Kafka integration example

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Ruby wrapper for Apache Spark

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Kinesis Connector for Structured Streaming

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL

A library that provides useful extensions to Apache Spark and PySpark.

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

📊 Cube — Open-Source Analytics API for Building Data Apps

Scala examples for learning to use Spark

A Spark plugin for reading Excel files via Apache POI

Haskell on Apache Spark.

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

Resources for Spark AR

Monitor Apache Spark from Jupyter Notebook

Code examples on Apache Spark using python

extremely distributed machine learning

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

Minikube for big data with Scala and Spark

🤖⚡ | The most POWERFUL multipurpose chat/meme bot that will boost the activity in your server.

Collection of different demo applications using Apache Spark

spark on kubernetes

Albis: High-Performance File Format for Big Data Systems