419 Open source projects that are alternatives of or similar to spark-data-sources

Avro SerDe for Apache Spark structured APIs.

Sparkling Water provides H2O functionality inside Spark cluster

❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Jupyter kernel for scala and spark

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

A Flexible and Powerful Parameter Server for large-scale machine learning

A large-scale entity and relation database supporting aggregation of properties

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

A Robinhood style COVID-19 🦠 Android tracking app for the US. Open source and built with Kotlin.

hadoop各组件使用，持续更新

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

Expressive types for Spark.

☁️ Cloud-scale telemetry ingestion from any stream of data with Azure Event Hubs

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

电商用户行为分析大数据平台

My presentation at ODSC India 2018 about Deep Learning with Apache Spark

A cohesive & pragmatic framework of FP centric Scala libraries

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

Alluxio, data orchestration for analytics and machine learning in the cloud

基于Spark2.2新闻网大数据实时系统项目

Essential Spark extensions and helper methods ✨😲

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Training of Locally Optimized Product Quantization (LOPQ) models for approximate nearest neighbor search of high dimensional data in Python and Spark.

▁▂▄▆▇█▇▆▄▂▁

An open source framework for building data analytic applications.

Boiler plate framework to use Spark and ZIO together.

Data validation and organization of metadata for data frames and database tables

An extensive non-reactive Typescript framework that eases the development experience in Spark AR

Cross-platform real-time collaboration client optimized for business and organizations.

Apache Spark and Apache Kafka integration example

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Ruby wrapper for Apache Spark

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Kinesis Connector for Structured Streaming

Web UI for Trino, Presto, Hive, Elasticsearch, SparkSQL

A complete (distributed) BigData stack, running in containers

Moonbox is a DVtaaS (Data Virtualization as a Service) Platform

📊 Cube — Open-Source Analytics API for Building Data Apps

Scala examples for learning to use Spark

A Spark plugin for reading Excel files via Apache POI

Haskell on Apache Spark.

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

Code examples for my blog posts

Monitor Apache Spark from Jupyter Notebook

Code examples on Apache Spark using python

⛈️ Rumble 1.11.0 "Banyan Tree"🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more

extremely distributed machine learning

Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Autoscaling for Google Cloud Dataproc