529 Open source projects that are alternatives of or similar to Kotlin Spark Api

An encrypted data analytics platform

大数据分析可视化实践

Distributed t-SNE via Apache Spark

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

State of the Art Natural Language Processing

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、Kafka、jpa、redies、oauth2、swagger、jsp、docker、spring-batch、异常处理、日志输出、多模块开发、多环境打包、缓存cache、爬虫、jwt、GraphQL、dubbo、zookeeper和Async等等📌

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

Profile and monitor your ML data pipeline end-to-end

A Cloud Native Batch System (Project under CNCF)

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Unified SQL Analytics Engine Based on SparkSQL

There are pieces of scala code that explain Scala syntax and related things - like what you can do with all this

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Boiler plate framework to use Spark and ZIO together.

Apache Avro is a data serialization system.

Apache Spark and Apache Kafka integration example

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Kinesis Connector for Structured Streaming

Pandas and Spark DataFrame comparison for humans

A pandas-like deferred expression system, with first-class SQL support

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Spark RDD with Lucene's query and entity linkage capabilities

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Write your Spark data to Kafka seamlessly

Spark Structured Streaming / Kafka / Cassandra / Elastic

An open-source toolkit for large-scale genomic analysis

汇总java生态圈常用技术框架、开源中间件，系统架构、数据库、大公司架构案例、常用三方类库、项目管理、线上问题排查、个人成长、思考等知识

extremely distributed machine learning

liteflow是一个基于任务版本来实现的分布式任务流调度系统

Fast, Scientific and Numerical Computing for the JVM (NDArrays)

Data science and Big Data with Python

Distributed Big Data Orchestration Service

Content for architecting a data science platform for products using Luigi, Spark & Flask.

A Spark SQL extension which provides SQL Standard Authorization for Apache Spark

An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Geospatial Raster support for Spark DataFrames

Distributed Deep learning with Keras & Spark

Production Ready Data Integration Product, documentation：

Isolation Forest on Spark

HandySpark - bringing pandas-like capabilities to Spark dataframes

🐳 big data study

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

Two-day workshop that covers how to use R to interact databases and Spark

A repository to keep track of all the code that I end up writing for my blog posts.

技术书籍等

A Clojure dataframe library that runs on Spark

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Spark SQL index for Parquet tables

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

A distributed data processing framework in Haskell.

A RPC framework leveraging Spark RPC module

GeoTrellis for PySpark

LearningApacheSpark