529 Open source projects that are alternatives of or similar to Kotlin Spark Api

大数据博客、笔试题、教程、项目、面经的整理

Code Library for My Blog

A daily digest of the articles or videos I've found interesting, that I want to share with you.

C# and F# language binding and extensions to Apache Spark

🚚 Agile Data Preparation Workflows made easy with dask, cudf, dask_cudf and pyspark

High Performance HTTP Sidecar Load Balancer

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Source code for James Lee's Aparch Spark with Java course

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

A simple spark standalone cluster for your testing environment purposses

Some class materials for a data processing course using PySpark

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

Python clone of Spark, a MapReduce alike framework in Python

Java开发者或者大数据开发者面试知识点整理

一个大数据架构师应该掌握的技能

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等

大数据入门指南 ⭐

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Data Lineage Tracking And Visualization Solution

type-class based data cleansing library for Apache Spark SQL

简单的可视化湖州通话数据 假设数据量很大，没法用浏览器直接绘制热力图，把绘制热力图这一步骤放到线下计算分析。使用Apache Spark并行计算数据之后，再使用Apache Spark绘制热力图，然后用leafletjs加载OpenStreetMap图层和热力图图层，以达到良好的交互效果。现在使用Apache Spark实现绘制，可能是Apache Spark不擅长这方面的计算或者是我没有设计好算法，并行计算的速度比不上单机计算。Apache Spark绘制热力图和计算代码在这 https://github.com/yuanzhaokang/ParallelizeHeatmap.git .

Big Data for Data Engineers Coursera Specialization from Yandex

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Julia binding for Apache Spark

大数据分析可视化实践

Live-coding the cluster!

Distributed t-SNE via Apache Spark

State of the Art Natural Language Processing

Spark、Flink等离线任务的调度以及实时任务的监控

spark ml 算法原理剖析以及具体的源码实现分析

A minimal benchmark for scalability, speed and accuracy of commonly used open source implementations (R packages, Python scikit-learn, H2O, xgboost, Spark MLlib etc.) of the top machine learning algorithms for binary classification (random forests, gradient boosted trees, deep neural networks etc.).

Profile and monitor your ML data pipeline end-to-end

Upserts, Deletes And Incremental Processing on Big Data.

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure

Unified SQL Analytics Engine Based on SparkSQL

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

Big Data Ecosystem Docker

Fundamentals of Spark with Python (using PySpark), code examples

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

Linkis helps easily connect to various back-end computation/storage engines(Spark, Python, TiDB...), exposes various interfaces(REST, JDBC, Java ...), with multi-tenancy, high performance, and resource control.

Process Common Crawl data with Python and Spark

Apache Avro is a data serialization system.

TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning

Simple and beautiful card component with an elegant spark line, for VueJS.

Updated repository

Pandas and Spark DataFrame comparison for humans

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

DataStax Spark Cassandra Connector

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.