懒松鼠Flink-Boot 脚手架让Flink全面拥抱Spring生态体系，使得开发者可以以Java WEB开发模式开发出分布式运行的流处理程序，懒松鼠让跨界变得更加简单。懒松鼠旨在让开发者以更底上手成本（不需要理解分布式计算的理论知识和Flink框架的细节）便可以快速编写业务代码实现。为了进一步提升开发者使用懒松鼠脚手架开发大型项目的敏捷的度，该脚手架默认集成Spring框架进行Bean管理，同时将微服务以及WEB开发领域中经常用到的框架集成进来，进一步提升开发速度。比如集成Mybatis ORM框架，Hibernate Validator校验框架,Spring Retry重试框架等，具体见下面的脚手架特性。

✭ 209

java spring-boot mybatis bigdata flink

Shifu

An end-to-end machine learning and data mining framework on Hadoop

✭ 207

java machine-learning neural-network pipeline hadoop bigdata random-forest

Javaorbigdata Interview

Java开发者或者大数据开发者面试知识点整理

✭ 203

java spark interview hadoop bigdata storm

Awesome Learning

实践源码库：https://github.com/jast90/bigdata 。微信搜索Jast关注公众号，获取最新技术分享😯。

✭ 197

java awesome book hadoop bigdata

Kotlin Spark Api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

✭ 183

kotlin scala spark bigdata

Flinkx

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

✭ 2,651

java bigdata flink sql data-transfer data-synchronization streaming-computation data-sync

Bigdata practice

大数据分析可视化实践

✭ 166

python nginx kafka stream bigdata hive

Java Notes

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

✭ 160

java spring algorithm network bigdata

Nmflibrary

MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1

✭ 153

matlab data-analysis machine-learning-algorithms bigdata matrix-factorization optimization-algorithms gradient-descent online-learning

Javainterview

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

✭ 154

java architecture books bigdata datastructures

Hudi

Upserts, Deletes And Incremental Processing on Big Data.

✭ 2,586

java scala shell ANTLR Dockerfile Mustache bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink

Athenacli

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

✭ 151

python cli command-line syntax-highlighting bigdata autocompletion aws-cli

Avro

Apache Avro is a data serialization system.

✭ 2,005

python java c C#C++rust dotnet bigdata avro

Poli

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

✭ 1,850

java reactjs spring-boot sql dashboard data-visualization bigdata jdbc reporting business-intelligence sql-editor

Big Data Study

🐳 big data study

✭ 141

awesome big-data bigdata study

Azure Event Hubs Spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

✭ 140

scala kafka azure spark streaming real-time stream microsoft apache bigdata apache-spark spark-streaming connector

Ecommercerecommendsystem

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

✭ 139

java typescript vue spark ecommerce bigdata flink

Twitwork

Monitor twitter stream

✭ 133

javascript nodejs twitter osint bigdata dataviz twitter-api

Tipdm

TipDM建模平台，开源的数据挖掘工具。

✭ 130

javascript machine-learning tensorflow workflow data-analysis data-mining bigdata

Spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Fpart

Sort files and pack them into partitions

✭ 127

c data parallel bigdata migration rsync

Volcano

A Cloud Native Batch System (Project under CNCF)

✭ 2,114

go shell machine-learning kubernetes bigdata hpc gene batch-systems

Hadoopcryptoledger

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

✭ 126

java blockchain ethereum bitcoin spark hadoop bigdata flink hive

Liteflow

liteflow是一个基于任务版本来实现的分布式任务流调度系统

✭ 112

java workflow bigdata scheduling dag

Genie

Distributed Big Data Orchestration Service

✭ 1,544

java groovy CSS javascript PLpgSQL shell spring-boot cloud microservices microservice distributed-systems big-data configuration bigdata configuration-management orchestration netflixoss netflix-oss

Lambda Arch

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

✭ 111

java spark bigdata

Books

技术书籍等

✭ 110

java shell books bigdata

Flinkstreamsql

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

✭ 1,682

java sql stream bigdata flink

Spark R Notebooks

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

✭ 109

r jupyter-notebook data-science jupyter data-analysis big-data notebook bigdata exploratory-data-analysis

Daudit

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

✭ 108

python security redis mongodb bigdata auditing

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

✭ 10,478

awesome awesome-list database data-science data-visualization data bigdata stream-processing distributed-database data-analytics streaming-data data-stream series-database data-warehouse visualize-data

Tennis Crystal Ball

Ultimate Tennis Statistics and Tennis Crystal Ball - Tennis Big Data Analysis and Prediction

✭ 107

java machine-learning database data-science statistics data-analysis big-data bigdata prediction sports forecast

Griddb

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

✭ 1,587

C++java c python Makefile shell database sql iot time-series fast nosql timeseries bigdata newsql griddb

Flink Notes

flink学习笔记

✭ 106

scala bigdata flink

Sparktutorial

Source code for James Lee's Aparch Spark with Java course

✭ 105

java spark bigdata

Splash

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

✭ 105

java scala spark storage bigdata apache-spark

Bigdata Notebook

✭ 100

scala machine-learning kafka spark streaming hadoop bigdata flink storm

Bigdata Notes

大数据入门指南 ⭐

✭ 10,991

java scala kafka spark big-data yarn hadoop phoenix zookeeper bigdata hive hbase hdfs mapreduce storm flume azkaban sqoop

Spark Py Notebooks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

✭ 1,338

python jupyter-notebook machine-learning data-science spark data-analysis big-data notebook bigdata ipython pyspark ipython-notebook

Covid19 Market Waiting Times

A project to help people stand in line at the market as little as possible

✭ 95

javascript bigdata

Mnemonic

Apache Mnemonic - A non-volatile hybrid memory storage oriented library

✭ 91

java apache memory bigdata

Biglasso

biglasso: Extending Lasso Model Fitting to Big Data in R

✭ 87

r bigdata parallel-computing

Ignite Book Code Samples

All code samples, scripts and more in-depth examples for the book high performance in-memory computing with Apache Ignite. Please use the repository "the-apache-ignite-book" for Ignite version 2.6 or above.

✭ 86

java cache high-performance nosql bigdata in-memory

Bigdata File Viewer

A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.

✭ 86

java bigdata avro hdfs parquet

Mlsql

The Programming Language Designed For Big Data and AI

✭ 1,262

javascript machine-learning bigdata

Athena Cli

Presto-like CLI tool for AWS Athena

✭ 85

python aws command-line-tool bigdata aws-cli

Hudi Resources

汇总Apache Hudi相关资料