194 Open source projects that are alternatives of or similar to 2019_egu_workshop_jupyter_notebooks

Functions and Python scripts to ingest ERA5 data into Google Earth Engine

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

最全的Java技术知识点，以及Java源码分析。为开源贡献自己的一份力。

Monitor twitter stream

Based on Apache Flink. support data synchronization/integration and streaming SQL computation.

Examples for gauravbytes.com

An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.

java学习和项目中一些典型的应用场景样例代码

An open-source big data platform designed and optimized for the Internet of Things (IoT).

A Cloud Native Batch System (Project under CNCF)

Applying Lambda Architecture with Spark, Kafka, and Cassandra.

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

☕️ Java 基础 👫 面向对象思想✏️ 算法 📝 操作系统 ☁️ 网络 💾 数据库 🙊 Spring 💡 系统架构🐘大数据

Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.

AthenaCLI is a CLI tool for AWS Athena service that can do auto-completion and syntax highlighting.

bigdatatutorial

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

编程路上加油站！------【持续更新中...欢迎star,欢迎常回来看看......】【内容：编程/学习/阅读资源，开源项目,面试题,网站,书,博客,教程等等】

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Simple-IT-English: smart wordbook from community for community

liteflow是一个基于任务版本来实现的分布式任务流调度系统

OUTDATED, use https://github.com/OSGeo/grass/ ! Continuous integration for GRASS GIS

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法

🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!

Java开发者或者大数据开发者面试知识点整理

AeroBulk is a modern-FORTRAN-based package/library that gathers state-of-the-art aerodynamic bulk formulae algorithms used to compute turbulent air-sea fluxes of momentum, heat and freshwater.

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

个人笔记集中营，快糙猛的形式记录技术性Notes .. 📚☕️⌨️🎧

大数据分析可视化实践

🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

MATLAB library for non-negative matrix factorization (NMF): Version 1.8.1

TiDB connectors for Flink/Hive/Presto

Upserts, Deletes And Incremental Processing on Big Data.

An open-source, cloud-ready web application for simplified deployment of big data workflows.

Apache Avro is a data serialization system.

一道面试题的思考 - 6000万数据包和300万数据包在50M内存使用环境中求交集

🐳 big data study

A daily digest of the articles or videos I've found interesting, that I want to share with you.

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

Download and Visualize Essential Global Heating Data in R

TipDM建模平台，开源的数据挖掘工具。

Python clone of Spark, a MapReduce alike framework in Python

Sort files and pack them into partitions

Full featured TypeScript Twitter archive reader and browser

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

A collection of pentest tools and resources targeting Hadoop environments

Distributed Big Data Orchestration Service

A robust web archive analytics toolkit

技术书籍等

Asynchronous HBase client for NodeJs using REST

R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks

Hayabusa: Simple and Fast Full-Text Search Engine for Massive System Log Data

Масштабируемое машинное обучение и анализ больших данных с Apache Spark

大数据学习笔记，学习路线，技术案例整理。

C4E, a JVM friendly library written in Scala for both local and distributed (Spark) Clustering.

懒松鼠Flink-Boot 脚手架让Flink全面拥抱Spring生态体系，使得开发者可以以Java WEB开发模式开发出分布式运行的流处理程序，懒松鼠让跨界变得更加简单。懒松鼠旨在让开发者以更底上手成本（不需要理解分布式计算的理论知识和Flink框架的细节）便可以快速编写业务代码实现。为了进一步提升开发者使用懒松鼠脚手架开发大型项目的敏捷的度，该脚手架默认集成Spring框架进行Bean管理，同时将微服务以及WEB开发领域中经常用到的框架集成进来，进一步提升开发速度。比如集成Mybatis ORM框架，Hibernate Validator校验框架,Spring Retry重试框架等，具体见下面的脚手架特性。

A curated list of awesome big data frameworks, ressources and other awesomeness.

An end-to-end machine learning and data mining framework on Hadoop