713 Open source projects that are alternatives of or similar to Waterdrop

seatunnel plugin developing examples.

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

深圳地铁大数据客流分析系统🚇🚄🌟

Spark、Flink等离线任务的调度以及实时任务的监控

零基础学习spark，大数据学习

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

A simplified, lightweight ETL Framework based on Apache Spark

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Iceberg is a table format for large, slow-moving tabular data

Scala examples for learning to use Spark

一个大数据架构师应该掌握的技能

A Scala feature transformation library for data science and machine learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

大数据入门指南 ⭐

An open source framework for building data analytic applications.

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

Cookbook to install Hadoop 2.0+ using Chef

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Streaming System 相关的论文读物

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

电商用户行为分析大数据平台

Stream computing platform for bigdata

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Building Large-Scale AI Applications for Distributed Big Data

酷玩 Spark: Spark 源代码解析、Spark 类库等

Generic Data Ingestion & Dispersal Library for Hadoop

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Data Lineage Tracking And Visualization Solution

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Real Time Analytics and Data Pipelines based on Spark Streaming

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Custom state store providers for Apache Spark

Alluxio, data orchestration for analytics and machine learning in the cloud

Create clusters of VMs on the cloud and configure them with Ansible.

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

C# and F# language binding and extensions to Apache Spark

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

A big data platform for analyzing web access logs

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

scala、spark使用过程中，各种测试用例以及相关资料整理

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

MapReduce, Spark, Java, and Scala for Data Algorithms Book

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

A Spark cluster setup running on Docker containers

🚢 Docker image for Apache Spark

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

Code and presentation for Strata Model Serving tutorial

Code examples on Apache Spark using python

Next generation tool for decentralized exchange and transformation of semi-structured data