651 Open source projects that are alternatives of or similar to Big Whale

个人学习知识库涉及到数据仓库建模、实时计算、大数据、Java、算法等。

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Fast Data Cluster (Apache Cassandra, Kafka, Spark, Flink, YARN and HDFS with Vagrant and VirtualBox)

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

深圳地铁大数据客流分析系统🚇🚄🌟

Production Ready Data Integration Product, documentation：

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Iceberg is a table format for large, slow-moving tabular data

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

一个大数据架构师应该掌握的技能

商品大数据实时推荐系统。前端：Vue + TypeScript + ElementUI，后端 Spring + Spark

A Scala feature transformation library for data science and machine learning

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

电商用户行为分析大数据平台

50+ DockerHub public images for Docker & Kubernetes - Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak, TeamCity and DevOps tools built on the major Linux distros: Alpine, CentOS, Debian, Fedora, Ubuntu

大数据生态解决方案数据平台：基于大数据、数据平台、微服务、机器学习、商城、自动化运维、DevOps、容器部署平台、数据平台采集、数据平台存储、数据平台计算、数据平台开发、数据平台应用搭建的大数据解决方案。

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

Big Data Ecosystem Docker

Fundamentals of Spark with Python (using PySpark), code examples

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

Data Lineage Tracking And Visualization Solution

Create clusters of VMs on the cloud and configure them with Ansible.

Building Large-Scale AI Applications for Distributed Big Data

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Generic Data Ingestion & Dispersal Library for Hadoop

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

When Apache Pulsar meets Apache Spark

A Spark cluster setup running on Docker containers

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

Alluxio, data orchestration for analytics and machine learning in the cloud

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

A large-scale entity and relation database supporting aggregation of properties

A complete (distributed) BigData stack, running in containers

Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.

An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR

🚢 Docker image for Apache Spark

A big data platform for analyzing web access logs

Code and presentation for Strata Model Serving tutorial

零基础学习spark，大数据学习

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Next generation tool for decentralized exchange and transformation of semi-structured data

MapReduce, Spark, Java, and Scala for Data Algorithms Book

大数据入门指南 ⭐

Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&Flink 等

基于Spark2.2新闻网大数据实时系统项目

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

Cookbook to install Hadoop 2.0+ using Chef

extremely distributed machine learning