651 Open source projects that are alternatives of or similar to ibis

深圳地铁大数据客流分析系统🚇🚄🌟

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

电商用户行为分析大数据平台

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Alluxio, data orchestration for analytics and machine learning in the cloud

定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)

💎🔥大数据学习笔记

The GIS Tools for Hadoop are a collection of GIS tools for spatial analysis of big data.

At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

编程电子书，电子书，编程书籍，包括C，C#，Docker，Elasticsearch，Git，Hadoop，HeadFirst，Java，Javascript，jvm，Kafka，Linux，Maven，MongoDB，MyBatis，MySQL，Netty，Nginx，Python，RabbitMQ，Redis，Scala，Solr，Spark，Spring，SpringBoot，SpringCloud，TCPIP，Tomcat，Zookeeper，人工智能，大数据类，并发编程，数据库类，数据挖掘，新面试题，架构设计，算法系列，计算机类，设计模式，软件测试，重构优化，等更多分类

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

Generic Data Ingestion & Dispersal Library for Hadoop

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Function, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Kafka Connect HDFS connector

一个大数据架构师应该掌握的技能

Iceberg is a table format for large, slow-moving tabular data

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Apache Ignite

Apache Hive

WeDataSphere is a financial level one-stop open-source suitcase for big data platforms. Currently the source code of Scriptis and Linkis has already been released to the open-source community. WeDataSphere, Big Data Made Easy!

Ytk-learn is a distributed machine learning library which implements most of popular machine learning algorithms(GBDT, GBRT, Mixture Logistic Regression, Gradient Boosting Soft Tree, Factorization Machines, Field-aware Factorization Machines, Logistic Regression, Softmax).

Scalable, redundant, and distributed object store for Apache Hadoop

Gathers scalable tensorflow and infrastructure deployment

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster. See https://github.com/Cascading/cascading for the release repository.

Apache Tez

Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White

Data Lineage Tracking And Visualization Solution

A tool for provisioning and managing Apache Hadoop clusters in the cloud. Cloudbreak, as part of the Hortonworks Data Platform, makes it easy to provision, configure and elastically grow HDP clusters on cloud infrastructure. Cloudbreak can be used to provision Hadoop across cloud infrastructure providers including AWS, Azure, GCP and OpenStack.

Create clusters of VMs on the cloud and configure them with Ansible.

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Lightweight, simple structured NoSQL database for Android

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

hadoop-mini-clusters provides an easy way to test Hadoop projects directly in your IDE

Apache Drill is a distributed MPP query layer for self describing data

Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from your browser

phData Pulse application log aggregation and monitoring

Docker build project to setup a lightweight hadoop cluster containing hadoop, pig, zookeeper, hbase, phoenix, storm, kafka, kafka manager

Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

Temporal service

Cadence is a distributed, scalable, durable, and highly available orchestration engine to execute asynchronous long-running business logic in a scalable and resilient way.

Budibase is an open-source low-code platform for creating internal apps in minutes. Supports PostgreSQL, MySQL, MSSQL, MongoDB, Rest API, Docker, K8s 🚀

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.