294 Open source projects that are alternatives of or similar to orion

Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

Multiple node cluster on Docker for self development.

Fundamentals of Spark with Python (using PySpark), code examples

Road to Machine Learning

Kafka Connect FileSystem Connector

Mirror of Apache Chukwa

Apache Parquet implementation in Rust

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Apache Calcite

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

大型分布式系统实时监控平台

Ephemeral Hadoop clusters using Google Compute Platform

Griffon Data Science Virtual Machine

A Java NIO file system provider for HDFS

Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

Extended datasource support for Spark/Hadoop on Aliyun E-MapReduce.

An implementation of locality sensitive hashing with Hadoop

An end-to-end machine learning and data mining framework on Hadoop

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

https://www.researchgate.net/profile/Rajah_Iyer

Super-fast Spark RDD for Titan Graph Database on HBase

MapReduce, Spark, Java, and Scala for Data Algorithms Book

Source code and dataset for paper "CBMR: An optimized MapReduce for item‐based collaborative filtering recommendation algorithm with empirical analysis"

bigdatatutorial

实践源码库：https://github.com/jast90/bigdata 。 微信搜索Jast关注公众号，获取最新技术分享😯。

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

按知识领域整理面试题，包括C++、Java、Hadoop、机器学习等

推荐项目（实时推荐和离线推荐）

An easy way to deploy your Akka services to a distributed environment.

Hadoop Crypto Ledger - Analyzing CryptoLedgers, such as Bitcoin Blockchain, on Big Data platforms, such as Hadoop/Spark/Flink/Hive

Real-time analysis and visualization with Storm-AMQ-Camel-Websockets-Highcharts integration.

Install hadoop cluster with ansible

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

MySQL to NoSQL real time dataflow

Apache Nutch is an extensible and scalable web crawler

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

A scalable Apache Hadoop-based implementation of the Pooled Time Series video similarity algorithm based on M. Ryoo et al paper CVPR 2015.

Computes and visualizes the sentiment analysis of tweets of US States in real-time using Storm.

A pandas-like deferred expression system, with first-class SQL support

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

Docker image for main Apache Hadoop components (Yarn/Hdfs)

Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version

DataX is an open source universal ETL tool that support Cassandra, ClickHouse, DBF, Hive, InfluxDB, Kudu, MySQL, Oracle, Presto(Trino), PostgreSQL, SQL Server

Docker containers for Hadoop.

Asakusa Framework

ArcGIS GeoEvent Server sample Hadoop connector for storing GeoEvents in HDFS.

winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

Support TensorFlow on YARN

电商用户行为分析大数据平台

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…

extremely distributed machine learning

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

Alluxio, data orchestration for analytics and machine learning in the cloud

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.