GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → amarmesic → ambari-hdp-docker

amarmesic / ambari-hdp-docker

Licence: other
Dockerfiles and Docker Compose for HDP 2.6 with Blueprints

Programming Languages

shell
77523 projects

Labels

dockerdockerfilehadoopblueprintambarihdpambari-blueprints

Projects that are alternatives of or similar to ambari-hdp-docker

hdp-ansible
Automated (Ansible) installation of HDP via Ambari Blueprint
Stars: ✭ 17 (-26.09%)
Mutual labels:  ambari, hdp
BigInsights-on-Apache-Hadoop
Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix
Stars: ✭ 21 (-8.7%)
Mutual labels:  hadoop, ambari
jumbo
🐘 A local Hadoop cluster bootstrapper using Vagrant, Ansible, and Ambari.
Stars: ✭ 17 (-26.09%)
Mutual labels:  hadoop, ambari
Deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learni…
Stars: ✭ 12,277 (+53278.26%)
Mutual labels:  hadoop
Hive Jdbc Uber Jar
Hive JDBC "uber" or "standalone" jar based on the latest Apache Hive version
Stars: ✭ 188 (+717.39%)
Mutual labels:  hadoop
Sparkrdma
RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark
Stars: ✭ 215 (+834.78%)
Mutual labels:  hadoop
phoenix
Apache Phoenix / Hbase Spring Boot Microservices
Stars: ✭ 23 (+0%)
Mutual labels:  hadoop
Bigdata docker
Big Data Ecosystem Docker
Stars: ✭ 161 (+600%)
Mutual labels:  hadoop
Devops Bash Tools
550+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Kafka, Docker, APIs, Hadoop, SQL, PostgreSQL, MySQL, Hive, Impala, Travis CI, Jenkins, Concourse, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, .tmux.conf, .psqlrc ...
Stars: ✭ 226 (+882.61%)
Mutual labels:  hadoop
Facebook Hive Udfs
Facebook's Hive UDFs
Stars: ✭ 213 (+826.09%)
Mutual labels:  hadoop
Shifu
An end-to-end machine learning and data mining framework on Hadoop
Stars: ✭ 207 (+800%)
Mutual labels:  hadoop
Nutch
Apache Nutch is an extensible and scalable web crawler
Stars: ✭ 2,277 (+9800%)
Mutual labels:  hadoop
Hadoop Connectors
Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
Stars: ✭ 218 (+847.83%)
Mutual labels:  hadoop
Bigdata Playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Stars: ✭ 177 (+669.57%)
Mutual labels:  hadoop
docker-hadoop
Docker image for main Apache Hadoop components (Yarn/Hdfs)
Stars: ✭ 59 (+156.52%)
Mutual labels:  hadoop
Big Whale
Spark、Flink等离线任务的调度以及实时任务的监控
Stars: ✭ 163 (+608.7%)
Mutual labels:  hadoop
Hadoop Attack Library
A collection of pentest tools and resources targeting Hadoop environments
Stars: ✭ 228 (+891.3%)
Mutual labels:  hadoop
Javaorbigdata Interview
Java开发者或者大数据开发者面试知识点整理
Stars: ✭ 203 (+782.61%)
Mutual labels:  hadoop
Recommendsys
推荐项目（实时推荐和离线推荐）
Stars: ✭ 198 (+760.87%)
Mutual labels:  hadoop
Calcite
Apache Calcite
Stars: ✭ 2,816 (+12143.48%)
Mutual labels:  hadoop
View All Similar Projects ➔

Dockerfiles and Docker Compose for setting up an multi-node HDP Cluster with Ambari 2.6. Docker images are based on Ubuntu 16.04. Optionally, you can boostrap HDP installation with Ambari blueprints.

Requires Docker > v1.13 and Docker Compose > v1.17

Docker cluster layout

HDP on Docker Architecture

Build images

  1. Build HDP Base Image
cd hdp-base
docker build -t amarmesic/hdp-base:latest .
  1. Build Ambari Agent Image
cd hdp-ambari-agent
docker build -t amarmesic/hdp-ambari-agent:latest .
  1. Build Ambari Server Image
cd hdp-ambari-server
docker build -t amarmesic/hdp-ambari-server:latest .

Run Docker Compose

To start containers, use Docker Compose

docker-compose up -d

It will take about a minute until Ambari is available on port 8080

Optional: Install HDP 2.6 using Ambari Blueprints

Change the working directory to blueprints

  1. Register blueprint
curl -H "X-Requested-By: ambari" -X POST -u admin:admin http://<AMBARIHOST>:8080/api/v1/blueprints/<CLUSTERNAME> -d @blueprint.json
  1. Start deployment

Below comand will start cluster deployment

curl -H "X-Requested-By: ambari" -X POST -u admin:admin http://<AMBARHOST>:8080/api/v1/clusters/<CLUSTERNAME> -d @hosts.json

Passwords

Admin/Database password for all services is hadoop

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].