All Projects → FAU-DLM → GPU-Jupyterhub

FAU-DLM / GPU-Jupyterhub

Licence: other
Setting up a Jupyterhub Dockercontainer to spawn Jupyter Notebooks with GPU support (containing Tensorflow, Pytorch and Keras)

Programming Languages

CSS
56736 projects
python
139335 projects - #7 most used programming language
Dockerfile
14818 projects
HTML
75241 projects
shell
77523 projects

Projects that are alternatives of or similar to GPU-Jupyterhub

docker-nvidia-glx-desktop
MATE Desktop container designed for Kubernetes supporting OpenGL GLX and Vulkan for NVIDIA GPUs with WebRTC and HTML5, providing an open source remote cloud graphics or game streaming platform. Spawns its own fully isolated X Server instead of using the host X server, therefore not requiring /tmp/.X11-unix host sockets or host configuration.
Stars: ✭ 47 (+104.35%)
Mutual labels:  gpu, nvidia, nvidia-docker
Plotoptix
Data visualisation in Python based on OptiX 7.2 ray tracing framework.
Stars: ✭ 252 (+995.65%)
Mutual labels:  gpu, nvidia
Nvidia Modded Inf
Modified nVidia .inf files to run drivers on all video cards, research & telemetry free drivers
Stars: ✭ 227 (+886.96%)
Mutual labels:  gpu, nvidia
handbrake-nvenc-docker
Handbrake GUI with Web browser and VNC access. Supports NVENC encoding
Stars: ✭ 32 (+39.13%)
Mutual labels:  nvidia, nvidia-docker
Nvidia Htop
A tool for enriching the output of nvidia-smi.
Stars: ✭ 213 (+826.09%)
Mutual labels:  gpu, nvidia
Nvidia Clerk
A cross-platform go bot that tracks for availability of stock from Nvidia's store and adds a cart to your checkout.
Stars: ✭ 214 (+830.43%)
Mutual labels:  gpu, nvidia
DistributedDeepLearning
Tutorials on running distributed deep learning on Batch AI
Stars: ✭ 23 (+0%)
Mutual labels:  nvidia, nvidia-docker
Nfancurve
A small and lightweight POSIX script for using a custom fan curve in Linux for those with an Nvidia GPU.
Stars: ✭ 180 (+682.61%)
Mutual labels:  gpu, nvidia
coreos-gpu-installer
Scripts to build and use a container to install GPU drivers on CoreOS Container Linux
Stars: ✭ 21 (-8.7%)
Mutual labels:  gpu, nvidia
peakperf
Achieve peak performance on x86 CPUs and NVIDIA GPUs
Stars: ✭ 33 (+43.48%)
Mutual labels:  gpu, nvidia
DistributedDeepLearning
Distributed Deep Learning using AzureML
Stars: ✭ 36 (+56.52%)
Mutual labels:  gpu, nvidia
Macos Egpu Cuda Guide
Set up CUDA for machine learning (and gaming) on macOS using a NVIDIA eGPU
Stars: ✭ 187 (+713.04%)
Mutual labels:  gpu, nvidia
Srmd Ncnn Vulkan
SRMD super resolution implemented with ncnn library
Stars: ✭ 186 (+708.7%)
Mutual labels:  gpu, nvidia
Genomeworks
SDK for GPU accelerated genome assembly and analysis
Stars: ✭ 215 (+834.78%)
Mutual labels:  gpu, nvidia
Nvidia Docker
Build and run Docker containers leveraging NVIDIA GPUs
Stars: ✭ 13,961 (+60600%)
Mutual labels:  gpu, nvidia-docker
fahclient
Dockerized Folding@home client with NVIDIA GPU support to help battle COVID-19
Stars: ✭ 38 (+65.22%)
Mutual labels:  nvidia, nvidia-docker
Gmonitor
gmonitor is a GPU monitor (Nvidia only at the moment)
Stars: ✭ 169 (+634.78%)
Mutual labels:  gpu, nvidia
Cuml
cuML - RAPIDS Machine Learning Library
Stars: ✭ 2,504 (+10786.96%)
Mutual labels:  gpu, nvidia
mpu
A shim driver allows in-docker nvidia-smi showing correct process list without modify anything
Stars: ✭ 27 (+17.39%)
Mutual labels:  nvidia, nvidia-docker
gpustats
Statistics on GPUs
Stars: ✭ 21 (-8.7%)
Mutual labels:  gpu, nvidia

This repo contains the docker-compose.yml for defining the dependencies to run the Jupyter Notebook Images described in the Dockerfiles under Jupyter_Images. There is one Jupyter Notebook image, CUDA10.0 and Ubuntu18.04 based. It will be spwaned from a Jupyterhub which is defined in the Dockerfile.jupyterhub under the folder Jupyterhub_Image. For more details visit our website https://www.dlm.med.fau.de/setting-jupyterhub-deep-learning/

Edited the repo:

  • removed the cuda 9 image
  • restructured the docker-compose.yml --> you will need a folder called secets containing the env_files mentioned in the yml-env_file --> will need a folder under Jupyterhub_Image called ssl containing your ssl certs for building and running the Jupyterhub.

The Jupyter_Image (jupyternotebook) has new features and some removed features: Python2 is gone R is available Python3 is available SOS is available

The workhorse for deep-learning is Python3 based. It contains Tensorflow-GPU 1.14, Keras 2.2.4 Pytorch 1.2.0 and Fastai 1.0.57

-Jupyterhub Image definition with DockerSpawner for spawning Jupyternotebooks. Localauthentication is removed and replaced by OAuth with Github

  • Data is persisted: --> -locally (Docker-Volume --> cookie secrets) --> host machine and pesronal data is mapped into the container for pre spwan hook (see into jupyterhub_config.py)

-Spawned Images run in single Docker-Containers
- Data is persisted: --> user based: -locally on nvme/ssd (Docker-Volume bind mount--> host_path:/home/Deep_Learner/private/local) and per network associated folder
(host_path:/home/Deep_Learner/private/network). --> commonly shared: - per network associated folder (net_share:/home/Deep_Learner/shared).

Added ftp server mapping to an uploads folder in host_path/uploads:/home/Deep_Learner/shared/uploads

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].