GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → jupyter → Enterprise_gateway

jupyter / Enterprise_gateway

Licence: other
A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.

Programming Languages

python
139335 projects - #7 most used programming language

Labels

jupyter-notebookhacktoberfestkubernetessparkjupyterkernelyarngatewayenterprisejupyter-kernels

Projects that are alternatives of or similar to Enterprise gateway

Almond
A Scala kernel for Jupyter
Stars: ✭ 1,354 (+228.64%)
Mutual labels:  jupyter-notebook, spark, jupyter, jupyter-kernels
Sparkmagic
Jupyter magics and kernels for working with remote Spark clusters
Stars: ✭ 954 (+131.55%)
Mutual labels:  jupyter-notebook, spark, jupyter, kernel
Stata kernel
A Jupyter kernel for Stata. Works with Windows, macOS, and Linux.
Stars: ✭ 172 (-58.25%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Ocaml Jupyter
An OCaml kernel for Jupyter (IPython) notebook
Stars: ✭ 177 (-57.04%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Nbstripout
strip output from Jupyter and IPython notebooks
Stars: ✭ 738 (+79.13%)
Mutual labels:  hacktoberfest, jupyter-notebook, jupyter
Juniperkernel
R Kernel for Jupyter
Stars: ✭ 67 (-83.74%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Irkernel
R kernel for Jupyter
Stars: ✭ 1,379 (+234.71%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Lfortran
Official mirror of https://gitlab.com/lfortran/lfortran. Please submit pull requests (PR) there. Any PR sent here will be closed automatically.
Stars: ✭ 220 (-46.6%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Elasticsearch Spark Recommender
Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch
Stars: ✭ 707 (+71.6%)
Mutual labels:  jupyter-notebook, spark, jupyter
coq jupyter
Jupyter kernel for Coq
Stars: ✭ 70 (-83.01%)
Mutual labels:  kernel, jupyter, jupyter-kernels
Nlp profiler
A simple NLP library allows profiling datasets with one or more text columns. When given a dataset and a column name containing text data, NLP Profiler will return either high-level insights or low-level/granular statistical information about the text in that column.
Stars: ✭ 181 (-56.07%)
Mutual labels:  hacktoberfest, jupyter-notebook, jupyter
imongo
A MongoDB kernel for Jupyter
Stars: ✭ 51 (-87.62%)
Mutual labels:  kernel, jupyter, jupyter-kernels
Icsharp
C# kernel for Jupyter
Stars: ✭ 263 (-36.17%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Ielixir
Jupyter's kernel for Elixir programming language
Stars: ✭ 312 (-24.27%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Spark Scala Tutorial
A free tutorial for Apache Spark.
Stars: ✭ 907 (+120.15%)
Mutual labels:  jupyter-notebook, spark, jupyter
Best Of Jupyter
🏆 A ranked list of awesome Jupyter Notebook, Hub and Lab projects (extensions, kernels, tools). Updated weekly.
Stars: ✭ 200 (-51.46%)
Mutual labels:  jupyter-notebook, jupyter, jupyter-kernels
Spylon Kernel
Jupyter kernel for scala and spark
Stars: ✭ 129 (-68.69%)
Mutual labels:  spark, kernel, jupyter-kernels
Justenoughscalaforspark
A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.
Stars: ✭ 538 (+30.58%)
Mutual labels:  jupyter-notebook, spark, jupyter
Sqlcell
SQLCell is a magic function for the Jupyter Notebook that executes raw, parallel, parameterized SQL queries with the ability to accept Python values as parameters and assign output data to Python variables while concurrently running Python code. And *much* more.
Stars: ✭ 145 (-64.81%)
Mutual labels:  hacktoberfest, jupyter-notebook, jupyter
Spark Jupyter Aws
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
Stars: ✭ 259 (-37.14%)
Mutual labels:  jupyter-notebook, spark, jupyter
View All Similar Projects ➔

Website | Technical Overview | Features | Installation | System Architecture | Contributing |

Jupyter Enterprise Gateway

Actions Status PyPI version Downloads Documentation Status Google Group Join the chat at https://gitter.im/jupyter/enterprise_gateway

Jupyter Enterprise Gateway enables Jupyter Notebook to launch remote kernels in a distributed cluster, including Apache Spark managed by YARN, IBM Spectrum Conductor, Kubernetes or Docker Swarm.

It provides out of the box support for the following kernels:

  • Python using IPython kernel
  • R using IRkernel
  • Scala using Apache Toree kernel

Full Documentation for Jupyter Enterprise Gateway can be found here

Jupyter Enterprise Gateway does not manage multiple Jupyter Notebook deployments, for that you should use JupyterHub.

Technical Overview

Jupyter Enterprise Gateway is a web server that provides headless access to Jupyter kernels within an enterprise. Inspired by Jupyter Kernel Gateway, Jupyter Enterprise Gateway provides feature parity with Kernel Gateway's jupyter-websocket mode in addition to the following:

  • Adds support for remote kernels hosted throughout the enterprise where kernels can be launched in the following ways:
    • Local to the Enterprise Gateway server (today's Kernel Gateway behavior)
    • On specific nodes of the cluster utilizing a round-robin algorithm
    • On nodes identified by an associated resource manager
  • Provides support for Apache Spark managed by YARN, IBM Spectrum Conductor, Kubernetes or Docker Swarm out of the box. Others can be configured via Enterprise Gateway's extensible framework.
  • Secure communication from the client, through the Enterprise Gateway server, to the kernels
  • Multi-tenant capabilities
  • Persistent kernel sessions
  • Ability to associate profiles consisting of configuration settings to a kernel for a given user (see Project Roadmap)

Deployment Diagram

Features

See Enterprise Gateway Features in the documentation for a list of Jupyter Enterprise Gateway features.

Installation

Detailed installation instructions are located in the Getting Started page of the project docs. Here's a quick start using pip:

# install from pypi
pip install --upgrade jupyter_enterprise_gateway

# show all config options
jupyter enterprisegateway --help-all

# run it with default options
jupyter enterprisegateway

Please check the Configuration Options page for information about the supported options.

System Architecture

The System Architecture page includes information about Enterprise Gateway's remote kernel, process proxy, and launcher frameworks.

Contributing

The Contribution page includes information about how to contribute to Enterprise Gateway along with our roadmap. While there, you'll want to set up a development environment and check out typical developer tasks.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].