All Projects β†’ nteract β†’ Commuter

nteract / Commuter

Licence: bsd-3-clause
🚎 Notebook sharing hub

Programming Languages

javascript
184084 projects - #8 most used programming language

Projects that are alternatives of or similar to Commuter

Server
☁️ Nextcloud server, a safe home for all your data
Stars: ✭ 17,723 (+4920.68%)
Mutual labels:  collaboration, sharing
Sci Pype
A Machine Learning API with native redis caching and export + import using S3. Analyze entire datasets using an API for building, training, testing, analyzing, extracting, importing, and archiving. This repository can run from a docker container or from the repository.
Stars: ✭ 90 (-74.5%)
Mutual labels:  s3, jupyter-notebook
Cortx
CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.
Stars: ✭ 426 (+20.68%)
Mutual labels:  s3, jupyter-notebook
Sparkleshare
Share and collaborate by syncing with any Git repository instantly. Linux, macOS, and Windows.
Stars: ✭ 4,661 (+1220.4%)
Mutual labels:  collaboration, sharing
tellery
Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.
Stars: ✭ 219 (-37.96%)
Mutual labels:  notebook, collaboration
H1st
The AI Application Platform We All Need. Human AND Machine Intelligence. Based on experience building AI solutions at Panasonic: robotics predictive maintenance, cold-chain energy optimization, Gigafactory battery mfg, avionics, automotive cybersecurity, and more.
Stars: ✭ 697 (+97.45%)
Mutual labels:  collaboration, jupyter-notebook
Udacity Data Engineering
Udacity Data Engineering Nano Degree (DEND)
Stars: ✭ 89 (-74.79%)
Mutual labels:  s3, jupyter-notebook
Paperboy
A web frontend for scheduling Jupyter notebook reports
Stars: ✭ 221 (-37.39%)
Mutual labels:  jupyter-notebook, notebook
hub
Public reusable components for Polyaxon
Stars: ✭ 8 (-97.73%)
Mutual labels:  notebook, s3
TeleType
Stream or share terminals over the web. Show off mad cli-fu, help a colleague, teach, or troubleshoot. end-to-end encrypted πŸ›‘
Stars: ✭ 83 (-76.49%)
Mutual labels:  sharing, collaboration
Gistpad
VS Code extension for managing and sharing code snippets, notes and interactive samples using GitHub Gists
Stars: ✭ 443 (+25.5%)
Mutual labels:  collaboration, notebook
Basic Mathematics For Machine Learning
The motive behind Creating this repo is to feel the fear of mathematics and do what ever you want to do in Machine Learning , Deep Learning and other fields of AI
Stars: ✭ 300 (-15.01%)
Mutual labels:  jupyter-notebook, notebook
Beakerx
Beaker Extensions for Jupyter Notebook
Stars: ✭ 2,594 (+634.84%)
Mutual labels:  jupyter-notebook, notebook
Nbgallery
Enterprise Jupyter notebook sharing and collaboration app
Stars: ✭ 135 (-61.76%)
Mutual labels:  collaboration, jupyter-notebook
Applied Reinforcement Learning
Reinforcement Learning and Decision Making tutorials explained at an intuitive level and with Jupyter Notebooks
Stars: ✭ 229 (-35.13%)
Mutual labels:  jupyter-notebook, notebook
Stock Analysis Engine
Backtest 1000s of minute-by-minute trading algorithms for training AI with automated pricing data from: IEX, Tradier and FinViz. Datasets and trading performance automatically published to S3 for building AI training datasets for teaching DNNs how to trade. Runs on Kubernetes and docker-compose. >150 million trading history rows generated from +5000 algorithms. Heads up: Yahoo's Finance API was disabled on 2019-01-03 https://developer.yahoo.com/yql/
Stars: ✭ 605 (+71.39%)
Mutual labels:  s3, jupyter-notebook
Style transfer
CNN image style transfer 🎨.
Stars: ✭ 210 (-40.51%)
Mutual labels:  jupyter-notebook, notebook
Best Of Jupyter
πŸ† A ranked list of awesome Jupyter Notebook, Hub and Lab projects (extensions, kernels, tools). Updated weekly.
Stars: ✭ 200 (-43.34%)
Mutual labels:  jupyter-notebook, notebook
S3contents
A S3 backed ContentsManager implementation for Jupyter
Stars: ✭ 175 (-50.42%)
Mutual labels:  s3, jupyter-notebook
Audio Spectrum Analyzer In Python
A series of Jupyter notebooks and python files which stream audio from a microphone using pyaudio, then processes it.
Stars: ✭ 273 (-22.66%)
Mutual labels:  jupyter-notebook, notebook

Glitch Deployed styled with prettier

comΒ·mutΒ·er

/kΙ™Λˆmyo͞odΙ™r/ a person who travels some distance to work on a regular basis.

As commuters, we rush around from place to place all day. We go to work, school, and stores. We travel to locations near and far. Eventually, we return to our cozy home. πŸš— 🏒 ✈️ πŸ—Ό πŸš„ 🏬 🚌 🏫 🚲 πŸŒ† πŸƒ 🏑

Like commuters, our data travels around too. Sometimes we need a notebook at work and other times at a client's site. Wherever and whenever you need your notebooks, commuter has you covered.

What is "commuter"?

As an opinionated nteract focused server, commuter reads notebooks from a local directory or Amazon S3, has a directory explorer to find notebooks, and provides a jupyter compatible version of the contents API. You determine where your notebooks should reside and where they should be shared. Flexibility and convenience.

commuter

Try commuter today and take your notebooks wherever you need them.

Installation

You may use whichever package manager (npm or yarn) best suits your workflow. The nteract team internally uses yarn.

npm install @nteract/commuter -g
# OR
yarn global add @nteract/commuter

Usage

Configure and run commuter with environment variables and commuter server.

Example local run (using a network file share!):

COMMUTER_LOCAL_STORAGE_BASEDIRECTORY=/efs/users/ commuter

Example S3 run:

COMMUTER_BUCKET=sweet-notebooks commuter

Environment Variables

General Environment Variables

Environment Variable Description Default
COMMUTER_STORAGE_BACKEND local, s3, or gcs local
COMMUTER_DISCOVERY_BACKEND either elasticsearch or none "none"
COMMUTER_PORT Port to run commuter on 4000
COMMUTER_LOCAL_STORAGE_BASEDIRECTORY directory to serve in local storage mode process.cwd()
COMMUTER_ES_HOST ElasticSearch Host ""

Environment Variables for S3 Storage

Authentication to S3 is using CredentialProviderChain with default providers. This supports the most common ways of authenticating in AWS.

Environment Variable Description Default
AWS_ACCESS_KEY_ID Specifies an AWS access key associated with an IAM user or role. Optional
AWS_SECRET_ACCESS_KEY Specifies the secret key associated with the access key. This is essentially the "password" for the access key. Optional
AWS_SESSION_TOKEN Specifies the session token value that is required if you are using temporary security credentials. Optional
AWS_PROFILE Specifies the name of the profile with the credentials and options to use. This can be the name of a profile stored in a credentials or config file default
COMMUTER_S3_BASE_PREFIX prefix on the bucket, similar to base directory ""
COMMUTER_S3_PATH_DELIMITER separator for "paths" "/"
COMMUTER_BUCKET bucket contents served from Required in S3 mode, no default
COMMUTER_S3_ENDPOINT S3 endpoint Optional, selected automatically
COMMUTER_S3_FORCE_PATH_STYLE Set to true to activate s3ForcePathStyle. Forces path-style URLs for s3 objects, therefore URLs will be in the form <endpoint>/<bucket>/<key> instead of <bucket>.<endpoint>/<key> false

Environment Variables for Google Storage

Environment Variable Description Default
GOOGLE_APPLICATION_CREDENTIALS file path of the JSON file that contains your service account key ""
COMMUTER_BUCKET GCS bucket name without "gs://" prefix Required
COMMUTER_GCS_PATH_DELIMITER separator for "paths" "/"
COMMUTER_GCS_BASE_PREFIX prefix on the bucket, similar to base directory ""

Roadmap

ROADMAP Document

Development

Quick Start

  1. git clone [email protected]:nteract/commuter.git
  2. cd commuter
  3. yarn
  4. yarn dev
  5. open http://localhost:4000

Dev Docker

A Dockerfile for a local dev server can be use as follows:

  1. docker build --tag commuter:dev --file Dockerfile.dev .
  2. Run this:
docker run \
    --init \
    --interactive \
    --tty \
    --rm \
    --publish 4000:4000 \
    --mount type=bind,source=(pwd),target=/app \
    --env COMMUTER_LOCAL_STORAGE_BASEDIRECTORY=/app/examples \
    commuter:dev

Tests

There are three ways you can run tests:

  • If you have your environment set up, you can run tests locally via yarn test.
  • This repository is also set up with GitHub Actions, a builtin CI system, which will automatically trigger test builds for multiple Node versions upon every push into this repository. You can then check out the results in the Actions tab.
  • These GitHub Actions can be triggered locally using act, this way you don't have to have your JavaScript environment set up and you don't have to commit and push in order to run the tests remotely through GitHub.

Deployment

  1. Install commuter cli yarn add @nteract/commuter
  2. exec commuter - the service is typically wrapped inside daemontools

Deployment (Docker / Kubernetes)

A Dockerfile intended for Production use (suitable for Kubernetes or other container runtime) has been contributed. Instructions are below.

Note: there is no officially published Docker image at this time, you should publish it to your own image registry.

  1. Build and tag image docker build --tag commuter:latest .
  2. Image can be executed as follows:
docker run \
--publish 4000:4000 \
--mount type=bind,source=/home/username/work/commuter/examples,target=/examples \
--env COMMUTER_LOCAL_STORAGE_BASEDIRECTORY=/examples \
commuter:latest
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].