All Projects → equinor → gordo

equinor / gordo

Licence: AGPL-3.0 license
An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to gordo

open-stream-processing-benchmark
This repository contains the code base for the Open Stream Processing Benchmark.
Stars: ✭ 37 (+48%)
Mutual labels:  distributed-computing
XH5For
XDMF parallel partitioned mesh I/O on top of HDF5
Stars: ✭ 23 (-8%)
Mutual labels:  scalable
ShadowClone
Unleash the power of cloud
Stars: ✭ 224 (+796%)
Mutual labels:  distributed-computing
SSNM-Coseg
[AAAI20] Deep Object Co-segmentation via Spatial-Semantic Network Modulation(Oral paper)
Stars: ✭ 21 (-16%)
Mutual labels:  end-to-end
python-json-socket
JSON messaging based socket interface with multi-threaded server and client
Stars: ✭ 52 (+108%)
Mutual labels:  distributed-computing
harika
Offline-, mobile-first graph note-taking app focused on performance with the knowledgebase of any scale
Stars: ✭ 111 (+344%)
Mutual labels:  scalable
pyspark-algorithms
PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
Stars: ✭ 72 (+188%)
Mutual labels:  distributed-computing
raven-distribution-framework
Decentralized Computing Backend for Artificial Intelligence, Web3, Metaverse, and Gaming Application
Stars: ✭ 31 (+24%)
Mutual labels:  distributed-computing
microcore
.NET Core framework for inter-service communication
Stars: ✭ 24 (-4%)
Mutual labels:  distributed-computing
cypress-example-docker-circle-workflows
Cypress + Docker + CircleCI Workflows = ❤️
Stars: ✭ 29 (+16%)
Mutual labels:  end-to-end
tasq
A simple task queue implementation to enqeue jobs on local or remote processes.
Stars: ✭ 83 (+232%)
Mutual labels:  distributed-computing
SlurmClusterManager.jl
julia package for running code on slurm clusters
Stars: ✭ 27 (+8%)
Mutual labels:  distributed-computing
wrench
WRENCH: Cyberinfrastructure Simulation Workbench
Stars: ✭ 25 (+0%)
Mutual labels:  distributed-computing
LSTM-TensorSpark
Implementation of a LSTM with TensorFlow and distributed on Apache Spark
Stars: ✭ 40 (+60%)
Mutual labels:  distributed-computing
rce
Distributed, workflow-driven integration environment
Stars: ✭ 42 (+68%)
Mutual labels:  distributed-computing
ganimation replicate
An Out-of-the-Box Replication of GANimation using PyTorch, pretrained weights are available!
Stars: ✭ 165 (+560%)
Mutual labels:  out-of-the-box
End-to-End-Machine-Learning-Projects
This repository contains Machine Learning projects that involve the steps starting from data collection to deployment
Stars: ✭ 74 (+196%)
Mutual labels:  end-to-end
ParallelUtilities.jl
Fast and easy parallel mapreduce on HPC clusters
Stars: ✭ 28 (+12%)
Mutual labels:  distributed-computing
End-to-End-Mandarin-ASR
End-to-end speech recognition on AISHELL dataset.
Stars: ✭ 20 (-20%)
Mutual labels:  end-to-end
protoactor-python
Proto Actor - Ultra fast distributed actors
Stars: ✭ 78 (+212%)
Mutual labels:  distributed-computing

Gordo


Building thousands of models with timeseries data to monitor systems.


Table of content

About

Gordo fulfills the role of inhaling config files and supplying components to the pipeline of:

  1. Fetching data
  2. Training model
  3. Serving model

Examples

See our example notebooks for how to develop with gordo locally.


Install

pip install --upgrade gordo

Bleeding edge:
pip install git+https://github.com/equinor/gordo.git

Uninstall

pip uninstall gordo

Developer manual

This section will explain how to start development of Gordo.

How to prepare working environment

  • Install pip-tools
pip install --upgrade pip
pip install --upgrade pip-tools
  • Install requirements
pip install -r requirements/full_requirements.txt
pip install -r requirements/test_requirements.txt

How to update packages

Note: you have to install pip-tools version higher then 6 for requirements to have same multi-line output format.

To update some package in full_requirements.txt:

  • Change its version in requirements.in file;
  • Compile requirements:
pip-compile --output-file=full_requirements.txt mlflow_requirements.in postgres_requirements.in requirements.in  

How to run tests locally

Tests system requirements

To run tests it's required for your system to has (note: commands might differ from your OS):

  • Running docker process;
  • Available 5432 port for postgres container (postgresql container is used, so better to stop your local instance for tests running).

Run tests

List of commands to run tests can be found here. Running of tests takes some time, so it's faster to run tests in parallel:

python3 setup.py test

NOTE: this example is for Pycharm IDE to use breakpoints in the code of the tests.
On the configuration setup for test running add to Additional arguments: in pytest section following string: --ignore benchmarks --cov-report= --no-cov or TEMPORARY remove --cov-report=xml and --cov=gordo from pytest.ini file.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].