GitPlanet
All Git Users → triton-inference-server

6 open source projects by triton-inference-server

[ Open user page on Github ]
1. Server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
✭ 2,994
C++pythonshellCMakeRoffSmartydeep-learningmachine-learningcloudgpuinferenceedgedatacenter
2. onnxruntime backend
The Triton backend for the ONNX Runtime.
✭ 40
C++pythonCMakebackendinferencetriton-inference-serveronnx-runtime
3. tensorflow backend
The Triton backend for TensorFlow 1 and TensorFlow 2.
✭ 19
C++CMake
4. model analyzer
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
✭ 144
pythonshelldeep-learninggpuinferenceperformance-analysis
5. python backend
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
✭ 176
C++pythonshellCMake
6. backend
Common source, scripts and utilities for creating Triton backends.
✭ 134
C++CMakeCudac
1-6 of 6 user projects