GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → dkurt → openvino_pytorch_layers

dkurt / openvino_pytorch_layers

Licence: Apache-2.0 license
How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO

Programming Languages

C++
36643 projects - #6 most used programming language
python
139335 projects - #7 most used programming language
CMake
9771 projects

Labels

customintelpytorchfftonnxunpoolingopenvinomodel-optimizerintel-openvino

Projects that are alternatives of or similar to openvino pytorch layers

pytorch YOLO OpenVINO demo
No description or website provided.
Stars: ✭ 73 (+329.41%)
Mutual labels:  onnx, openvino
Fast Stacked Hourglass Network OpenVino
A fast stacked hourglass network for human pose estimation on OpenVino
Stars: ✭ 52 (+205.88%)
Mutual labels:  onnx, openvino
intruder-detector-python
Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.
Stars: ✭ 16 (-5.88%)
Mutual labels:  intel, openvino
object-flaw-detector-python
Detect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 17 (+0%)
Mutual labels:  intel, openvino
YOLOX
YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/
Stars: ✭ 6,570 (+38547.06%)
Mutual labels:  onnx, openvino
gaze-estimation-with-laser-sparking
Deep learning based gaze estimation demo with a fun feature :-)
Stars: ✭ 32 (+88.24%)
Mutual labels:  intel, openvino
mtomo
Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.
Stars: ✭ 24 (+41.18%)
Mutual labels:  onnx, openvino
object-size-detector-python
Monitor mechanical bolts as they move down a conveyor belt. When a bolt of an irregular size is detected, this solution emits an alert.
Stars: ✭ 26 (+52.94%)
Mutual labels:  intel, openvino
safety-gear-detector-python
Observe workers as they pass in front of a camera to determine if they have adequate safety protection.
Stars: ✭ 54 (+217.65%)
Mutual labels:  intel, openvino
openncc
OpenNCC Kit
Stars: ✭ 23 (+35.29%)
Mutual labels:  intel, openvino
MobileNetV2-PoseEstimation
Tensorflow based Fast Pose estimation. OpenVINO, Tensorflow Lite, NCS, NCS2 + Python.
Stars: ✭ 99 (+482.35%)
Mutual labels:  intel, openvino
optimum
🏎️ Accelerate training and inference of 🤗 Transformers with easy to use hardware optimization tools
Stars: ✭ 567 (+3235.29%)
Mutual labels:  intel, onnx
ONNX-Runtime-with-TensorRT-and-OpenVINO
Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
Stars: ✭ 15 (-11.76%)
Mutual labels:  onnx, openvino
object-flaw-detector-cpp
Detect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 19 (+11.76%)
Mutual labels:  intel, openvino
Openvino
OpenVINO™ Toolkit repository
Stars: ✭ 2,858 (+16711.76%)
Mutual labels:  openvino, model-optimizer
motor-defect-detector-python
Predict performance issues with manufacturing equipment motors. Perform local or cloud analytics of the issues found, and then display the data on a user interface to determine when failures might arise.
Stars: ✭ 24 (+41.18%)
Mutual labels:  intel, openvino
concurrent-video-analytic-pipeline-optimization-sample-l
Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.
Stars: ✭ 39 (+129.41%)
Mutual labels:  intel, openvino
vs-mlrt
Efficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)
Stars: ✭ 34 (+100%)
Mutual labels:  onnx, openvino
old-audiosync
First implementation of the audio synchronization feature for Vidify, now obsolete
Stars: ✭ 16 (-5.88%)
Mutual labels:  fft
BetterVanillaGenerator
This plugin not only provides better terrain generators for Nukkit, you can also customize your world by modifying the configuration.
Stars: ✭ 26 (+52.94%)
Mutual labels:  custom
View All Similar Projects ➔

Repository with guides to enable some layers from PyTorch in Intel OpenVINO:

CI

OpenVINO Model Optimizer extension

To create OpenVINO IR, use extra --extension flag to specify a path to Model Optimizer extensions that perform graph transformations and register custom layers.

mo --input_model model.onnx --extension openvino_pytorch_layers/mo_extensions

Custom CPU extensions

You also need to build CPU extensions library which actually has C++ layers implementations:

source /opt/intel/openvino_2022/setupvars.sh

cd user_ie_extensions
mkdir build && cd build
cmake .. -DCMAKE_BUILD_TYPE=Release && make -j$(nproc --all)

Add compiled extensions library to your project:

from openvino.runtime import Core

core = Core()
core.add_extension('user_ie_extensions/build/libuser_cpu_extension.so')

model = ie.read_model('model.xml')
compiled_model = ie.compile_model(model, 'CPU')
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].