All Projects → Tony607 → keras_openvino

Tony607 / keras_openvino

Licence: other
How to run Keras model inference x3 times faster with CPU and Intel OpenVINO

Programming Languages

Jupyter Notebook
11667 projects
python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to keras openvino

Berrynet
Deep learning gateway on Raspberry Pi and other edge devices
Stars: ✭ 1,529 (+4678.13%)
Mutual labels:  edge-computing, openvino
concurrent-video-analytic-pipeline-optimization-sample-l
Create a concurrent video analysis pipeline featuring multistream face and human pose detection, vehicle attribute detection, and the ability to encode multiple videos to local storage in a single stream.
Stars: ✭ 39 (+21.88%)
Mutual labels:  edge-computing, openvino
object-flaw-detector-python
Detect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 17 (-46.87%)
Mutual labels:  edge-computing, openvino
object-flaw-detector-cpp
Detect various irregularities of a product as it moves along a conveyor belt.
Stars: ✭ 19 (-40.62%)
Mutual labels:  edge-computing, openvino
intruder-detector-python
Build an application that alerts you when someone enters a restricted area. Learn how to use models for multiclass object detection.
Stars: ✭ 16 (-50%)
Mutual labels:  edge-computing, openvino
motor-defect-detector-python
Predict performance issues with manufacturing equipment motors. Perform local or cloud analytics of the issues found, and then display the data on a user interface to determine when failures might arise.
Stars: ✭ 24 (-25%)
Mutual labels:  edge-computing, openvino
object-size-detector-python
Monitor mechanical bolts as they move down a conveyor belt. When a bolt of an irregular size is detected, this solution emits an alert.
Stars: ✭ 26 (-18.75%)
Mutual labels:  edge-computing, openvino
safety-gear-detector-python
Observe workers as they pass in front of a camera to determine if they have adequate safety protection.
Stars: ✭ 54 (+68.75%)
Mutual labels:  edge-computing, openvino
awesome-edge-computing
A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.
Stars: ✭ 149 (+365.63%)
Mutual labels:  edge-computing
openvino pytorch layers
How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO
Stars: ✭ 17 (-46.87%)
Mutual labels:  openvino
BMW-IntelOpenVINO-Detection-Inference-API
This is a repository for a No-Code object detection inference API using the OpenVINO. It's supported on both Windows and Linux Operating systems.
Stars: ✭ 66 (+106.25%)
Mutual labels:  openvino
vs-mlrt
Efficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)
Stars: ✭ 34 (+6.25%)
Mutual labels:  openvino
openvino contrib
Repository for OpenVINO's extra modules
Stars: ✭ 55 (+71.88%)
Mutual labels:  openvino
FAST-Pathology
⚡ Open-source software for deep learning-based digital pathology
Stars: ✭ 54 (+68.75%)
Mutual labels:  openvino
ONNX-Runtime-with-TensorRT-and-OpenVINO
Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
Stars: ✭ 15 (-53.12%)
Mutual labels:  openvino
opencv-python-inference-engine
Wrapper package for OpenCV with Inference Engine python bindings.
Stars: ✭ 32 (+0%)
Mutual labels:  openvino
web
realness.online
Stars: ✭ 15 (-53.12%)
Mutual labels:  edge-computing
Pruned-OpenVINO-YOLO
Deploy the pruned YOLOv3/v4/v4-tiny/v4-tiny-3l model on OpenVINO embedded devices
Stars: ✭ 46 (+43.75%)
Mutual labels:  openvino
ros openvino
A ROS package to wrap openvino inference engine and get it working with Myriad and GPU
Stars: ✭ 57 (+78.13%)
Mutual labels:  openvino
FogBus
[JSS'19] A Blockchain-based Lightweight Framework for Edge and Fog Computing
Stars: ✭ 28 (-12.5%)
Mutual labels:  edge-computing

How to run Keras model inference x3 times faster with CPU and Intel OpenVINO | DLology Blog

System requirement

  • 6th-8th Generation Intel® Core™
  • Intel® Xeon® v5 family
  • Intel® Xeon® v6 family

Operating Systems

  • Ubuntu* 16.04.3 long-term support (LTS), 64-bit
  • CentOS* 7.4, 64-bit
  • Windows* 10, 64-bit

How to Run

Require Python 3.5+ and Jupyter notebook installed

Clone or download this repo

git clone https://github.com/Tony607/keras_openvino

Install OpenVINO

Setup OpenVINO on your machine, choose your OS on this page, follow the instruction to download and install it.

Install required libraries

pip3 install -r requirements.txt

Run the setupvars.bat before calling jupyter notebook.

"C:\Program Files (x86)\IntelSWTools\openvino\bin\setupvars.bat"

Or in Linux add the following line to ~/.bashrc

source /opt/intel/openvino/bin/setupvars.sh

In a terminal run,

jupyter notebook

In the opened browser window open

keras-openvino-ImageNet.ipynb

Run Inference on NCS (Neural compute stick 1 or 2)

Once you have the inference model, plugin the NCS, run this script.

python3 ncs_inference.py
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].