HolmesShuan / Cnn Inference Engine Quick View
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
Stars: ✭ 124
Labels
Projects that are alternatives of or similar to Cnn Inference Engine Quick View
Deepgaze
Computer Vision library for human-computer interaction. It implements Head Pose and Gaze Direction Estimation Using Convolutional Neural Networks, Skin Detection through Backprojection, Motion Detection and Tracking, Saliency Map.
Stars: ✭ 1,552 (+1151.61%)
Mutual labels: cnn
Model Quantization
Collections of model quantization algorithms
Stars: ✭ 118 (-4.84%)
Mutual labels: cnn
What Is My Girlfriend Thinking
用 Tensorflow.js 猜猜我的女朋友在想什么. A Tensorflow.js application for facial classification.
Stars: ✭ 122 (-1.61%)
Mutual labels: cnn
Id Card Detector
💳 Detecting the National Identification Cards with Deep Learning (Faster R-CNN)
Stars: ✭ 114 (-8.06%)
Mutual labels: cnn
Sppnet
Spatial Pyramid Pooling on top of AlexNet using tensorflow. ***New updates for SPPnet in Pytorch**
Stars: ✭ 117 (-5.65%)
Mutual labels: cnn
3d Densenet
3D Dense Connected Convolutional Network (3D-DenseNet for action recognition)
Stars: ✭ 118 (-4.84%)
Mutual labels: cnn
Hyperlandmark
Deep Learning Based Free Mobile Real-Time Face Landmark Detector. Contact:[email protected]
Stars: ✭ 1,528 (+1132.26%)
Mutual labels: cnn
Unified Gesture And Fingertip Detection
A Unified Convolutional Neural Network Approach of Gesture Recognition and Fingertip Detection.
Stars: ✭ 121 (-2.42%)
Mutual labels: cnn
Reproducible Image Denoising State Of The Art
Collection of popular and reproducible image denoising works.
Stars: ✭ 1,776 (+1332.26%)
Mutual labels: cnn
Aspect Extraction
Aspect extraction from product reviews - window-CNN+maxpool+CRF, BiLSTM+CRF, MLP+CRF
Stars: ✭ 117 (-5.65%)
Mutual labels: cnn
Classifier multi label textcnn
multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification
Stars: ✭ 116 (-6.45%)
Mutual labels: cnn
Deepface
Keras implementation of the renowned publication "DeepFace: Closing the Gap to Human-Level Performance in Face Verification" by Taigman et al. Pre-trained weights on VGGFace2 dataset.
Stars: ✭ 113 (-8.87%)
Mutual labels: cnn
Lenet 5
PyTorch implementation of LeNet-5 with live visualization
Stars: ✭ 122 (-1.61%)
Mutual labels: cnn
Tf2
An Open Source Deep Learning Inference Engine Based on FPGA
Stars: ✭ 113 (-8.87%)
Mutual labels: cnn
Deepway
This project is an aid to the blind. Till date there has been no technological advancement in the way the blind navigate. So I have used deep learning particularly convolutional neural networks so that they can navigate through the streets.
Stars: ✭ 118 (-4.84%)
Mutual labels: cnn
A Convolutional Recurrent Neural Network For Real Time Speech Enhancement
A minimum unofficial implementation of the "A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement" (CRN) using PyTorch
Stars: ✭ 123 (-0.81%)
Mutual labels: cnn
Keras transfer cifar10
Object classification with CIFAR-10 using transfer learning
Stars: ✭ 120 (-3.23%)
Mutual labels: cnn
CNN-Inference-Engine-Quick-View
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
Runtime-speed Comparisons
Data-flow graph optimization
FLOAT32-Support
| Framework | Main Platform | Model Compatibility | Detection-Support | Speed Benchmarks |
|---|---|---|---|---|
| Bolt | CPU (ARM optimized) / x86 / Mali GPU | Caffe / Tensorflow / PyTorch / onnx | Y | Link |
| TNN | CPU (ARM optimized) / Mali Adreno Apple GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| Paddle-Light | CPU (ARM optimized) / Mali GPU / FPGA / NPU | Paddle / Caffe / onnx | Y | Link |
| MNN | CPU (ARM optimized) / Mali GPU | Caffe / Tensorflow / onnx | Y | Link |
| NCNN | CPU (ARM optimized) / Mali GPU | Caffe / PyTorch / mxnet / onnx | Y | 3rd party Link / Official Link |
| MACE | CPU (ARM optimized) / Mali GPU / DSP | Caffe / Tensorflow / onnx | Y | Link |
| TEngine | CPU (ARM A72 optimized) | Caffe / mxnet | Y | Link |
| AutoKernel | CPU / GPU/ NPU | Caffe / mxnet / Tensorflow / PyTorch / Darknet | Y | Link |
| Synet | CPU (ARM optimized) / x86 | Caffe / PyTorch / Tensorflow / mxnet / onnx | Y | - |
| MsnhNet | CPU (ARM optimized) / Mali GPU / x86 / TensorRT | PyTorch | Y | Link |
| ONNX-Runtime | CPU / Nvidia GPU | onnx | Y | - |
| HiAI | Kirin CPU / NPU | Caffe / Tensorflow | Y | - |
| NNIE | NPU | Caffe | Y | 1TOPs |
| Intel-Caffe | CPU (Intel optimized) | Caffe | Y | Link |
| FeatherCNN | CPU (ARM optimized) | Caffe | N | Link / unofficial Link |
| Tensorflowlite | CPU (Android optimized) | Caffe2 / Tensorflow / onnx | Y | Link |
| TensorRT | GPU (Volta optimized) | Caffe / Tensorflow / onnx | Y | Link |
| TVM | CPU (ARM optimized) / Mali GPU / FPGA | onnx | Y | - |
| SNPE | CPU (Qualcomm optimized) / GPU / DSP | Caffe / Caffe2 / Tensorflow/ onnx | Y | Link |
| Pocket-Tensor | CPU (ARM/x86 optimized) | Keras | N | Link |
| ZQCNN | CPU | Caffe / mxnet | Y | Link |
| ARM-NEON-to-x86-SSE | CPU (Intel optimized) | Intrinsics-Level | - | - |
| Simd | CPU (all platform optimized) | Intrinsics-Level | - | - |
| clDNN | Intel® Processor Graphics / Iris™ Pro Graphics | Caffe / Tennsorflow / mxnet / onnx | Y | Link |
FIX16-Support
| Framework | Main Platform | Model Compatibility | Detection-Support | Speed Benchmarks |
|---|---|---|---|---|
| Bolt | CPU (ARM optimized) / x86 / Mali GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| ARM32-SGEMM-LIB | CPU (ARM optimized) | GEMM Library | N | Link |
| TNN | CPU (ARM optimized) / Mali Adreno Apple GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| Yolov2-Xilinx-PYNQ | FPGA (Xilinx PYNQ) | Yolov2-only | Y | Link |
INT8-Support
| Framework | Main Platform | Model Compatibility | Detection-Support | Speed Benchmarks |
|---|---|---|---|---|
| Bolt | CPU (ARM optimized) / x86 / Mali GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| Intel-Caffe | CPU (Intel Skylake) | Caffe | Y | Link |
| TNN | CPU (ARM optimized) / Mali Adreno Apple GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| NCNN | CPU (ARM) | Caffe / pytorch / mxnet / onnx | Y | Link |
| Paddle-Light | CPU (ARM optimized) / Mali GPU / FPGA | Paddle / Caffe / onnx | Y | Link |
| MNN | CPU (ARM optimized) / Mali GPU | Caffe / Tensorflow / onnx | Y | Link |
| Tensorflowlite | CPU (Android) | Caffe2 / Tensorflow / onnx | Y | Link |
| TensorRT | GPU (Volta) | Caffe / Tensorflow / onnx | Y | Link |
| Gemmlowp | CPU (ARM / x86) | GEMM Library | - | - |
| SNPE | DSP (Quantized DLC) | Caffe / Caffe2 / Tensorflow/ onnx | Y | Link |
| MACE | CPU (ARM optimized) / Mali GPU / DSP | Caffe / Tensorflow / onnx | Y | Link |
| TF2 | FPGA | Caffe / PyTorch / Tensorflow | Y | Link |
TERNARY-Support
| Framework | Main Platform | Model Compatibility | Detection-Support | Speed Benchmarks |
|---|---|---|---|---|
| Gemmbitserial | CPU (ARM / x86) | GEMM Library | - | Link |
BINARY-Support
| Framework | Main Platform | Model Compatibility | Detection-Support | Speed Benchmarks |
|---|---|---|---|---|
| Bolt | CPU (ARM optimized) / x86 / Mali GPU | Caffe / Tensorflow / PyTorch | Y | Link |
| BMXNET | CPU (ARM / x86) / GPU | mxnet | Y | Link |
| DABNN | CPU (ARM) | Caffe / Tensorflow / onnx | N | Link |
| Espresso | GPU | - | N | Link |
| BNN-PYNQ | FPGA (Xilinx PYNQ) | - | N | Link |
| FINN | FPGA (Xilinx) | - | N | Link |
NLP-Support
| Framework | Main Platform | Model Compatibility | Speed Benchmarks |
|---|---|---|---|
| TurboTransformers | CPU / Nvidia GPU | PyTorch | Link |
| Bolt | CPU / Mali GPU | Caffe / onnx | Link |
Note that the project description data, including the texts, logos, images, and/or trademarks,
for each open source project belongs to its rightful owner.
If you wish to add or remove any projects, please contact us at [email protected].