cmdbug / Yolov5_ncnn

中文说明

🚀 If it helps you, click a star! ⭐️

Ncnn deployment on mobile,support:YOLOv5s,YOLOv4-tiny,MobileNetV2-YOLOv3-nano,Simple-Pose,Yolact,ChineseOCR-lite,ENet,Landmark106,DBFace,MBNv2-FCN and MBNv3-Seg-small on camera.

iOS:

• Xcode 12.4
• macOS 11.2.3
• iPhone 6sp 13.5.1

Android:

• Android Studio 4.1
• Win10 20H2
• Meizu 16x 8.1.0 (CPU:Qualcomm 710 GPU:Adreno 616)

Android has added permission requests, but if it still crashes, please manually confirm whether the relevant permissions are allowed.

iOS

Select the model to be tested directly on the interface.

Android

Select the model to be tested directly on the interface.

Models

iOS:

• Copy .param and .bin from "android_YOLOV5_NCNN\app\src\main\assets" to "iOS_YOLOv5NCNN\YOLOv5NCNN\res"
• If it prompts that net.h can't be found, you need to download it from the ncnn official website or compile .framework(20201208) yourself and replace it in the project. If opencv2.framework(4.3.0) is useful, you need to download it again and replace it in the project.
• The default library used by iOS does not include vulkan and bitcode.
• Normally, you need to re-download ncnn.framework/glslang.framework/openmp.framework/opencv2.framework and replace it with the project.
• For the configuration of Vulkan, please refer to the general configuration mentioned in Issues.

Android：

• Due to factors such as mobile phone performance and image size, FPS varies greatly on different mobile phones. This project mainly tests the use of the NCNN framework. For the conversion of specific models, you can go to the NCNN official to view the conversion tutorial.
• Because the opencv library is too large, only arm64-v8a/armeabi-v7a is reserved. If you need other versions, go to the official download.
• ncnn temporarily uses the vulkan version, and acceleration needs to be turned on before loading, which is not turned on in this project. If you want to use the ncnn version, you need to modify the CMakeLists.txt configuration.
• Different AS versions may have various problems with compilation. If the compilation error cannot be solved, it is recommended to use AS4.0 or higher to try.

This project is more about practicing the use and deployment of various models, without too much processing in terms of speed. If you have requirements for speed, you can directly obtain data such as YUV for direct input or use methods such as texture and opengl to achieve data input, reducing intermediate data transmission and conversion.

Convert locally(Will not upload model): xxxx -> ncnn

Minimal OpenCV:opencv-mobile

🎨 Screenshot

Android	iOS

Android

mbnv2-yolov3-nano	yolov4-tiny	yolov5s

simple_pose	yolact	chineseocr_lite_01

chineseocr_lite_02	ENet	yoloface500k-landmark106

dbface	mbnv2_fcn	mbnv3_seg_small

yolov5s_custom_op	nanodet	yolo-fastest-xl

light_openpose

iOS

mbnv2-yolov3-nano	yolov4-tiny	yolov5s

yolov5s_custom_op	nanodet	yolo-fastest-xl

mbnv2_fcn	mbnv3_seg_small	simple_pose

yolact	yoloface500k-landmark106	dbface

chineseocr_lite_01	chineseocr_lite_02	light_openpose
		TODO

Thanks:

• sunnyden, dog-qiuqiu, ..., nihui
• https://github.com/Tencent/ncnn