66 Open source projects that are alternatives of or similar to nanodet_tensorrt_int8

RepVGG TensorRT int8 量化，实测推理不到1ms一帧！

tensorrt int8 量化yolov5 onnx模型

TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！

Object detection for video surveillance

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server

A multi object tracking Library Based on tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

A flexible Python front-end inference SDK based on TensorRT

C++ library based on tensorrt integration

This project generates images you've probably seen in autonomous driving demo. Object Detection, Lane Detection, Road Segmentation, Depth Estimation using TensorRT

YOLOv4 object detector using TensorRT engine

⚡ Open-source software for deep learning-based digital pathology

TensorRT Examples (TensorRT, Jetson Nano, Python, C++)

Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.

YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite

Tensorflow to TensorRT Model Converter

This repository contains a docker image that I use to develop my artificial intelligence applications in an uncomplicated fashion. Python, TensorFlow, PyTorch, ONNX, Keras, OpenCV, TensorRT, Numpy, Jupyter notebook... 🐋🔥

Localize to Classify and Classify to Localize: Mutual Guidance in Object Detection

Deep Learning API and Server in C++14 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

pnn is Darknet compatible neural nets inference engine implemented in Rust.

TensorRT person tracking RFBNet300

PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT

YOLO v3, v4, v5, v6, v7 + SORT tracking + ROS platform. Supporting: YOLO with Darknet, OpenCV(DNN), OpenVINO, TensorRT(tkDNN). SORT supports python(original) and C++. (Not Deep SORT)

Yolov3 on tensorflow2.0 and tensorrt7.0

PyTorch Project Specification.

This is the implementation that supports yolov5s, yolov5m, yolov5l, yolov5x.

Efficient ML Filter Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2, and Real-CUGAN)

Use the Intel D435 real-sensing camera to realize object detection based on the Yolov3-5 framework under the Opencv DNN(old version)/TersorRT(now) by ROS-melodic.Real-time display of the Pointcloud in the camera coordinate system.

Hardware-accelerated DNN model inference ROS2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU

Deep learning gateway on Raspberry Pi and other edge devices

A c++ implementation of yolov5 and deepsort

This repo is a C++ version of yolov5_deepsort_tensorrt. Packing all C++ programs into .so files, using Python script to call C++ programs further.

🍅🍅🍅YOLOv5-Lite: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 930+kb (int8) and 1.7M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

Use PyTorch model in C++ project

车牌识别，基于HyperLPR实现，修改模型调用方法，使用caffe+tensorRT实现GPU加速，修改了车牌检测模型

Example of loading a Keras model into TensorRT C++ API

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

openpose, yolov3 with tiny-tensorrt

You can import this module directly

Multiple types of NN model optimization environments. It is possible to directly access the host PC GUI and the camera to verify the operation. Intel iHD GPU (iGPU) support. NVIDIA GPU (dGPU) support.

QuarkDet lightweight object detection in PyTorch .Real-Time Object Detection on Mobile Devices.

TensorRT for SOLO(use python)

Sample apps to demonstrate how to deploy models trained with TAO on DeepStream

InsightFace REST API for easy deployment of face recognition services with TensorRT in Docker.

PyTorch ,ONNX and TensorRT implementation of YOLOv4

The purpose of this project is to apply mediapipe to more AI chips.

Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment

针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库

An easy to use PyTorch to TensorRT converter

No description or website provided.

C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ONNX Runtime, LibTorch, TensorFlow

EfficientNetv2 TensorRT int8

More readable and flexible yolov5 with more backbone(resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer) and (cbam，dcn and so on), and tensorrt

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

This is a highly separated deployment project based on Deepstream , including the full range of Yolo and continuously expanding deployment projects such as Ocr.

Tengine is a lite, high performance, modular inference engine for embedded device

Implementation of popular deep learning networks with TensorRT network definition API

tensorRt-inference darknet2onnx pytorch2onnx mxnet2onnx python version

Sample projects for TensorRT in C++