All Projects → maudzung → Awesome Autonomous Driving Papers

maudzung / Awesome Autonomous Driving Papers

This repository provides awesome research papers for autonomous driving perception. If you do find a problem or have any suggestions, please raise this as an issue or make a pull request with information (format of the repo): Research paper title, datasets, metrics, objects, source code, publisher, and year.

Projects that are alternatives of or similar to Awesome Autonomous Driving Papers

Vision3d
Research platform for 3D object detection in PyTorch.
Stars: ✭ 177 (+490%)
Mutual labels:  lidar, real-time
Hdl localization
Real-time 3D localization using a (velodyne) 3D LIDAR
Stars: ✭ 332 (+1006.67%)
Mutual labels:  lidar, real-time
RGB-Fusion-Tool-PS
Powershell that use RGB Fusion CLI to associate profiles with Windows Processes
Stars: ✭ 30 (+0%)
Mutual labels:  fusion, rgb
Depth clustering
🚕 Fast and robust clustering of point clouds generated with a Velodyne sensor.
Stars: ✭ 657 (+2090%)
Mutual labels:  lidar, real-time
sensor-fusion
Filters: KF, EKF, UKF || Process Models: CV, CTRV || Measurement Models: Radar, Lidar
Stars: ✭ 96 (+220%)
Mutual labels:  fusion, lidar
Complex Yolov4 Pytorch
The PyTorch Implementation based on YOLOv4 of the paper: "Complex-YOLO: Real-time 3D Object Detection on Point Clouds"
Stars: ✭ 691 (+2203.33%)
Mutual labels:  lidar, real-time
Streamz
Real-time stream processing for python
Stars: ✭ 924 (+2980%)
Mutual labels:  real-time
Fastlayerdecomposition
fast layer decomposition and updating
Stars: ✭ 20 (-33.33%)
Mutual labels:  rgb
Sketch Chat
A Sketch plugin to chat in Sketch Cloud files
Stars: ✭ 20 (-33.33%)
Mutual labels:  real-time
Blink1
Official software for blink(1) USB RGB LED by ThingM
Stars: ✭ 888 (+2860%)
Mutual labels:  rgb
Mechanical Keyboard
DIY mechanical keyboard and where to find them
Stars: ✭ 947 (+3056.67%)
Mutual labels:  rgb
Las Rs
Read and write ASPRS las files, Rust edition.
Stars: ✭ 27 (-10%)
Mutual labels:  lidar
Spimedb
EXPLORE & EDIT REALITY
Stars: ✭ 14 (-53.33%)
Mutual labels:  real-time
Modosc
A set of Max abstractions designed for computing motion descriptors from raw motion capture data in real time.
Stars: ✭ 24 (-20%)
Mutual labels:  real-time
Wetland Hydro Gee
Mapping wetland hydrological dynamics using Google Earth Engine (GEE)
Stars: ✭ 20 (-33.33%)
Mutual labels:  lidar
Fusiondirect.jl
(No maintenance) Detect gene fusion directly from raw fastq files
Stars: ✭ 23 (-23.33%)
Mutual labels:  fusion
Mangosta Ios
MongooseIM client for iOS
Stars: ✭ 28 (-6.67%)
Mutual labels:  real-time
Przm
🎨 A simple, yet feature rich color picker and manipulator
Stars: ✭ 17 (-43.33%)
Mutual labels:  rgb
Fusionless
Python in Black Magic Design's Fusion that sucks less.
Stars: ✭ 12 (-60%)
Mutual labels:  fusion
Rocket.chat
The communications platform that puts data protection first.
Stars: ✭ 31,251 (+104070%)
Mutual labels:  real-time

Awesome-Autonomous-Driving-Papers


This repository provides awesome research papers for autonomous driving perception.
I have tried my best to keep this repository up to date. If you do find a problem or have any suggestions, please raise this as an issue or make a pull request with information (format of the repo): Research paper title, datasets, metrics, objects, source code, publisher, and year.

This summary is categorized into:

Abbreviations

  • AP-2D: Average Precision for 2D detection (on RGB-image space)
  • AP-3D: Average Precision for 3D detection
  • AP-BEV: Average Precision for Birds Eye View
  • AOS: Average Orientation Similarity (if 2D bounding box available)

Datasets

1. LiDAR-based 3D Object Detection

1.1 Single-stage detectors

Research Paper Datasets Metrics Objects Source Code Publisher Year
“HorizonLiDAR3D”: 1st Place Solution for Waymo Open Dataset Challenge - 3D Detection and Domain Adaptation
  • Waymo
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists --- ArXiv 2020
Structure Aware Single-stage 3D Object Detection from Point Cloud (SA-SSD)
  • KITTI
  • AP-3D
  • AP-BEV
Cars PyTorch CVPR 2020
3DSSD: Point-based 3D Single Stage Object Detector
  • KITTI
  • nuScenes
  • AP-3D
  • AP-BEV
Cars PyTorch CVPR 2020
LaserNet: An Efficient Probabilistic 3D Object Detector for Autonomous Driving
  • KITTI
  • ATG4D
  • AP-3D
  • AP-BEV
Cars --- CVPR 2019
PointPillars: Fast Encoders for Object Detection from Point Clouds
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch CVPR 2019
SECOND: Sparsely Embedded Convolutional Detection
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch Sensors 2018
Complex-YOLO: an euler-region-proposal for real-time 3d object detection on point clouds
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch ECCV 2018
YOLO3D: End-to-end real-time 3D Oriented Object Bounding Box Detection from LiDAR Point Cloud
  • KITTI
  • mAP-3D
Cars, Pedestrians, Cyclists PyTorch ECCV 2018
Pixor: Real-time 3d object detection from point clouds
  • KITTI
  • AP-3D
Cars PyTorch CVPR 2018
VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch Tensorflow CVPR 2018
3D Fully Convolutional Network using PointCloud data for Vehicle Detection
  • KITTI
  • AP-3D
  • AOS
Cars Tensorflow IROS 2017

1.2 Two-stage detectors

Research Paper Datasets Metrics Objects Source Code Publisher Year
PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
  • KITTI
  • Waymo
  • AP-3D
Cars PyTorch CVPR 2020
Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud
  • KITTI
  • AP-3D
  • AP-BEV
Cars (1 model), Pedestrians and Cyclists(1 model) Tensorflow CVPR 2020
3D IoU-Net: IoU Guided 3D Object Detector for Point Clouds
  • KITTI
  • AP-3D
  • AP-BEV
Cars --- ArXiv 2020
PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud
  • KITTI
  • AP-3D
Cars, Pedestrians, Cyclists PyTorch CVPR 2019
Patch Refinement - Localized 3D Object Detection
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists --- ArXiv 2019
StarNet: Targeted Computation for Object Detection in Point Clouds
  • KITTI
  • Waymo
  • AP-3D
Cars, Pedestrians, Cyclists PyTorch ArXiv 2019
Part-A^2 Net: 3D Part-Aware and Aggregation Neural Network for Object Detection from Point Cloud
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch ArXiv 2019
Fast Point R-CNN
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists --- ICCV 2019
STD: Sparse-to-Dense 3D Object Detector for Point Cloud
  • KITTI
  • AP-3D
Cars, Pedestrians, Cyclists --- ICCV 2019
Three-dimensional Backbone Network for 3D Object Detection in Traffic Scenes
  • KITTI
  • AP-3D
Cars, Pedestrians, Cyclists PyTorch ICCV 2019
Frustum ConvNet: Sliding Frustums to Aggregate Local Point-Wise Features for Amodal 3D Object Detection
  • KITTI
  • SUN-RGBD
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch IROS 2019
Frustum PointNets for 3D Object Detection from RGB-D Data
  • KITTI
  • SUN-RGBD
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists Tensorflow CVPR 2018

2. Monocular Image-based 3D Object Detection

Research Paper Datasets Metrics Objects Source Code Publisher Year
RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving
  • KITTI
  • AP-3D
  • AP-BEV
  • AOS
Cars PyTorch ECCV 2020
Stereo R-CNN based 3D Object Detection for Autonomous Driving
  • KITTI
  • AP-3D/BEV
  • AP-2D
Cars PyTorch CVPR 2019
M3D-RPN: Monocular 3D Region Proposal Network for Object Detection
  • KITTI
  • AP-3D/BEV
  • AP-2D
Cars, Pedestrians, Cyclists PyTorch ICCV 2019
Mono3D++: Monocular 3D Vehicle Detection with Two-Scale 3D Hypotheses and Task Priors
  • KITTI
  • AP-3D/BEV
  • AP-2D
Cars, Pedestrians, Cyclists --- ArXiv 2019
3D Bounding Box Estimation Using Deep Learning and Geometry
  • KITTI
  • AP
Cars, Cyclists PyTorch CVPR 2017
Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular image
  • KITTI
Cars --- CVPR 2017
Deep MANTA: A Coarse-to-fine Many-Task Network for joint 2D and 3D vehicle analysis from monocular image
  • KITTI
  • AP-2D/3D
  • AOS
Cars Link ICRA 2017

3. LiDAR and RGB Images Fusion

Research Paper Datasets Metrics Objects Source Code Publisher Year
ImVoteNet: Boosting 3D Object Detection in Point Clouds with Image Votes
  • SUN RGB-D
  • AP-3D
37 object categories PyTorch CVPR 2020
Multi-Task Multi-Sensor Fusion for 3D Object Detection
  • KITTI
  • AP-2D
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch CVPR 2019

4. Pseudo-LiDAR

Research Paper Datasets Metrics Objects Source Code Publisher Year
Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Driving
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch ICLR 2020
Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists PyTorch CVPR 2019

5. Training tricks

Research Paper Datasets Metrics Objects Source Code Publisher Year
PPBA: Improving 3D Object Detection through Progressive Population Based Augmentation
  • KITTI
  • AP-3D
  • AP-BEV
Cars, Pedestrians, Cyclists --- ArXiv 2020
Class-balanced Grouping and Sampling for Point Cloud 3D Object Detection
  • KITTI
  • AP-3D
  • AP-BEV
10 object categories PyTorch ArXiv 2019
Weighted Point Cloud Augmentation for Neural Network Training Data Class-Imbalance
  • ScanNet
  • Semantic3D
    --- ArXiv 2019

    6. Object tracking (in progress)

    To do list:

    • [x] Add 3D object detection papers based on LiDAR/monocular images/fusion/pseudo-LiDAR.
    • [x] Add training tricks papers
    • [ ] Add object tracking papers.
    • [ ] Provide download.py script to automatically download .pdf files.

    References

    Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].