All Projects → cedricxie → Apollo_perception_ros

cedricxie / Apollo_perception_ros

Object detection / tracking / fusion based on Apollo r3.0.0 perception module in ROS

Projects that are alternatives of or similar to Apollo perception ros

Apollo
An open autonomous driving platform
Stars: ✭ 19,814 (+10969.27%)
Mutual labels:  apollo, autonomous-driving, self-driving-car, autonomous-vehicles
Visualizing-lidar-data
Visualizing lidar data using Uber Autonomous Visualization System (AVS) and Jupyter Notebook Application
Stars: ✭ 75 (-58.1%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
Dig Into Apollo
Apollo notes (Apollo学习笔记) - Apollo learning notes for beginners.
Stars: ✭ 903 (+404.47%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
Lidarobstacledetection
Lidar Obstacle Detection
Stars: ✭ 90 (-49.72%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
Rtm3d
Unofficial PyTorch implementation of "RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving" (ECCV 2020)
Stars: ✭ 211 (+17.88%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
dig-into-apollo
Apollo notes (Apollo学习笔记) - Apollo learning notes for beginners.
Stars: ✭ 1,786 (+897.77%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
SelfDrivingRCCar
Autonomous RC Car using Neural Networks, Python and Open CV
Stars: ✭ 102 (-43.02%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
SelfDrivingCarsControlDesign
Self Driving Cars Longitudinal and Lateral Control Design
Stars: ✭ 96 (-46.37%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
WIMP
[arXiv] What-If Motion Prediction for Autonomous Driving ❓🚗💨
Stars: ✭ 80 (-55.31%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
Error-State-Extended-Kalman-Filter
Vehicle State Estimation using Error-State Extended Kalman Filter
Stars: ✭ 100 (-44.13%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
Self Driving Golf Cart
Be Driven 🚘
Stars: ✭ 147 (-17.88%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
Awesome Self Driving Car
An awesome list of self-driving cars
Stars: ✭ 185 (+3.35%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
highway-path-planning
My path-planning pipeline to navigate a car safely around a virtual highway with other traffic.
Stars: ✭ 39 (-78.21%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
BtcDet
Behind the Curtain: Learning Occluded Shapes for 3D Object Detection
Stars: ✭ 104 (-41.9%)
Mutual labels:  self-driving-car, autonomous-driving, autonomous-vehicles
Carla
Open-source simulator for autonomous driving research.
Stars: ✭ 7,012 (+3817.32%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
Autonomousdrivingcookbook
Scenarios, tutorials and demos for Autonomous Driving
Stars: ✭ 1,939 (+983.24%)
Mutual labels:  autonomous-driving, self-driving-car, autonomous-vehicles
Rc car ros
ROS package to control an autonomous RC vehicle based on Raspberry Pi3
Stars: ✭ 30 (-83.24%)
Mutual labels:  self-driving-car, autonomous-vehicles
Duckietown.jl
Differentiable Duckietown
Stars: ✭ 29 (-83.8%)
Mutual labels:  self-driving-car, autonomous-vehicles
Constrained attention filter
(ECCV 2020) Tensorflow implementation of A Generic Visualization Approach for Convolutional Neural Networks
Stars: ✭ 36 (-79.89%)
Mutual labels:  autonomous-driving, autonomous-vehicles
Autonomous driving
Ros package for basic autonomous lane tracking and object detection
Stars: ✭ 67 (-62.57%)
Mutual labels:  autonomous-driving, autonomous-vehicles

Apollo Perception Standalone in ROS

Apollo is the most mature and sophisticated autonomous driving platform that is open source right now.

However, there are some limitations.

  • Apollo (r3.0) is built upon a customized ROS environment, which is not compatible with normal ROS packages / plugins.
  • Apollo (r3.5) abandons ROS and uses Cyber RT instead.
  • If you want to understand their code and test it with your own application, you will need to have a good understanding of their framework before you can make any modifications.

Have you wondered, what if everything can be run as a standard ROS node and you can use all the familiar tools that are available in ROS? Then this repository is what you need!

Apollo Perception Architecture
Apollo Perception Architecture
Apollo Perception Overview
Apollo Perception Overview
Demo of Perception
Perception with demo-2.0.bag

The obstacle perception module in Apollo (r3.0) is extracted and modified so that it can be run as a normal ROS node. Everything is inside docker environment. Detailed steps of building and running the perception module are listed as follows.

I myself find learning Apollo's approach in perception very beneficial to helping me understand how the perception architecture is set up. I hope you find this repo useful as well.

All contributions are welcome!! There are so many things that can be improved. Please raise issues and/or make pull requests if you would like to work on it too. Thank you.

Environment Information

The system is tested on Nvidia GeForce GTX 1080 Ti and 1070 Max-Q. Please install Nvidia Driver, Docker, and Nvidia Docker.

Dependencies Image Environment
Nvidia Driver (Tested on 384.130) Ubuntu 14.04
Nvidia Docker (Tested on 2) Cuda 8.0 + Cudnn 7

Building and Running

  1. Clone Repository in Host
mkdir ~/shared_dir && cd ~/shared_dir
git clone https://github.com/cedricxie/apollo_perception_ros
  1. Pull Dokcer Image
    docker pull cedricxie/apollo-perception-ros

  2. Enter Docker Container
    cd ~/shared_dir/apollo_perception_ros && ./docker/run.sh

  3. Make ROS Packages

cd ~/shared_dir/apollo_perception_ros/
catkin build
source devel/setup.bash
  1. Launch Perception Node
    roslaunch vehicle_base detect_sim.launch

  2. Playback Demo-2.0.bag from Apollo
    rosbag play demo-2.0.bag --clock
    The bag can be downloaded at Apollo Data Open Platform, Vehicle System Demo Data, with file name demo-sensor-data-apollo-2.0.tar.gz.

Known issues

  1. During building process, an error such as follows might occur. Usually do catkin build again can skip the problem. I am still trying to figure out how to complete solve it. Let me know if you find out a solution.
/usr/include/c++/4.8/bits/c++0x_warning.h:32:2: error: #error This file requires compiler and library support for the ISO C++ 2011 standard. This support is currently experimental, and must be enabled with the -std=c++11 or -std=gnu++11 compiler options.
  1. Continental radar detection messages are in Protobuf format inside the ROS bag. Therefore it is not currently supported. However if you have your own radar, you can utilize the modest radar detector in the perception module to integrate into the system.

To Do:

  1. Add ego motion compensation.
  2. Add sequence type fuser
  3. Add Prediction / Planning modules.
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].