All Projects → qinnzou → Robust Lane Detection

qinnzou / Robust Lane Detection

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Robust Lane Detection

Pytorch convlstm
convolutional lstm implementation in pytorch
Stars: ✭ 126 (+14.55%)
Mutual labels:  deep-neural-networks, cnn, lstm
Deepseqslam
The Official Deep Learning Framework for Route-based Place Recognition
Stars: ✭ 49 (-55.45%)
Mutual labels:  deep-neural-networks, cnn, lstm
Pytorch Learners Tutorial
PyTorch tutorial for learners
Stars: ✭ 97 (-11.82%)
Mutual labels:  deep-neural-networks, cnn, lstm
Cfsrcnn
Coarse-to-Fine CNN for Image Super-Resolution (IEEE Transactions on Multimedia,2020)
Stars: ✭ 84 (-23.64%)
Mutual labels:  deep-neural-networks, cnn
Cnn Paper2
🎨 🎨 深度学习 卷积神经网络教程 :图像识别,目标检测,语义分割,实例分割,人脸识别,神经风格转换,GAN等🎨🎨 https://dataxujing.github.io/CNN-paper2/
Stars: ✭ 77 (-30%)
Mutual labels:  deep-neural-networks, cnn
Recursive Cnns
Implementation of my paper "Real-time Document Localization in Natural Images by Recursive Application of a CNN."
Stars: ✭ 80 (-27.27%)
Mutual labels:  dataset, cnn
Irm Based Speech Enhancement Using Lstm
Ideal Ratio Mask (IRM) Estimation based Speech Enhancement using LSTM
Stars: ✭ 66 (-40%)
Mutual labels:  deep-neural-networks, lstm
Face landmark dnn
Face Landmark Detector based on Mobilenet V1
Stars: ✭ 92 (-16.36%)
Mutual labels:  dataset, cnn
End To End Sequence Labeling Via Bi Directional Lstm Cnns Crf Tutorial
Tutorial for End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
Stars: ✭ 87 (-20.91%)
Mutual labels:  cnn, lstm
Pytorch Pos Tagging
A tutorial on how to implement models for part-of-speech tagging using PyTorch and TorchText.
Stars: ✭ 96 (-12.73%)
Mutual labels:  cnn, lstm
Models
DLTK Model Zoo
Stars: ✭ 101 (-8.18%)
Mutual labels:  deep-neural-networks, cnn
Deepzip
NN based lossless compression
Stars: ✭ 69 (-37.27%)
Mutual labels:  cnn, lstm
Satellite Image Deep Learning
Resources for deep learning with satellite & aerial imagery
Stars: ✭ 1,141 (+937.27%)
Mutual labels:  dataset, deep-neural-networks
Dltk
Deep Learning Toolkit for Medical Image Analysis
Stars: ✭ 1,249 (+1035.45%)
Mutual labels:  deep-neural-networks, cnn
Bitcoin Price Prediction Using Lstm
Bitcoin price Prediction ( Time Series ) using LSTM Recurrent neural network
Stars: ✭ 67 (-39.09%)
Mutual labels:  deep-neural-networks, lstm
Cnn lstm for text classify
CNN, LSTM, NBOW, fasttext 中文文本分类
Stars: ✭ 90 (-18.18%)
Mutual labels:  cnn, lstm
Sarcasmdetection
Sarcasm detection on tweets using neural network
Stars: ✭ 99 (-10%)
Mutual labels:  cnn, lstm
Faceaging By Cyclegan
Stars: ✭ 105 (-4.55%)
Mutual labels:  dataset, deep-neural-networks
Lstm Cnn classification
Stars: ✭ 64 (-41.82%)
Mutual labels:  cnn, lstm
Gtsrb
Convolutional Neural Network for German Traffic Sign Recognition Benchmark
Stars: ✭ 65 (-40.91%)
Mutual labels:  deep-neural-networks, cnn

Robust Lane Detection From Continuous Driving Scenes Using Deep Neural Networks

This is the source code of Robust Lane Detection from Continuous Driving Scenes Using Deep Neural Networks. We provide the dataset and the pretrained model.

Zou Q, Jiang H, Dai Q, Yue Y, Chen L and Wang Q, Robust Lane Detection from Continuous Driving Scenes Using Deep Neural Networks, IEEE Transactions on Vehicular Technology, 2019.

Network Architecture

image

Some Results

image image image image image image

tvtLANE Dataset

Description:

This dataset contains 19383 image sequences for lane detection, and 39460 frames of them are labeled. These images were divided into two parts, a training dataset contains 9548 labeled images and augmented by four times, and a test dataset has 1268 labeled images. The size of images in this dataset is 128*256.

  • Training set:
    • Data augmentation: The training set is augmented. By flipping and rotating the images in three degree, the data volume is quadruple. These augmented data are separated from the original training set, which is name as “origin”. “f” and “3d” after “-” are represent for flipping and rotation. Namely, the “origin- 3df” folder is the rotated and flipped training set.
    • Data construction: The original training set contains continuous driving scenes images, and they are divided into images sequences by every twenty. All images are contained in “clips_all”, and there are 19096 sequences for training. Each 13th and 20th frame in a sequence are labeled, and the 38192 image and their labels are in “clips_13(_truth)” and “clips_20(_truth)”. The original training dataset has two parts. Sequences in “0313”, “0531” and “0601” subfolders are constructed on TuSimple lane detection dataset, containing scenes in American highway. The four “weadd” folders are added images in rural road in China.
  • Test set:
    • Testset #1: The normal testset, named Testset #1, is used for testing the overall performance of algorithms. Sequences in “0530”, “0531” and “0601” subfolders are constructed on TuSimple lane dataset. 270 sequences are contained, and each 13th and 20th image is labeled.
    • Testset #2: The Testset #2 is used for testing the robustness of algorithms. 12 kinds of hard scenes for human eyes are contained. All frames are labeled.

Using:

Index are contained. For detecting lanes in continuous scenes, the input size is 5 in our paper. Thus, the former images are additional information to predict lanes in the last frame, and the last frame is the labeled one. We use different sampling strides to get 5 continuous images, as shown below. Each row in the index represents for a sequence and its label for training.image

Download:

You can download this dataset from the link in the 'Dataset-Description-v1.2.pdf' file.
BaiduYun:
https://pan.baidu.com/s/1lE2CjuFa9OQwLIbi-OomTQ passcodes:tf9x Or
Google Drive:
https://drive.google.com/drive/folders/1MI5gMDspzuV44lfwzpK6PX0vKuOHUbb_?usp=sharing

You can also download the pretrained model from the following link,
https://pan.baidu.com/s/1DXy6klAHNmsIjq_g83CGiQ or
https://drive.google.com/drive/folders/1BHbYU3AoU5i2mduMtfUkFHVuYObA_fWt?usp=sharing

All pretrained models can be download at https://pan.baidu.com/s/1u9ABAPouZL2nIMT4E7uAQw
passcodes:w30b

Set up

Requirements

PyTorch 0.4.0
Python 3.6
CUDA 8.0
We run on the Intel Core Xeon [email protected], 64GB RAM and two GeForce GTX TITAN-X GPUs.

Preparation

Data Preparation

Our dataset contains 19383 continuous driving scenes image sequences, and 39460 frames of them are labeled. The size of images is 128*256. The training set contains 19096 image sequences. Each 13th and 20th frame in a sequence are labeled, and the image and their labels are in “clips_13(_truth)” and “clips_20(_truth)”. All images are contained in “clips_all”.
Sequences in “0313”, “0531” and “0601” subfolders are constructed on TuSimple lane detection dataset, containing scenes in American highway. The four “weadd” folders are added images in rural road in China.
The testset has two parts: Testset #1 (270 sequences, each 13th and 20th image is labeled) for testing the overall performance of algorithms. The Testset #2 (12 kinds of hard scenes, all frames are labeled) for testing the robustness of algorithms.
To input the data, we provide three index files(train_index, val_index, and test_index). Each row in the index represents for a sequence and its label, including the former 5 input images and the last ground truth (corresponding to the last frame of 5 inputs). Our dataset can be downloaded and put into "./LaneDetectionCode/data/". If you want to use your own data, please refer to the format of our dataset and indexs.

Pretrained Models

Pretrained models on PyTorch are available using links in the Download part, including the propoesd models(SegNet-ConvLSTM, UNet-ConvLSTM) as well as the comparable two(SegNet, UNet)
You can download them and put them into "./LaneDetectionCode/pretrained/".

Training

Before training, change the paths including "train_path"(for train_index.txt), "val_path"(for val_index.txt), "pretrained_path" in config.py to adapt to your environment.
Choose the models(SegNet-ConvLSTM, UNet-ConvLSTM or SegNet, UNet) and adjust the arguments such as class weights, batch size, learning rate in config.py.
Then simply run:

python train.py

Test

To evlauate the performance of a pre-trained model, please put the pretrained model listed above or your own models into "./LaneDetectionCode/pretrained/" and change "pretrained_path" in config.py at first, then change "test_path" for test_index.txt, and "save_path" for the saved results.
Choose the right model that would be evlauated, and then simply run:

python test.py

The quantitative evaluations of Accuracy, Precision, Recall and F1 measure would be printed, and the result pictures will be save in "./LaneDetectionCode/save/result/".
We have put five images sequences in the "./LaneDetectionCode/data/testset" with test_index_demo.txt on UNet-ConvLSTM for demo. You can run test.py directly to check the performance.

Citation:

Please cite our paper if you use this code or data in your own work:

@article{zou2019tvt,
  title={Robust lane detection from continuous driving scenes using deep neural networks},
  author={Q. Zou and H. Jiang and Q. Dai and Y. Yue and L. Chen and Q. Wang},
  journal={IEEE Transactions on Vehicular Technology},
  volume={69},
  number={1},
  pages={41--54},
  year={2020},
}

Copy Right:

This dataset was collected for academic research only.

Contact:

For any problem about this dataset, please contact Dr. Qin Zou ([email protected]).

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].