Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Prediction
Author: Alex Wong [email protected]
If you use this code, please cite the following paper:
A. Wong, B. W. Hong and S. Soatto. Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Prediction.
https://arxiv.org/abs/1903.07309
@article{wong2018bilateral,
title={Bilateral Cyclic Constraint and Adaptive Regularization for Unsupervised Monocular Depth Prediction},
author={Wong, Alex and Hong, Byung-Woo and Soatto, Stefano},
journal={arXiv preprint arXiv:1903.07309},
year={2019}
}
Getting Started
The following guide assumes that you are located in the root directory of this repository
and that you have Tensorflow 1.0+ installed
Create a symbolic link to your dataset directory
ln -s /path/to/data/directory/containing/kitti/root/folder data
where /path/to/data/directory/containing/kitti/root/folder contains your raw KITTI dataset and KITTI 2015 Stereo benchmark
/path/to/data/directory/containing/kitti/root/folder/kitti_raw_data
/path/to/data/directory/containing/kitti/root/folder/kitti_stereo_flow
Run the KITTI data setup script to generate text files containing KITTI training and validation filepaths:
python setup/prep_kitti_eigen_split_data.py
python setup/prep_kitti_kitti_split_data.py
Training the Monocular Disparity Network
For training on KITTI Eigen Split:
python src/train_monodispnet.py \
--trn_im0_path training/eigen_trn_im0.txt \
--trn_im1_path training/eigen_trn_im1.txt \
--learning_rates 1.8e-4,2.0e-4,1.0e-4,5.0e-5 \
--learning_bounds 0.01,0.90,0.95 \
--max_disparity 0.33 \
--w_ph 0.15 \
--w_st 0.85 \
--w_sm 0.10 \
--w_bc 1.05 \
--n_checkpoint 5000 \
--checkpoint_path checkpoints/eigen_model
For training on KITTI KITTI 2015 Split:
python src/train_monodispnet.py \
--trn_im0_path training/kitti_trn_im0.txt \
--trn_im1_path training/kitti_trn_im1.txt \
--learning_rates 1.8e-4,2.0e-4,1.0e-4,5.0e-5 \
--learning_bounds 0.01,0.90,0.95 \
--max_disparity 0.33 \
--w_ph 0.15 \
--w_st 0.85 \
--w_sm 0.10 \
--w_bc 1.05 \
--n_checkpoint 5000 \
--checkpoint_path checkpoints/kitti_model
Evaluation on KITTI Eigen Split and KITTI 2015 Split Benchmark
Run the following script to evaluate your model:
Generating output for KITTI Eigen Split
python src/run_monodispnet.py \
--im0_path testing/eigen_tst_im0.txt \
--restore_path checkpoints/eigen_model/model.ckpt-000000 \
--output_path checkpoints/eigen_model/outputs \
--max_disparity 0.33
Evaluating KITTI Eigen Split
python src/evaluate_kitti.py \
--npy_path checkpoints/eigen_model/outputs/disparities.npy \
--ims_path testing/eigen_tst_im0.txt \
--gts_path testing/eigen_tst_gtd.txt \
--split eigen \
--max_depth 80
Generating output for KITTI KITTI 2015 Split
python src/run_monodispnet.py \
--im0_path testing/kitti_tst_im0.txt \
--restore_path checkpoints/kitti_model/model.ckpt-000000 \
--output_path checkpoints/kitti_model/outputs \
--max_disparity 0.33
Evaluating KITTI 2015 Split
python src/evaluate_kitti.py \
--npy_path checkpoints/kitti_model/outputs/disparities.npy \
--ims_path testing/kitti_tst_im0.txt \
--gts_path testing/kitti_tst_gtd.txt \
--split kitti
Downloading Pre-trained Models
To get the pre-trained models on Eigen and KITTI split and output disparities please visit:
https://tinyurl.com/y2adhhb3