Practical Depth Estimation with Image Segmentation and Serial U-Nets

Kyle Cantrell, Craig Miller, Carlos Morato

2020

Abstract

Knowledge of environmental depth is required for successful autonomous vehicle navigation and VSLAM. Current autonomous vehicles utilize range-finding solutions such as LIDAR, RADAR, and SONAR that suffer drawbacks in both cost and accuracy. Vision-based systems offer the promise of cost-effective, accurate, and passive depth estimation to compete with existing sensor technologies. Existing research has shown that it is possible to estimate depth from 2D monocular vision cameras using convolutional neural networks. Recent advances suggest that depth estimate accuracy can be improved when networks used for supplementary tasks such as semantic segmentation are incorporated into the network architecture. A novel Serial U-Net (NU-Net) architecture is introduced as a modular, ensembling technique for combining the learned features from N-many U-Nets into a single pixel-by-pixel output. Serial U-Nets are proposed to combine the benefits of semantic segmentation and transfer learning for improved depth estimation accuracy. The performance of Serial U-Net architectures are characterized by evaluation on the NYU Depth V2 benchmark dataset and by measuring depth inference times. Autonomous vehicle navigation can substantially benefit by leveraging the latest in depth estimation and deep learning.

Paper Citation

in Harvard Style

Cantrell K., Miller C. and Morato C. (2020). Practical Depth Estimation with Image Segmentation and Serial U-Nets.In Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS, ISBN 978-989-758-419-0, pages 406-414. DOI: 10.5220/0009781804060414

in Bibtex Style

@conference{vehits20,
author={Kyle Cantrell and Craig Miller and Carlos Morato},
title={Practical Depth Estimation with Image Segmentation and Serial U-Nets},
booktitle={Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,},
year={2020},
pages={406-414},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009781804060414},
isbn={978-989-758-419-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,
TI - Practical Depth Estimation with Image Segmentation and Serial U-Nets
SN - 978-989-758-419-0
AU - Cantrell K.
AU - Miller C.
AU - Morato C.
PY - 2020
SP - 406
EP - 414
DO - 10.5220/0009781804060414