Combined Bilateral Filter for Enhanced Real-time Upsampling of Depth Images

Oliver Wasenmüller, Gabriele Bleser, Didier Stricker

2015

Abstract

Highly accurate depth images at video frame rate are required in many areas of computer vision, such as 3D reconstruction, 3D video capturing or manufacturing. Nowadays low cost depth cameras, which deliver a high frame rate, are widely spread but suffer from a high level of noise and a low resolution. Thus, a sophisticated real time upsampling algorithm is strongly required. In this paper we propose a new sensor fusion approach called Combined Bilateral Filter (CBF) together with the new Depth Discontinuity Preservation (DDP) post processing, which combine the information of a depth and a color sensor. Thereby we especially focus on two drawbacks that are common in related algorithms namely texture copying and upsampling without depth discontinuity preservation. The output of our algorithm is a higher resolution depth image with essentially reduced noise, no aliasing effects, no texture copying and very sharply preserved edges. In a ground truth comparison our algorithm was able to reduce the mean error up to 73% within around 30ms. Furthermore, we compare our method against other state of the art algorithms and obtain superior results.

References

  1. Aodha, O. M., Campbell, N. D., Nair, A., and Brostow, G. J. (2012). Patch based synthesis for single depth image super-resolution. In Proceedings of the European Conference on Computer Vision (ECCV), pages 71-84. Springer.
  2. Canny, J. (1986). A computational approach to edge detection. In Transactions on Pattern Analysis and Machine Intelligence (PAMI), volume 6, pages 679-698. IEEE.
  3. Cui, Y., Schuon, S., Chan, D., Thrun, S., and Theobalt, C. (2010). 3D shape scanning with a time-of-flight camera. In Conference on Computer Vision and Pattern Recognition (CVPR), pages 1173-1180. IEEE.
  4. Diebel, J. and Thrun, S. (2005). An application of markov random fields to range sensing. In Advances in neural information processing systems (NIPS), pages 291- 298. NIPS.
  5. Kim, C., Yu, H., and Yang, G. (2011). Depth super resolution using bilateral filter. In International Congress on Image and Signal Processing (CISP), volume 2, pages 1067-1071. IEEE.
  6. Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. (2007). Joint bilateral upsampling. In ACM Transactions on Graphics (TOG), volume 26, page 96. ACM.
  7. Scharstein, D. and Szeliski, R. (2003). High-accuracy stereo depth maps using structured light. In Conference on Computer Vision and Pattern Recognition (CVPR), volume 1, pages 1-195. IEEE.
  8. Schuon, S., Theobalt, C., Davis, J., and Thrun, S. (2009). LidarBoost: Depth superresolution for ToF 3D shape scanning. In Conference on Computer Vision and Pattern Recognition (CVPR), pages 343-350. IEEE.
  9. Tomasi, C. and Manduchi, R. (1998). Bilateral filtering for gray and color images. In International Conference on Computer Vision (ICCV), pages 839-846. IEEE.
  10. Yang, Q., Yang, R., Davis, J., and Nistér, D. (2007). Spatialdepth super resolution for range images. In Conference on Computer Vision and Pattern Recognition (CVPR), pages 1-8. IEEE.
Download


Paper Citation


in Harvard Style

Wasenmüller O., Bleser G. and Stricker D. (2015). Combined Bilateral Filter for Enhanced Real-time Upsampling of Depth Images . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 5-12. DOI: 10.5220/0005234800050012


in Bibtex Style

@conference{visapp15,
author={Oliver Wasenmüller and Gabriele Bleser and Didier Stricker},
title={Combined Bilateral Filter for Enhanced Real-time Upsampling of Depth Images},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={5-12},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005234800050012},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Combined Bilateral Filter for Enhanced Real-time Upsampling of Depth Images
SN - 978-989-758-089-5
AU - Wasenmüller O.
AU - Bleser G.
AU - Stricker D.
PY - 2015
SP - 5
EP - 12
DO - 10.5220/0005234800050012