CODED APERTURE STEREO - For Extension of Depth of Field and Refocusing

Yuichi Takeda, Shinsaku Hiura, Kosuke Sato

Abstract

Image acquisition techniques using coded apertures have been intensively investigated to improve the performance of image deblurring and depth estimation. Generally, estimation of the scene depth is a key issue in the recovery of optical blur because the size of the blur kernel varies according to the depth. However, since it is hard to estimate the depth of a scene with a single image, most successful methods use several images with different optical parameters captured by a specially developed camera with expensive internal optics. On the other hand, a stereo camera configuration is widely used to obtain the depth map of a scene. Therefore, in this paper, we propose a method for deblurring and depth estimation using a stereo camera with coded apertures. Our system configuration offers several advantages. First, coded apertures make not only deconvolution but also stereo matching very robust, because the loss of high spatial frequency domain information in the blurred image is well suppressed. Second, the size of the blur kernel is linear with the disparity of the stereo images, making calibration of the system very easy. The proof of this linearity is given in this paper together with several experimental results showing the advantages of our method.

References

  1. Green, P., Sun, W., Matusik, W., and Durand, F. (2007). Multi-aperture photography. In ACM SIGGRAPH 2007 papers, SIGGRAPH 7807, New York, NY, USA. ACM.
  2. Hiura, S. and Matsuyama, T. (1998). Depth measurement by the multi-focus camera. In Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference on, pages 953 -959.
  3. Lam, E. Y. and Goodman, J. W. (2000). Iterative statistical approach to blind image deconvolution. J. Opt. Soc. Am. A, 17(7):1177-1184.
  4. Levin, A. (2010). Analyzing depth from coded aperture sets. In Proceedings of the 11th European conference on Computer vision: Part I, ECCV'10, pages 214- 227, Berlin, Heidelberg. Springer-Verlag.
  5. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. (2007). Image and depth from a conventional camera with a coded aperture. In ACM SIGGRAPH 2007 papers, SIGGRAPH 7807, New York, NY, USA. ACM.
  6. Liang, C.-K., Lin, T.-H., Wong, B.-Y., Liu, C., and Chen, H. H. (2008). Programmable aperture photography: multiplexed light field acquisition. In ACM SIGGRAPH 2008 papers, SIGGRAPH 7808, pages 55:1- 55:10, New York, NY, USA. ACM.
  7. Nayar, S., Watanabe, M., and Noguchi, M. (1995). Realtime focus range sensor. In Computer Vision, 1995. Proceedings., Fifth International Conference on, pages 995 -1001.
  8. Richardson, W. H. (1972). Bayesian-based iterative method of image restoration. J. Opt. Soc. Am., 62(1):55-59.
  9. Schechner, Y. Y. and Kiryati, N. (2000). Depth from defocus vs. stereo: How different really are they? Int. J. Comput. Vision, 39:141-162.
  10. Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., and Tumblin, J. (2007). Dappled photography: mask enhanced cameras for heterodyned light fields and coded aperture refocusing. ACM Trans. Graph., 26.
  11. Zhou, C., Lin, S., and Nayar, S. (2009). Coded aperture pairs for depth from defocus. In Computer Vision, 2009 IEEE 12th International Conference on, pages 325 -332.
  12. Zhou, C. and Nayar, S. (2009). What are good apertures for defocus deblurring? In Computational Photography (ICCP), 2009 IEEE International Conference on, pages 1 -8.
Download


Paper Citation


in Harvard Style

Takeda Y., Hiura S. and Sato K. (2012). CODED APERTURE STEREO - For Extension of Depth of Field and Refocusing . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-03-7, pages 103-111. DOI: 10.5220/0003818801030111


in Bibtex Style

@conference{visapp12,
author={Yuichi Takeda and Shinsaku Hiura and Kosuke Sato},
title={CODED APERTURE STEREO - For Extension of Depth of Field and Refocusing},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={103-111},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003818801030111},
isbn={978-989-8565-03-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)
TI - CODED APERTURE STEREO - For Extension of Depth of Field and Refocusing
SN - 978-989-8565-03-7
AU - Takeda Y.
AU - Hiura S.
AU - Sato K.
PY - 2012
SP - 103
EP - 111
DO - 10.5220/0003818801030111