Simultaneous Estimation of Spectral Reflectance and Normal from a Small Number of Images

Masahiro Kitahara, Takahiro Okabe, Christian Fuchs, Hendrik P. A. Lensch

2015

Abstract

Spectral reflectance is inherent characteristics of an object surface and therefore useful not only for computer vision tasks such as material classification but also compute graphics applications such as relighting. In this study, by integrating multispectral imaging and photometric stereo, we propose a method for simultaneously estimating the spectral reflectance and normal per pixel from a small number of images taken under multispectral and multidirectional light sources. In addition, taking attached shadows observed on curved surfaces into consideration, we derive the minimum number of images required for the simultaneous estimation and propose a method for selecting the optimal set of light sources. Through a number of experiments using real images, we show that our proposed method can estimate spectral reflectances without the ambiguity of per-pixel scales due to unknown normals, and that, when the optimal set of light sources is used, our method performs as well as the straightforward method using a large number of images. Moreover, we demonstrated that estimating both the spectral reflectances and normals is useful for relighting under novel illumination conditions.

References

  1. Ajdin, B., Finckh, M., Fuchs, C., Hanika, J., and Lensch, H. (2012). Compressive higher-order sparse and low-rank acquisition with a hyperspectral light stage. Technical report, Eberhard Karls Universität T übingen. WSI-2012-01.
  2. Drbohlav, O. and Chantler, M. (2005). On optimal light configurations in photometric stereo. In Proc. IEEE ICCV2005, volume 2, pages 1707-1712.
  3. Gat, N. (2000). Imaging spectroscopy using tunable filters: a review. In Proc. SPIE Wavelet Applications VII, volume 4056, pages 50-64.
  4. Gu, J. and Liu, C. (2012). Discriminative illumination: per-pixel classification of raw materials based on optimal projections of spectral BRDF. In Proc. IEEE CVPR2012, pages 797-804.
  5. Han, S., Sato, I., Okabe, T., and Sato, Y. (2013). Fast spectral reflectance recovery using DLP projector. IJCV. DOI 10.1007/s11263-013-0687-z.
  6. Okabe, T., Sato, I., and Sato, Y. (2009). Attached shadow coding: estimating surface normals from shadows under unknown reflectance and lighting conditions. In Proc. IEEE ICCV2009, pages 1693-1700.
  7. Park, J.-I., Lee, M.-H., Grossberg, M., and Nayar, S. (2007). Multispectral imaging using multiplexed illumination. In Proc. IEEE ICCV2007, pages 1-8.
  8. Parkkinen, J., Hallikainen, J., and Jaaskelainen, T. (1989). Characteristic spectra of munsell colors. JOSA A, 6(2):318-322.
  9. Schechner, Y. and Nayar, S. (2002). Generalized mosaicing: wide field of view multispectral imaging. IEEE Trans. PAMI, 24(10):1334-1348.
  10. Schechner, Y., Nayar, S., and Belhumeur, P. (2003). A theory of multiplexed illumination. In Proc. IEEE ICCV2003, pages 808-815.
  11. Wellman, J. (1981). Multispectral mapper: imaging spectroscopy as applied to the mapping of earth resources. In Proc. SPIE Imaging Spectroscopy, volume 268, pages 64-73.
  12. Woodham, R. (1980). Photometric method for determining surface orientation from multiple images. Optical Engineering, 19(1):139-144.
  13. Yamaguchi, M., Haneishi, H., Fukuda, H., Kishimoto, J., Kanazawa, H., Tsuchida, M., Iwama, R., and N, O. (2006). High-fidelity video and still-image communication based on spectral information: natural vision system and its applications. In Proc. SPIE-IS&T Electronic Imaging, volume 6062.
Download


Paper Citation


in Harvard Style

Kitahara M., Okabe T., Fuchs C. and P. A. Lensch H. (2015). Simultaneous Estimation of Spectral Reflectance and Normal from a Small Number of Images . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 303-313. DOI: 10.5220/0005302503030313


in Bibtex Style

@conference{visapp15,
author={Masahiro Kitahara and Takahiro Okabe and Christian Fuchs and Hendrik P. A. Lensch},
title={Simultaneous Estimation of Spectral Reflectance and Normal from a Small Number of Images},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={303-313},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005302503030313},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Simultaneous Estimation of Spectral Reflectance and Normal from a Small Number of Images
SN - 978-989-758-089-5
AU - Kitahara M.
AU - Okabe T.
AU - Fuchs C.
AU - P. A. Lensch H.
PY - 2015
SP - 303
EP - 313
DO - 10.5220/0005302503030313