Fast Capture of Spectral Image Series

Sebastian Merzbach, Michael Weinmann, Martin Rump, Reinhard Klein

2017

Abstract

In recent years there has been an increasing interest in multispectral imaging hardware. Among many other applications is the color-correct reproduction of materials. In this paper, we aim at circumventing the limitations of most devices, namely extensive acquisition times for acceptable signal-to-noise-ratios. For this purpose we propose a novel approach to spectral imaging that combines high-quality RGB data and spatial filtering of extremely noisy and sparsely measured spectral information. The capability of handling noisy spectral data allows a dramatic reduction of overall exposure times. The speed-up we achieve allows for spectral imaging at practical acquisition times. We use the RGB images for constraining the reconstruction of dense spectral information from the filtered noisy spectral data. A further important contribution is the extension of a commonly used radiometric calibration method for determining the camera response in the lowest, noise-dominated range of pixel values. We apply our approach both to capturing single high-quality spectral images, as well as to the acquisition of image-based multispectral surface reflectance. Our results demonstrate that we are able to lower the acquisition times for such multispectral reflectance from several days to the few hours necessary for an RGB-based measurement.

References

  1. Green, D. (2011). A colour scheme for the display of astronomical intensity images. arXiv preprint arXiv:1108.5083.
  2. Hagen, N. and Kudenov, M. W. (2013). Review of snapshot spectral imaging technologies. Optical Engineering, 52(9):090901-090901.
  3. Hardeberg, J. Y., Schmitt, F., and Brettel, H. (2002). Multispectral color image capture using a liquid crystal tunable filter. Optical Engineering, 40(10):2532-2548.
  4. Hardeberg, J. Y., Schmitt, F., Brettel, H., Crettez, J.-P., and Maitre, H. (1999). Multispectral image acquisition and simulation of illuminant changes. In Colour Imaging - Vision and Technology, pages 145-164. Wiley.
  5. Hullin, M. B., Hanika, J., Ajdin, B., Seidel, H.-P., Kautz, J., and Lensch, H. P. A. (2010). Acquisition and analysis of bispectral bidirectional reflectance and reradiation distribution functions. ACM Trans. Graph. (Proc. SIGGRAPH 2010), 29(4):97:1-97:7.
  6. Imai, F. H. and Berns, R. (1999). Spectral estimation using trichromatic digital cameras. In Proceedings of the International Symposium on Multispectral Imaging and Color Reproduction, pages 42-49.
  7. Imai, F. H. and Berns, R. S. (1998). High-resolution multispectral image archives: A hybrid approach. Proc. of the IS&T/SID Sixth Color Imaging Conference, pages 224-227.
  8. Krishnan, D. and Fergus, R. (2009). Dark flash photography. In ACM Transactions on Graphics, SIGGRAPH 2009 Conference Proceedings, volume 28.
  9. Matsui, S., Okabe, T., Shimano, M., and Sato, Y. (2009). Image enhancement of low-light scenes with nearinfrared flash images. In Asian Conference on Computer Vision, pages 213-223. Springer.
  10. Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. (2004). Digital photography with flash and no-flash image pairs. ACM transactions on graphics (TOG), 23(3):664-672.
  11. Robertson, M. A., Borman, S., and Stevenson, R. L. (2003). Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Journal of Electronic Imaging, 12(2):219-228.
  12. Rump, M. and Klein, R. (2010). Spectralization: Reconstructing spectra from sparse data. In SR 7810 Rendering Techniques, pages 1347-1354, Saarbruecken, Germany. Eurographics Association.
  13. Rump, M., Sarlette, R., and Klein, R. (2010). Groundtruth data for multispectral bidirectional texture functions. In CGIV 2010, pages 326-330. Society for Imaging Science and Technology.
  14. Rump, M., Zinke, A., and Klein, R. (2011). Practical spectral characterization of trichromatic cameras. ACM Trans. Graph., 30(6).
  15. Schwartz, C., Sarlette, R., Weinmann, M., Rump, M., and Klein, R. (2014). Design and implementation of practical bidirectional texture function measurement devices focusing on the developments at the university of bonn. Sensors, 14(5).
  16. Shrestha, R. and Hardeberg, J. Y. (2014). Evaluation and comparison of multispectral imaging systems. In Color and Imaging Conference, volume 2014, pages 107-112. Society for Imaging Science and Technology.
  17. Takeuchi, K., Tanaka, M., and Okutomi, M. (2013). Lowlight scene color imaging based on luminance estimation from near-infrared flash image. In Proceedings of IEEE International Workshop on Computational Cameras and Displays (formerly PROCAMS)(CCD/PROCAMS2013), pages 1-8.
  18. Tsuchida, M., Arai, H., Nishiko, M., Sakaguchi, Y., Uchiyama, T., Yamaguchi, M., Haneishi, H., and Ohyama, N. (2005). Development of BRDF and BTF measurement and computer-aided design systems based on multispectral imaging. In Proc. AIC Colour 05 - 10th congress of the international colour association, pages 129-132.
Download


Paper Citation


in Harvard Style

Merzbach S., Weinmann M., Rump M. and Klein R. (2017). Fast Capture of Spectral Image Series . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 148-159. DOI: 10.5220/0006175901480159


in Bibtex Style

@conference{grapp17,
author={Sebastian Merzbach and Michael Weinmann and Martin Rump and Reinhard Klein},
title={Fast Capture of Spectral Image Series},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},
year={2017},
pages={148-159},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006175901480159},
isbn={978-989-758-224-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - Fast Capture of Spectral Image Series
SN - 978-989-758-224-0
AU - Merzbach S.
AU - Weinmann M.
AU - Rump M.
AU - Klein R.
PY - 2017
SP - 148
EP - 159
DO - 10.5220/0006175901480159