RGB-D-λ: 3D Multispectral Acquisition with Stereo RGB Cameras

Alain Trémeau, Simone Bianco, Raimondo Schettini

2016

Abstract

In this paper we report some key questions related to the acquisition of accurate color images adressed by the Colour and Space in Cultural Heritage (COSCH) project. We summarize the main criteria defined by COSCH Working Group 1 and used by the authors to help Digital Cultural Heritage (DCH) users to have a deepen knowledge and understanding of the constraints, preconditions and practical aspects related to the use of a multi-spectral acquisition system. We also report how color data can be estimated from spectral data and discuss several issues related to the measurement of reflective surfaces by 2D imaging systems.

References

  1. Bianco S., Gasparini F., Schettini R., Vanneschi L., 2008. Polynomial modeling and optimization for colorimetric characterization of scanners. Journal of Electronic Imaging, Vol. 17, No. 4, pp. 043002- 043002.
  2. Bianco S., Schettini R., Vanneschi L., 2009. Empirical modeling for colorimetric characterization of digital cameras. IEEE International Conference on Image Processing (ICIP).
  3. Bianco S., Ciocca G., Marini F., Schettini R., 2009. Image quality assessment by preprocessing and full reference model combination. In Proc of IS&T/SPIE Electronic Imaging. International Society for Optics and Photonics, pp. 72420O-72420O.
  4. Bianco S., 2010. Reflectance spectra recovery from tristimulus values by adaptive estimation with metameric shape correction, J. Opt. Soc. Am. A/Vol. 27, No. 8/August, pp 1868-1877.
  5. Bianco S., Cusano C., 2011. Color target localization under varying illumination conditions. Proc of Computational Color Imaging workshop, pp. 245-255.
  6. Bianco S., Bruna A., Naccari F., Schettini R., 2011. Towards the design of low cost colorimetric imaging device. IEEE International Conference on Consumer Electronics-Berlin (ICCE-Berlin), pp. 229-233.
  7. Bianco S., Colombo A., Gasparini F., Schettini R., Zuffi S., 2011. Applications of spectral imaging and reproduction to cultural heritage. Digital Imaging for Cultural Heritage Preservation, pp. 183-209.
  8. Bianco S., Schettini R., 2011. Computational color constancy. 3rd European Workshop on Visual Information Processing (EUVIP), pp. 1-7.
  9. Bianco S., Schettini R., 2012. Sampling optimization for printer characterization by direct search. IEEE Transactions on Image Processing, Vol. 21, No. 12, pp. 4868-4873.
  10. Bianco S., Bruna A., Naccari F., Schettini R., 2012. Color space transformations for digital photography exploiting information about the illuminant estimation process. Journal of the Optical Society of America A, Vol. 29, No. 3, pp. 374-384.
  11. Bianco S., Bruna A., Naccari F., Schettini R., 2013. Color correction pipeline optimization for digital cameras. Journal of Electronic Imaging, Vol. 22, No. 2, pp. 023014-023014.
  12. Bianco S., Schettini R., 2014. Error-Tolerant Color Rendering for Digital Cameras. Journal of Mathematical Imaging and Vision, Vol. 50, No. 3, pp. 235-245.
  13. Bianco S., Cusano C., Schettini R., 2015. Color Constancy Using CNNs, IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).
  14. Boochs F., Trémeau A., Karmacharya A., Reich T., Heinz G., Kato Z. and Tamas L., 2015. Towards a Knowledge Model to Document and Select Algorithms and Processes in Cultural Heritage, Proceedings of Taima, Hammamet, 11-16 june, pp 201-209.
  15. De Lasarte Rigueiro Marta, 2009. Thorough characterization and analysis of a multispectral imaging system developed for colour measurement, PhD Thesis of the Universitat Polytècnica de Catalunya.
  16. Doulamis, Anastasios, et al. 2015. Selective 4D modelling framework for spatial-temporal land information management system", Third International Conference on Remote Sensing and Geoinformation of the Environment. International Society for Optics and Photonics.
  17. Dupont D., 2002. Study of the reconstruction of reflectance curves based on tristimulus values: comparison of methods of optimization, Color Res. Appl. 27, 88-99.
  18. Faridul H. S., Pouli T., Chamaret C., Stauder J., Kuzovkin D., Trémeau A. and Reinhard E., 2015. Color Mapping: A Review of Recent Methods, Extensions, and Applications”, Computer Graphics Forum, to be published.
  19. Hernàndez-Andrés Javier and Romero Javier, 2001. Colorimetric and spectroradiometric characteristics of narrow-field-ofview clear skylight in Granada, Spain, Journal of Optical Society of America A, 18(2), 412- 420.
  20. Imai F. H., 2010. Spectral reproduction from scene to hardcopy: Part I - Multi-spectral acquisition and spectral estimation using a Trichromatic Digital Camera System associated with absorption filters, Report of Munsell Color Science Laboratory, Rochester Institute of Technology, published in http://www.cis.rit.edu/research/mcsl2/research/reports. php#DupontReports (last access 21/07/2015).
  21. Kim Bog G., Han Jeong-won, and Park Soo-been, 2012. Spectral reflectivity recovery from the tristimulus values using a hybrid method, J. Opt. Soc. Am. A / Vol. 29, No. 12 / December, pp 2612-2621.
  22. Kyriakaki, Georgia, et al. 2014. 4D Reconstruction of Tangible Cultural Heritage Objects from WebRetrieved Images, International Journal of Heritage in the Digital Era 3.2: 431-452.
  23. Lahanier C., Schmitt F., 2003. Le Boeuf P. and Aitken G., Multi-spectral Digitisation and 3D Modelling of Paintings and Objects for Image Content Recognition, Image Classification and Multimedia Diffusion. An Ontology Access to the C2RMF Database and Library using the CIDOC-CRM, Intl. Conf. of Museum Digitization, Antiquities, Painting and Calligraphy, November 17-18, Taipei, Taiwan.
  24. Liang H., Saunders D., Cupitt J., and Lahanier C., 2004. Multispectral Imaging for Easel and Wall Paintings, PART 6: “Examination and Documentation Techniques” of the book Conservation of Ancient Sites on the Silk Road, Proceedings of the Second International Conference on the Conservation of Grotto Sites, Mogao Grottoes, Dunhuang, People's Republic of China, June 28-July 3, pp 267-274.
  25. López-Álvarez Miguel A., Hernández-Andrés J., Romero J., Campos J. and Pons A., 2009. Calibrating the Elements of a Multispectral Imaging System, Journal of Imaging Science and Technology, May-Jun., pp 031102-1- 031102-10.
  26. López-Álvarez M.A., Hernández-Andrés J., Valero E.M. and Nieves J.L., 2005. Colorimetric and Spectral Combined Metric for the Optimization of Multispectral Systems, Proc of the 10th Congress of the International Colour Association, pp 1685- 1688.
  27. Makantasis, K., Doulamis A., and Doulamis N. 2013. A non-parametric unsupervised approach for content based image retrieval and clustering, Proceedings of the 4th ACM/IEEE international workshop on Analysis and retrieval of tracked events and motion in imagery stream. ACM.
  28. Peyvandi S. and Amirshahi S. H., 2011. Generalized spectral decomposition: a theory and practice to spectral reconstruction, J. Opt. Soc. Am. A, Vol. 28, No. 8 / August, pp 1545-1553.
  29. Ribés A., Schmitt F., Pillay R. and Lahanier C. 2005. Calibration and Spectral Reconstruction for CRISATEL: An Art Painting Multispectral Acquisition System. Journal of Imaging Science and Technology, 49, pp. 563-573.
  30. Saunders, D., Cupitt, J., 1993. Image processing at the National Gallery: The VASARI Project, National Gallery technical bulletin, 14:72.
  31. Viggiano J. A. S., 2002. A perception-referenced method for comparison of radiance ratio spectra and its application as an index of metamerism, Proc. of the 9th Congress of the International Colour Association, NY, pp. 701-704.
  32. Zuffi S., Santini S., and Schettini R., 2008. From Color Sensor Space to Feasible Reflectance Spectra, IEEE Transactions on Signal Processing, Vol. 56, No. 2, pp 518-531
Download


Paper Citation


in Harvard Style

Trémeau A., Bianco S. and Schettini R. (2016). RGB-D-λ: 3D Multispectral Acquisition with Stereo RGB Cameras . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 689-696. DOI: 10.5220/0005845406890696


in Bibtex Style

@conference{rgb-spectralimaging16,
author={Alain Trémeau and Simone Bianco and Raimondo Schettini},
title={RGB-D-λ: 3D Multispectral Acquisition with Stereo RGB Cameras},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)},
year={2016},
pages={689-696},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005845406890696},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)
TI - RGB-D-λ: 3D Multispectral Acquisition with Stereo RGB Cameras
SN - 978-989-758-175-5
AU - Trémeau A.
AU - Bianco S.
AU - Schettini R.
PY - 2016
SP - 689
EP - 696
DO - 10.5220/0005845406890696