SHADOW AND SPECULAR REMOVAL BY PHOTOMETRIC LINEARIZATION BASED ON PCA WITH OUTLIER EXCLUSION

Takahiro Mori, Shinsaku Hiura, Kosuke Sato

Abstract

The photometric linearization method converts real images, including various photometric components such as diffuse reflection, specular reflection, attached and cast shadow, into images with diffuse reflection components only, which satisfies the Lambertian law. The conventional method(Mukaigawa et al., 2007) based on a random sampling framework successfully achieves the task; however, it contains two problems. The first is that the three basis images selected from the input images by the user seriously affect the linearization result quality. The other is that it takes a long time to process the enormous number of random samples needed to find the correct answer probabilistically. We therefore propose a novel algorithm using the PCA (principal component analysis) method with outlier exclusion. We used knowledge of photometric phenomena for the outlier detection and the experiments show that the method provides fast and precise linearization results.

References

  1. Belhumeur, P. and Kriegman, D. (1996). What is the set of images of an object under all possible lighting conditions? In cvpr, page 270. Published by the IEEE Computer Society.
  2. Fischler, M. and Bolles, R. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395.
  3. Georghiades, A., Belhumeur, P., and Kriegman, D. (2001). From few to many: Illumination cone models for face recognition under variable lighting and pose. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 23(6):643-660.
  4. Ikeuchi, K. and Sato, K. (1991). Determining reflectance properties of an object using range and brightness images. IEEE Transactions on Pattern Analysis and Machine Intelligence, pages 1139-1153.
  5. Klinker, G., Shafer, S., and Kanade, T. (1988). The measurement of highlights in color images. International Journal of Computer Vision, 2(1):7-32.
  6. Mukaigawa, Y., Ishii, Y., and Shakunaga, T. (2007). Analysis of photometric factors based on photometric linearization. JOSA A, 24(10):3326-3334.
  7. Mukaigawa, Y., Miyaki, H., Mihashi, S., and Shakunaga, T. (2001). Photometric image-based rendering for image generation in arbitrary illumination. In Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on, volume 2, pages 652-659. IEEE.
  8. Nayar, S., Fang, X., and Boult, T. (1993). Removal of specularities using color and polarization. In Computer Vision and Pattern Recognition, 1993. Proceedings CVPR'93., 1993 IEEE Computer Society Conference on, pages 583-590. IEEE.
  9. Sato, Y. and Ikeuchi, K. (1994). Temporal-color space analysis of reflection. JOSA A, 11(11):2990-3002.
  10. Sato, Y., Wheeler, M., and Ikeuchi, K. (1997). Object shape and reflectance modeling from observation. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques, pages 379-387. ACM Press/Addison-Wesley Publishing Co.
  11. Shafer, S. (1985). Using color to separate reflection components from a color image. Color Research and Applications, 10(4):210-218.
  12. Shashua, A. (1992). Geometry and photometry in 3D visual recognition. PhD thesis, Citeseer.
  13. Wolff, L. and Boult, T. (1991). Constraining object features using a polarisation reflectance model. IEEE Trans. Patt. Anal. Mach. Intell, 13:635-657.
Download


Paper Citation


in Harvard Style

Mori T., Hiura S. and Sato K. (2012). SHADOW AND SPECULAR REMOVAL BY PHOTOMETRIC LINEARIZATION BASED ON PCA WITH OUTLIER EXCLUSION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-03-7, pages 221-229. DOI: 10.5220/0003817202210229


in Bibtex Style

@conference{visapp12,
author={Takahiro Mori and Shinsaku Hiura and Kosuke Sato},
title={SHADOW AND SPECULAR REMOVAL BY PHOTOMETRIC LINEARIZATION BASED ON PCA WITH OUTLIER EXCLUSION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={221-229},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003817202210229},
isbn={978-989-8565-03-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)
TI - SHADOW AND SPECULAR REMOVAL BY PHOTOMETRIC LINEARIZATION BASED ON PCA WITH OUTLIER EXCLUSION
SN - 978-989-8565-03-7
AU - Mori T.
AU - Hiura S.
AU - Sato K.
PY - 2012
SP - 221
EP - 229
DO - 10.5220/0003817202210229