Generic and Real-time Detection of Specular Reflections in Images

Alexandre Morgand, Mohamed Tamaazousti

2014

Abstract

In this paper, we propose a generic and efficient method for real-time specular reflections detection in images. The method relies on a new thresholding technique applied in the Hue-Saturation-Value (HSV) color space. A detailed experimental study was conducted in this color space to highlight specular reflections’ properties. Current state-of-the-art methods have difficulties with lighting jumps by being too specific or computationally expensive for real-time applications. Our method addresses this problem using the following three steps: an adaptation of the contrast of the image to handle lighting jumps, an automatic thresholding to isolate specular reflections and a post-processing step to further reduce the number of false detections. This method has been compared with the state-of-the-art according to our two proposed experimental protocols based on contours and gravity center and offers fast and accurate results without a priori on the image in real-time.

References

  1. Arnold, M., Ghosh, A., Ameling, S., and Lacey, G. (2010). Automatic segmentation and inpainting of specular highlights for endoscopic imaging. Journal on Image and Video Processing, 2010:9.
  2. Blake, A. and Brelstaff, G. (1988). Geometry from specularities. International Conference on Computer Vision, pages 394-403.
  3. Brelstaff, G. and Blake, A. (1988). Detecting specular reflections using lambertian constraints. In International Conference on Computer Vision, ICCV.
  4. Deng, Y., Manjunath, B., and Shin, H. (1999). Color image segmentation. In Computer Vision and Pattern Recognition, CVPR.
  5. Feris, R., Raskar, R., Tan, K.-H., and Turk, M. (2006). Specular highlights detection and reduction with multi-flash photography. Journal of the Brazilian Computer Society, 12(1):35-42.
  6. Jachnik, J., Newcombe, R. A., and Davison, A. J. (2012). Real-time surface light-field capture for augmentation of planar specular. In International Symposium on Mixed and Augmented Reality, ISMAR.
  7. Karsch, K., Hedau, V., Forsyth, D., and Hoiem, D. (2011). Rendering synthetic objects into legacy photographs. ACM Transactions on Graphics (TOG), 30(6):157.
  8. Lagger, P., Salzmann, M., Lepetit, V., and Fua, P. (2008). 3d pose refinement from reflections. In Computer Vision and Pattern Recognition, CVPR.
  9. Lambert, J. H. and DiLaura, D. L. (2001). Photometry, or, on the measure and gradations of light, colors, and shade:translation from the Latin of photometria, sive, de mensura et gradibus luminis, colorum et umbrae.
  10. Lee, S.-T., Yoon, T.-H., Kim, K.-S., Kim, K.-D., and Park, W. (2010). Removal of specular reflections in tooth color image by perceptron neural nets. In International Conference on Signal Processing Systems, ICSPS.
  11. Lee, S. W. and Bajcsy, R. (1992). Detection of specularity using color and multiple views. In European Conference on Computer Vision, ECCV.
  12. Oh, J., Hwang, S., Lee, J., Tavanapong, W., Wong, J., and de Groen, P. C. (2007). Informative frame classification for endoscopy video. Medical Image Analysis, 11(2):110-127.
  13. Ortiz, F. and Torres, F. (2005). A new inpainting method for highlights elimination by colour morphology. In Pattern Recognition and Image Analysis, pages 368- 376.
  14. Ortiz, F. and Torres, F. (2006). Automatic detection and elimination of specular reflectance in color images by means of ms diagram and vector connected filters. Systems, Man, and Cybernetics, Part C: Applications and Reviews, 36(5):681-687.
  15. Park, J. B. and Kak, A. C. (2003). A truncated least squares approach to the detection of specular highlights in color images. In International Conference on Robotics and Automation, ICRA.
  16. Saint-Pierre, C.-A., Boisvert, J., Grimard, G., and Cheriet, F. (2011). Detection and correction of specular reflections for automatic surgical tool segmentation in thoracoscopic images. Machine Vision and Applications, 22(1):171-180.
  17. Shafer, S. A. (1985). Using color to separate reflection components. Color Research & Application, 10(4):210- 218.
  18. Sillion, F. and Puech, C. (1989). A general two-pass method integrating specular and diffuse reflection. In Special Interest Group on GRAPHics and Interactive Techniques, SIGGRAPH.
  19. Stehle, T. (2006). Removal of specular reflections in endoscopic images. Acta Polytechnica: Journal of Advanced Engineering, 46(4):32-36.
  20. Suzuki and Satoshi (1985). Topological structural analysis of digitized binary images by border following. Computer Vision, Graphics, and Image Processing, 30(1):32-46.
  21. Tan, R. T., Nishino, K., and Ikeuchi, K. (2004). Separating reflection components based on chromaticity and noise analysis. Pattern Analysis and Machine Intelligence, 26(10):1373-1379.
  22. Torres, F., Angulo, J., and Ortiz, F. (2003). Automatic detection of specular reflectance in colour images using the ms diagram. In Computer Analysis of Images and Patterns, CAIP.
Download


Paper Citation


in Harvard Style

Morgand A. and Tamaazousti M. (2014). Generic and Real-time Detection of Specular Reflections in Images . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 274-282. DOI: 10.5220/0004680102740282


in Bibtex Style

@conference{visapp14,
author={Alexandre Morgand and Mohamed Tamaazousti},
title={Generic and Real-time Detection of Specular Reflections in Images},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={274-282},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004680102740282},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Generic and Real-time Detection of Specular Reflections in Images
SN - 978-989-758-003-1
AU - Morgand A.
AU - Tamaazousti M.
PY - 2014
SP - 274
EP - 282
DO - 10.5220/0004680102740282