Specularity, Shadow, and Occlusion Removal for Planar Objects in Stereo Case

Irina Nurutdinova, Ronny Hänsch, Vincent Mühler, Stavroula Bourou, Alexandra I. Papadaki, Olaf Hellwich

2017

Abstract

Specularities, shadows, and occlusions are phenomena that commonly occur in images and cause a loss of information. This paper addresses the task to detect and remove all these phenomena simultaneously in order to obtain a corrected image with all information visible and recognizable. The proposed (semi-)automatic algorithm utilizes two input images that depict a planar object. The images can be acquired without special equipment (such as flash systems) or restrictions on the spatial camera layout. Experiments were performed for various combinations of objects, phenomena occurring, and capturing conditions. The algorithm perfectly detects and removes specularities in all examined cases. Shadows and occlusions are satisfactorily detected and removed with minimal user intervention in the majority of the performed experiments.

References

  1. Artusi, A., Banterle, F., and Chetverikov, D. (2011). A survey of specularity removal methods. In Computer Graphics Forum, volume 30, pages 2208-2230. Wiley Online Library.
  2. Biasotti, S., Tarini, M., and Giachetti, A. (2015). Mobile multiview diffuse texture extraction. In Smart Tools and Applications in Computer Graphics, pages 113- 120. Eurographics Association.
  3. Feris, R., Raskar, R., Tan, K. H., and Turk, M. (2004). Specular reflection reduction with multi-flash imaging. In Computer Graphics and Image Processing, Proceedings of the 17th Brazilian Symposium, pages 316-321. IEEE.
  4. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. In Communications of the ACM, volume 24(6), pages 381-395.
  5. Guo, R., Dai, Q., and Hoiem, D. (2011). Single-image shadow detection and removal using paired regions. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference, pages 2033-2040. IEEE.
  6. Klinker, G. J., Shafer, S. A., and Kanade, T. (1988). The measurement of highlights in color images. International Journal of Computer Vision, 2(1):7-32.
  7. Laffont, P.-Y., Bousseau, A., and Drettakis, G. (2013). Rich intrinsic image decomposition of outdoor scenes from multiple views. IEEE transactions on visualization and computer graphics, 19(2):210-224.
  8. Lin, S., Li, Y., Kang, S. B., Tong, X., and Shum, H. Y. (2002). Diffuse-specular separation and depth recovery from image sequences. In European conference on computer vision, pages 210-224. Springer Berlin Heidelberg.
  9. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2):91-110.
  10. Ma, W. C., Hawkins, T., Peers, P., Chabert, C. F., Weiss, M., and Debevec, P. (2007). Rapid acquisition of specular and diffuse normal maps from polarized spherical gradient illumination. In In Proceedings of the 18th Eurographics conference on Rendering Techniques, pages 183-194. Eurographics Association.
  11. Mallick, S. P., Zickler, T., Belhumeur, P. N., and Kriegman, D. J. (2006). Specularity removal in images and videos: A pde approach. In European Conference on Computer Vision, pages 550-563. Springer Berlin Heidelberg.
  12. Murali, S. and Govindan, V. K. (2013). Shadow detection and removal from a single image using lab color space. Cybernetics and information technologies, 13(1):95-103.
  13. Nurutdinova, I., Hänsch, R., Mühler, V., Bourou, S., and Papadaki, A. I. (2016). Project Website. http:// www.rhaensch.de/specular.html.
  14. Peréz, P., Gangnet, M., and Blake, A. (2003). Poisson image editing. In ACM Transactions on Graphics (TOG), volume 22(3), pages 313-318. ACM.
  15. Sun, J., Li, Y., Kang, S. B., and Shum, H. Y. (2005). Symmetric stereo matching for occlusion handling. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), volume 2, pages 399-406. IEEE.
  16. van den Bergh, M., Boix, X., Roig, G., and van Gool, L. (2015). Seeds: Superpixels extracted via energydriven sampling. International Journal of Computer Vision (IJCV), 111(3):298-314.
  17. Weiss, Y. (2001). Deriving intrinsic images from image sequences. In Computer Vision, 2001. ICCV 2001. Proceedings. Eighth IEEE International Conference on, volume 2, pages 68-75. IEEE.
  18. Yang, J., Liu, L., and Li, S. (2013). Separating specular and diffuse reflection components in the hsi color space. In Proceedings of the IEEE International Conference on Computer Vision Workshops, pages 891-898.
  19. Zitnick, C. L. and Kanade, T. (2000). A cooperative algorithm for stereo matching and occlusion detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(7):675-684.
Download


Paper Citation


in Harvard Style

Nurutdinova I., Hänsch R., Mühler V., Bourou S., I. Papadaki A. and Hellwich O. (2017). Specularity, Shadow, and Occlusion Removal for Planar Objects in Stereo Case . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 98-106. DOI: 10.5220/0006166100980106


in Bibtex Style

@conference{visapp17,
author={Irina Nurutdinova and Ronny Hänsch and Vincent Mühler and Stavroula Bourou and Alexandra I. Papadaki and Olaf Hellwich},
title={Specularity, Shadow, and Occlusion Removal for Planar Objects in Stereo Case},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={98-106},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006166100980106},
isbn={978-989-758-225-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - Specularity, Shadow, and Occlusion Removal for Planar Objects in Stereo Case
SN - 978-989-758-225-7
AU - Nurutdinova I.
AU - Hänsch R.
AU - Mühler V.
AU - Bourou S.
AU - I. Papadaki A.
AU - Hellwich O.
PY - 2017
SP - 98
EP - 106
DO - 10.5220/0006166100980106