SHADOW MODELING AND DETECTION FOR ROBUST FOREGROUND SEGMENTATION IN HIGHWAY SCENARIOS

Katherine Batista, Rui Caseiro, Jorge Batista

2010

Abstract

This paper presents a method to automatically model and detect shadows on highway surveillance scenarios. This approach uses a cascade of two classifiers. The first stage of this method uses a weak classifier to ascertain the color information of possibly shadowed pixels which will be used by the second stage of this method (strong classifier). The weak classifier estimates the Color Normalized Cross-Correlation (CNCC) and the color information of the pixels identified as shadow, will be used to build or update multi-layered statistical shadow models of the RGB appearance of shadow. These models will then be used, by the strong classifier, to correctly distinguish shadow. To prevent misclassifications from corrupting the results of both classifiers, spatial dependencies are also taken into account. For this purpose, nonparametric kernel density estimators in a pyramidal decomposition (PKDE), as well as, Markov Random Fields (MRF) were independently employed. This technique is being used in a real outdoor traffic surveillance system in order to minimize the effects of cast vehicle shadows as well as shadows induced by illumination changes. Several results are presented in this paper to prove its effectiveness and the advantages of applying spatial contextualization methods to the weak and strong classifiers.

References

  1. Bishop, C. M. (2006). Pattern Recognition in Machine Learning. Springer.
  2. Boykov, Y. and Kolmogorov, V. (2004). An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 26(9):1124-1137.
  3. Cavallaro, A., Salvador, E., and Ebrahimi, T. (2005). Shadow-aware object-based video processing. IEEE Proceedings - Vision, Image and Signal Processing, 152(4):398-406.
  4. Cucchiara, R., Grana, C., Piccardi, M., and Prati, A. (2003). Detecting moving objects, ghosts, and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10):1337-1342.
  5. Ford, L. R. and Fulkerson, D. R. (1962). Flows in Networks. Princeton University Press.
  6. Greig, D. M., Porteous, B. T., and Seheult, A. H. (1989). Exact maximum a posteriori estimation for binary images. Royal Statistical Soc., Series B, 51:271-279.
  7. Grest, D., michael Frahm, J., and Koch, R. (2003). A color similarity measure for robust shadow removal in real time. In Proc. of Vision, Modeling, and Visualization (VMV).
  8. Horprasert, T., Harwood, D., and Davis, L. S. (1999). A statistical approach for real-time robust background subtraction and shadow detection. In ICCV Frame-Rate WS.
  9. Huang, J. B. and Chen, C. S. (2008). Learning Moving Cast Shadows for Foreground Detection. In The Eighth International Workshop on Visual Surveillance - VS2008, Marseille France. Graeme Jones and Tieniu Tan and Steve Maybank and Dimitrios Makris.
  10. Kolmogorov, V. and Zabih, R. (2004). What energy functions can be minimized via graph cuts? IEEE Transactions on Pattern Analysis and Machine Intelligence, 26:147-159.
  11. Liu, Z., Huang, K., Tan, T., and Wang, L. (2007). Cast shadow removal combining local and global features. Computer Vision and Pattern Recognition, IEEE Computer Society Conference on, 0:1-8.
  12. Martel Brisson, N. and Zaccarin, A. (2007). Learning and removing cast shadows through a multidistribution approach. IEEE Trans. Pattern Anal. Mach. Intell., 29(7):1133-1146.
  13. Mittal, A. and Paragios, N. (2004). Motion-based background subtraction using adaptive kernel density estimation. volume 2, pages II-302-II-309 Vol.2.
  14. Monteiro, G., Marcos, J., Ribeiro, M., and Batista, J. (2008). Robust segmentation for outdoor traffic surveillance. In ICIP, pages 2652-2655.
  15. Porikli, F. and Thornton, J. (2005). Shadow flow: A recursive method to learn moving cast shadows. Computer Vision, IEEE International Conference on, 1:891- 898.
  16. Porikli, F. and Tuzel, O. (2005). Bayesian background modeling for foreground detection. In ACM International Workshop on Video Surveillance and Sensor Networks (VSSN), pages 55-28.
  17. Prati, A., Mikic, I., Trivedi, M. M., and Cucchiara, R. (2003). Detecting moving shadows: Algorithms and evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(7):918-923.
  18. Wand, M. P. and Jones, M. C. (1994). Kernel Smoothing (Monographs on Statistics and Applied Probability). Chapman & Hall/CRC.
  19. Zhong, J. and Sclaroff, S. (2003). Segmenting foreground objects from a dynamic textured background via a robust kalman filter. Computer Vision, IEEE International Conference on, 1:44.
Download


Paper Citation


in Harvard Style

Batista K., Caseiro R. and Batista J. (2010). SHADOW MODELING AND DETECTION FOR ROBUST FOREGROUND SEGMENTATION IN HIGHWAY SCENARIOS . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010) ISBN 978-989-674-029-0, pages 148-157. DOI: 10.5220/0002823401480157


in Bibtex Style

@conference{visapp10,
author={Katherine Batista and Rui Caseiro and Jorge Batista},
title={SHADOW MODELING AND DETECTION FOR ROBUST FOREGROUND SEGMENTATION IN HIGHWAY SCENARIOS},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010)},
year={2010},
pages={148-157},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002823401480157},
isbn={978-989-674-029-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2010)
TI - SHADOW MODELING AND DETECTION FOR ROBUST FOREGROUND SEGMENTATION IN HIGHWAY SCENARIOS
SN - 978-989-674-029-0
AU - Batista K.
AU - Caseiro R.
AU - Batista J.
PY - 2010
SP - 148
EP - 157
DO - 10.5220/0002823401480157