Classifier Ensembles with Trajectory Under-Sampling for Face Re-Identification

Roghayeh Soleymani, Eric Granger, Giorgio Fumera

2016

Abstract

In person re-identification applications, an individual of interest may be covertly tracked and recognized based on trajectories of faces or other distinguishing information captured with video surveillance camera. However, a varying level of imbalance often exists between target and non-target facial captures, and this imbalance level may differ from what was considered during design. The performance of face classification systems typically declines in such cases because, to avoid bias towards the majority class (non-target), they tend to optimize the overall accuracy under a balance class assumption. Specialized classifier ensembles trained on balanced data, where non-target samples are selected through random under-sampling or cluster-based sampling, have been proposed in literature, but they suffer from loss of information and low diversity and accuracy. In this paper, a new ensemble method is proposed for generating a diverse pool of classifiers, each one trained on different levels of class imbalance and complexity for a greater diversity of opinion. Ensembles with Trajectory Under Sampling (EoC-TUS) allows to select subsets of non-target training data based on trajectories information. Variants of these ensembles can give more importance to the most efficient classifiers in identifying target samples, or define efficient and diverse decision boundaries by starting selection of trajectories from the farthest ones to the target class. For validation, experiments are conducted using videos captured in the Faces In Action dataset, and compared to several baseline techniques. The proposed EoC-TUS outperforms state-of-the-art techniques in terms of accuracy and diversity over a range of imbalance levels in the input video.

References

  1. Bedagkar-Gala, A. and Shah, S. K. (2014). A survey of approaches and trends in person re-identification. Image and Vision Computing, 32(4):270-286.
  2. Chang, C.-C. and Lin, C.-J. (2011). Libsvm: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3):27.
  3. Chawla, N. V., Bowyer, K. W., Hall, L. O., and Kegelmeyer, W. P. (2002). Smote: synthetic minority oversampling technique. Journal of artificial intelligence research, 16(1):321-357.
  4. Chawla, N. V., Lazarevic, A., Hall, L. O., and Bowyer, K. W. (2003). Smoteboost: Improving prediction of the minority class in boosting. In Knowledge Discovery in Databases: PKDD 2003, pages 107-119.
  5. De-la Torre, M., Granger, E., Radtke, P. V., Sabourin, R., and Gorodnichy, D. O. (2015a). Partially-supervised learning from facial trajectories for face recognition in video surveillance. Information Fusion, 24:31-53.
  6. De-la Torre, M., Granger, E., and Sabourin, R. (2015b). Adaptive skew-sensitive fusion of ensembles and their application to face re-identification. Pattern Recognition, 48:3385-3406.
  7. Edgar, G. (2007). Measure, topology, and fractal geometry. Springer Science & Business Media.
  8. Fawcett, T. (2006). An introduction to ROC analysis. Pattern recognition letters, 27(8):861-874.
  9. Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., and Herrera, F. (2012). A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, 42(4):463-484.
  10. Goh, R., Liu, L., Liu, X., and Chen, T. (2005). The CMU face in action (FIA) database. In Analysis and Modelling of Faces and Gestures, pages 255-263.
  11. Kubat, M., Matwin, S., et al. (1997). Addressing the curse of imbalanced training sets: one-sided selection. In ICML, volume 97, pages 179-186. Nashville, USA.
  12. Kuncheva, L. I. and Whitaker, C. J. (2003). Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning, 51(2):181-207.
  13. Li, Q., Yang, B., Li, Y., Deng, N., and Jing, L. (2013). Constructing support vector machine ensemble with segmentation for imbalanced datasets. Neural Computing and Applications, 22(1):249-256.
  14. Li, X., Wang, L., and Sung, E. (2008). Adaboost with svm-based component classifiers. Engineering Applications of Artificial Intelligence, 21(5):785-795.
  15. Liu, Y., Yu, X., Huang, J. X., and An, A. (2011). Combining integrated sampling with svm ensembles for learning from imbalanced datasets. Information Processing & Management, 47(4):617-631.
  16. Ojala, T., Pietikainen, M., and Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(7):971-987.
  17. Pagano, C., Granger, E., Sabourin, R., Marcialis, G., and Roli, F. (2014). Adaptive ensembles for face recognition in changing video surveillance environments. Information Sciences, 286:75-101.
  18. Radtke, P. V., Granger, E., Sabourin, R., and Gorodnichy, D. O. (2014). Skew-sensitive boolean combination for adaptive ensembles-an application to face recognition in video surveillance. Information Fusion, 20:31-48.
  19. Rokach, L. (2009). Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliography. Computational Statistics & Data Analysis, 53(12):4046-4072.
  20. Rokach, L. (2010). Ensemble-based classifiers. Intelligence Review, 33(1-2):1-39.
  21. Sammon, J. W. (1969). A nonlinear mapping for data structure analysis. IEEE Transactions on computers, 18(5):401-409.
  22. Satta, R., Fumera, G., Roli, F., Cristani, M., and Murino, V. (2011). A multiple component matching framework for person re-identification. In Image Analysis and Processing-ICIAP 2011, pages 140-149. Springer.
  23. Seiffert, C., Khoshgoftaar, T. M., Van Hulse, J., and Napolitano, A. (2010). Rusboost: A hybrid approach to alleviating class imbalance. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, 40(1):185-197.
  24. Stefanowski, J. and Wilk, S. (2008). Selective preprocessing of imbalanced data for improving classification performance. In Data Warehousing and Knowledge Discovery, pages 283-292. Springer.
  25. Sun, Y., Kamel, M. S., Wong, A. K., and Wang, Y. (2007). Cost-sensitive boosting for classification of imbalanced data. Pattern Recognition, 40(12):3358-3378.
  26. Viola, P. and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, volume 1, pages I-511. IEEE.
  27. Wu, E. Y. G. and Chang, K. (2006). Kernel boundary alignment considering unbalanced data distribution. IEEE Trans. Knowl. Data Eng, 17(6):786-796.
  28. Yan, R., Liu, Y., Jin, R., and Hauptmann, A. (2003). On predicting rare classes with svm ensembles in scene classification. In Acoustics, Speech, and Signal Processing, 2003. Proceedings.(ICASSP'03). 2003 IEEE International Conference on, volume 3, pages III-21. IEEE.
  29. Yen, S.-J. and Lee, Y.-S. (2009). Cluster-based undersampling approaches for imbalanced data distributions. Expert Systems with Applications, 36(3):5718- 5727.
Download


Paper Citation


in Harvard Style

Soleymani R., Granger E. and Fumera G. (2016). Classifier Ensembles with Trajectory Under-Sampling for Face Re-Identification . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 97-108. DOI: 10.5220/0005698300970108


in Bibtex Style

@conference{icpram16,
author={Roghayeh Soleymani and Eric Granger and Giorgio Fumera},
title={Classifier Ensembles with Trajectory Under-Sampling for Face Re-Identification},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={97-108},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005698300970108},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Classifier Ensembles with Trajectory Under-Sampling for Face Re-Identification
SN - 978-989-758-173-1
AU - Soleymani R.
AU - Granger E.
AU - Fumera G.
PY - 2016
SP - 97
EP - 108
DO - 10.5220/0005698300970108