k-fold Subsampling based Sequential Backward Feature Elimination

Jeonghwan Park, Kang Li, Huiyu Zhou

2016

Abstract

We present a new wrapper feature selection algorithm for human detection. This algorithm is a hybrid feature selection approach combining the benefits of filter and wrapper methods. It allows the selection of an optimal feature vector that well represents the shapes of the subjects in the images. In detail, the proposed feature selection algorithm adopts the k-fold subsampling and sequential backward elimination approach, while the standard linear support vector machine (SVM) is used as the classifier for human detection. We apply the proposed algorithm to the publicly accessible INRIA and ETH pedestrian full image datasets with the PASCAL VOC evaluation criteria. Compared to other state of the arts algorithms, our feature selection based approach can improve the detection speed of the SVM classifier by over 50% with up to 2% better detection accuracy. Our algorithm also outperforms the equivalent systems introduced in the deformable part model approach with around 9% improvement in the detection accuracy.

References

  1. Alpaydin, E. (2004). In Introduction to Machine Learning. The MIT Press.
  2. Battiti, R. (1994). In Using Mutual Information for Selecting Features in Supervised Neural Net Learning. IEEE Transactions on Neural Networks, Vol. 5, No. 4.
  3. Bermejo, P., Gamez, J. A., and Puerta, J. M. (2011). In Improving Incremental Wrapper-based Subset Selection via Replacement and Early Stopping. International Journal of Pattern Recognition and Artificial Intelligence. Vol. 25.
  4. Chandrashekar, G. and Sahinn, F. (2014). In A survey on feature selection methods. Journal of Computers and Electrical Engineering 40, P. 16-28.
  5. Dalal, N. and Triggs, B. (2006). In Histograms of Oriented Gradients for Human Detection. IEEE Conference on Computer Vision and Pattern Recognition.
  6. Dollár, P., Wojek, C., Schiele, B., and Perona, P. (2009). In Pedestrian Detection: A benchmark. IEEE Conference on Computer Vision and Pattern Recognition.
  7. Dollár, P., Wojek, C., Schiele, B., and Perona, P. (2012). In Pedestrian Detection: An Evaluation of the State of the Art. IEEE Transactions on Pattern Analysis and Machine Intelligence.
  8. Ess, A., Leibe, B., Schindler, K., , and van Gool, L. (2008). In A Mobile Vision System for Robust Multi-Person Tracking. IEEE Conference on Computer Vision and Pattern Recognition.
  9. Estevez, P. A., Tesmer, M., Perez, C. A., and Zurada, J. M. (2009). In Normalized Mutual Information Feature Selection. IEEE Transactions on Neural Networks, Vol. 20, No.2.
  10. Everingham, M., Zisserman, A., Williams, C., and Gool, L. (2007). In The PASCAL visual obiect classes challenge 2007 results. Technical Report, PASCAL challenge 2007.
  11. Felzenszwalb, P., Girshick, R., McAllester, D., and Ramanan, D. (2010). In Object Detection with Discriminatively Trained Part Based Models. IEEE Conference on Computer Vision and Pattern Recognition.
  12. Felzenszwalb, P., McAllester, D., and Ramanan, D. (2008). In A Discriminatively Trained, Multiscale, Deformable Part Model. IEEE Conference on Computer Vision and Pattern Recognition.
  13. Foithong, S., Pinngern, O., and Attachoo, B. (2012). In Feature Subset Selection Wrapper based on Mutual Information and Rough sets. Journal of Expert Systems with Applications 39, P.574-584, Elsevier.
  14. Gutlein, M., Frank, E., Hall, M., and Karwath, A. (2009). In Large-scale attribute selection using wrappers. IEEE Symposium Series on Computational Intelligence and Data Mining.
  15. Guyon, I. and Elisseeff, A. (2003). In An Introduction to Variable and Feature Selection. Journal of Machine Learning Research 3, 1157-1182.
  16. Heng, C. K., Yokomitsu, S., Matsumoto, Y., and Tmura, H. (2012). In Shrink Boost for Selecting Multi-LBP Histogram Features in Object Detection. IEEE Conference on Computer Vision and Pattern Recognition.
  17. Javed, K., Babri, H. A., and Saeed, M. (2012). In Feature Selection Based on Class-Dependent Densities for High-Dimensional Binary Data. IEEE Transactions on Knowledge and Data Engineering, Vol. 24, P. 465-477.
  18. Kohavi, R. and John, G. H. (1997). In Wrappers for feature subset selection. Artificial Intelligence.
  19. Li, K. and Peng, J. (2007). In Neural Input Selection - A fast model-based approach. Journal of Neurocomputing, Vol. 70, P. 762-769.
  20. Peng, H., Long, F., , and Ding, C. (2005). In Feature Selection Based on Mutual Information: Criteria of MaxDependency, Max-Relevance, and Min-Redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 27, No. 8.
  21. Pohjalainen, J., Rasanen, O., and Kadioglu, S. (2013). In Feature Selection methods and Their combinations in High-dimensional Classification of Speaker Likability, Intelligibility and Personality Traits. Journal of Computer Speech and Language. Elsevier.
  22. Ruiz, R., Riquelme, J., and Aguilar-Ruiz, J. S. (2006). In Incremental wrapper-based gene selection from microarray data for cancer classification. Pattern Recognition, Vol. 39.
  23. Vazquez, D., Marin, J., Lopez, A., Ponsa, D., and Geronimo, D. (2014). In Virtual and Real World Adaptation for Pedestrian Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence.
  24. Vergara, J. R. and Esteves, P. A. (2014). In A review of Feature Selection method based on Mutual Information. Journal of Neural Computing and Applications 24, 175-186.
  25. Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., and Pan, Y. (2012). In A Multimedia Retrieval Framework Based on Semi-Supervised Ranking and Relevance Feedback. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 34, No. 4, P. 723-742.
  26. Zhou, H., Miller, P., and Zhang, J. (2011). In Age classification using Radon transform and entropy based scaling SVM. British Machine Vision Conference.
Download


Paper Citation


in Harvard Style

Park J., Li K. and Zhou H. (2016). k-fold Subsampling based Sequential Backward Feature Elimination . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 423-430. DOI: 10.5220/0005688804230430


in Bibtex Style

@conference{icpram16,
author={Jeonghwan Park and Kang Li and Huiyu Zhou},
title={k-fold Subsampling based Sequential Backward Feature Elimination},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={423-430},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005688804230430},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - k-fold Subsampling based Sequential Backward Feature Elimination
SN - 978-989-758-173-1
AU - Park J.
AU - Li K.
AU - Zhou H.
PY - 2016
SP - 423
EP - 430
DO - 10.5220/0005688804230430