GAdaBoost: Accelerating Adaboost Feature Selection with Genetic Algorithms

Mai F. Tolba, Mohamed Moustafa

2016

Abstract

Boosted cascade of simple features, by Viola Jones, is one of the most famous object detection frameworks. However, it suffers from a lengthy training process. This is due to the vast features space and the exhaustive search nature of Adaboost. In this paper we propose GAdaboost: a Genetic Algorithm to accelerate the training procedure through natural feature selection. Specifically, we propose to limit Adaboost search within a subset of the huge feature space, while evolving this subset following a Genetic Algorithm. Experiments demonstrate that our proposed GAdaboost is up to 3.7 times faster than Adaboost. We also demonstrate that the price of this speedup is a mere decrease (3%, 4%) in detection accuracy when tested on FDDB benchmark face detection set, and Caltech Web Faces respectively.

References

  1. Angelova, A., Abu-Mostafa, Y., and Perona, P. (2005). Pruning training sets for learning of object categories. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1:494-501.
  2. Chouaib, H., Terrades, O. R., Tabbone, S., Cloppet, F., and Vincent, N. (2008). Feature selection combining genetic algorithm and adaboost classifiers. In Pattern Recognition, 2008. ICPR 2008. 19th International Conference on, pages 1-4.
  3. Dezhen, Z. and Kai, Y. (2008). Genetic algorithm based optimization for adaboost. In Computer Science and Software Engineering, 2008 International Conference on, volume 1, pages 1044-1047.
  4. Dimashova, M. (2012). How is decision tree split quality computed. http://answers.opencv.org/question/566/ how-is-decision-tree-split-quality-computed/.
  5. Everingham, M., Gool, L. V., Williams, C. K. I., and Winn, J. (2010). The P ASCAL Visual Object Classes ( VOC ) Challenge. International Journal, pages 303-338.
  6. Fei-Fei, L., Fergus, R., and Perona, P. (2004). Learning Generative Visual Models From Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories. In IEEE CVPR Workshop of Generative Model Based Vision (WGMBV).
  7. Ferri, F., Pudil, P., Hatef, M., and Kittler, J. (1994). Comparative study of techniques for large-scale feature selection*. In GELSEMA, E. S. and KANAL, L. S., editors, Pattern Recognition in Practice IVMultiple Paradigms, Comparative Studies and Hybrid Systems, volume 16 of Machine Intelligence and Pattern Recognition, pages 403 - 413. North-Holland.
  8. Freund, Y. and Schapire, R. (1995). A desicion-theoretic generalization of on-line learning and an application to boosting. Computational learning theory, 55:119- 139.
  9. Itseez (2015). Open source computer vision library. https://github.com/itseez/opencv.
  10. Jain, V. and Learned-Miller, E. (2010). Fddb: A benchmark for face detection in unconstrained settings. Technical Report UM-CS-2010-009, University of Massachusetts, Amherst.
  11. Lienhart, R. and Maydt, J. (2002). An extended set of Haar-like features for rapid object detection. Proceedings. International Conference on Image Processing, 1:900-903.
  12. Lillywhite, K., Lee, D. J., Tippetts, B., and Archibald, J. (2013). A feature construction method for general object recognition. Pattern Recognition, 46(12):3300- 3314.
  13. Sun, Z., Bebis, G., and Miller, R. (2004). Object detection using feature subset selection. Pattern Recognition, 37(11):2165-2176.
  14. Tabassum, M. and Mathew, K. (2014). A Genetic Algorithm Analysis towards Optimization solutions. International Journal of Digital Information and Wireless Communications (IJDIWC), 4(1):124-142.
  15. Viola, P. and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, 1.
  16. Xue, B., Zhang, M., Member, S., and Browne, W. N. (2015). A Survey on Evolutionary Computation Approaches to Feature Selection. 2007(September):1- 20.
Download


Paper Citation


in Harvard Style

F. Tolba M. and Moustafa M. (2016). GAdaBoost: Accelerating Adaboost Feature Selection with Genetic Algorithms . In Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 1: ECTA, (IJCCI 2016) ISBN 978-989-758-201-1, pages 156-163. DOI: 10.5220/0006041101560163


in Bibtex Style

@conference{ecta16,
author={Mai F. Tolba and Mohamed Moustafa},
title={GAdaBoost: Accelerating Adaboost Feature Selection with Genetic Algorithms},
booktitle={Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 1: ECTA, (IJCCI 2016)},
year={2016},
pages={156-163},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006041101560163},
isbn={978-989-758-201-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 1: ECTA, (IJCCI 2016)
TI - GAdaBoost: Accelerating Adaboost Feature Selection with Genetic Algorithms
SN - 978-989-758-201-1
AU - F. Tolba M.
AU - Moustafa M.
PY - 2016
SP - 156
EP - 163
DO - 10.5220/0006041101560163