A Unified Framework for Coarse-to-Fine Recognition of Traffic Signs using Bayesian Network and Visual Attributes

Hamed Habibi Aghdam, Elnaz Jahani Heravi, Domenec Puig

2015

Abstract

Recently, impressive results have been reported for recognizing the traffic signs. Yet, they are still far from the real-world applications. To the best of our knowledge, all methods in the literature have focused on numerical results rather than applicability. First, they are not able to deal with novel inputs such as the false-positive results of the detection module. In other words, if the input of these methods is a non-traffic sign image, they will classify it into one of the traffic sign classes. Second, adding a new sign to the system requires retraining the whole system. In this paper, we propose a coarse-to-fine method using visual attributes that is easily scalable and, importantly, it is able to detect the novel inputs and transfer its knowledge to the newly observed sample. To correct the misclassified attributes, we build a Bayesian network considering the dependency between the attributes and find their most probable explanation using the observations. Experimental results on the benchmark dataset indicates that our method is able to outperform the state-of-art methods and it also possesses three important properties of novelty detection, scalability and providing semantic information.

References

  1. Bascn, S. M., Rodrguez, J. A., Arroyo, S. L., Caballero, A. F., and Lpez-Ferreras, F. (2010). An optimization on pictogram identification for the road-sign recognition task using fSVMsg. Computer Vision and Image Understanding, 114(3):373 - 383.
  2. Cheng, K. and Tan, X. (2014). Sparse representations based attribute learning for flower classification. Neurocomputing, 145(0):416 - 426.
  3. Cirean, D., Meier, U., Masci, J., and Schmidhuber, J. (2012). Multi-column deep neural network for traffic sign classification. Neural Networks, 32(0):333 - 338. Selected Papers from fIJCNNg 2011.
  4. Ciresan, D., Meier, U., Masci, J., and Schmidhuber, J. (2011). A committee of neural networks for traffic sign classification. In Neural Networks (IJCNN), The 2011 International Joint Conference on, pages 1918- 1921.
  5. Farhadi, A., Endres, I., Hoiem, D., and Forsyth, D. (2009). Describing objects by their attributes. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 1778-1785.
  6. Ferrari, V. and Zisserman, A. (2007). Learning visual attributes. In Advances in Neural Information Processing Systems.
  7. Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., and Igel, C. (2013). Detection of traffic signs in real-world images: The German Traffic Sign Detection Benchmark. In International Joint Conference on Neural Networks, number 1288.
  8. Lampert, C., Nickisch, H., and Harmeling, S. (2009). Learning to detect unseen object classes by betweenclass attribute transfer. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pages 951-958.
  9. Lee, H., Battle, A., Raina, R., and Ng, A. Y. (2007). Efficient sparse coding algorithms. In Schölkopf, B., Platt, J., and Hoffman, T., editors, Advances in Neural Information Processing Systems 19, pages 801-808. MIT Press.
  10. Liu, H., Liu, Y., and Sun, F. (2014). Traffic sign recognition using group sparse coding. Information Sciences, 266(0):75 - 89.
  11. Maldonado-Bascon, S., Lafuente-Arroyo, S., Gil-Jimenez, P., Gomez-Moreno, H., and Lopez-Ferreras, F. (2007). Road-sign detection and recognition based on support vector machines. Intelligent Transportation Systems, IEEE Transactions on, 8(2):264-278.
  12. Mogelmose, A., Trivedi, M., and Moeslund, T. (2012). Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey. Intelligent Transportation Systems, IEEE Transactions on, 13(4):1484-1497.
  13. Paclik, P., Novovicova, J., and Duin, R. P. W. (2006). Building road sign classifiers using trainable similarity measure. IEEE Transactions on Intelligent Transportation Systems, 7(3):309-321. to appear.
  14. Piccioli, G., Micheli, E. D., Parodi, P., and Campani, M. (1996). A robust method for road sign detection and recognition.
  15. Rohrbach, M., Stark, M., Szarvas, G., Gurevych, I., and Schiele, B. (2010). What helps where - and why? semantic relatedness for knowledge transfer. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  16. Russakovsky, O. and Fei-Fei, L. (2012). Attribute learning in large-scale datasets. In Proceedings of the 11th European Conference on Trends and Topics in Computer Vision - Volume Part I, ECCV'10, pages 1-14, Berlin, Heidelberg. Springer-Verlag.
  17. Sermanet, P. and LeCun, Y. (2011). Traffic sign recognition with multi-scale convolutional networks. In Neural Networks (IJCNN), The 2011 International Joint Conference on, pages 2809-2813.
  18. Stallkamp, J., Schlipsing, M., Salmen, J., and Igel, C. (2012). Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition. Neural Networks, 32(0):323 - 332. Selected Papers from fIJCNNg 2011.
  19. Sun, Z.-L., Wang, H., Lau, W.-S., Seet, G., and Wang, D. (2014). Application of bw-elm model on traffic sign recognition. Neurocomputing, 128(0):153 - 159.
  20. Wang, G., Ren, G., Wu, Z., Zhao, Y., and Jiang, L. (2013). A hierarchical method for traffic sign classification with support vector machines. In Neural Networks (IJCNN), The 2013 International Joint Conference on, pages 1-6.
  21. Zaklouta, F. and Stanciulescu, B. (2011). Warning traffic sign recognition using a hog-based k-d tree. In Intelligent Vehicles Symposium (IV), 2011 IEEE, pages 1019-1024.
  22. Zaklouta, F. and Stanciulescu, B. (2014). Real-time traffic sign recognition in three stages. Robotics and Autonomous Systems, 62(1):16 - 24. New Boundaries of Robotics.
Download


Paper Citation


in Harvard Style

Habibi Aghdam H., Jahani Heravi E. and Puig D. (2015). A Unified Framework for Coarse-to-Fine Recognition of Traffic Signs using Bayesian Network and Visual Attributes . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 87-96. DOI: 10.5220/0005303500870096


in Bibtex Style

@conference{visapp15,
author={Hamed Habibi Aghdam and Elnaz Jahani Heravi and Domenec Puig},
title={A Unified Framework for Coarse-to-Fine Recognition of Traffic Signs using Bayesian Network and Visual Attributes},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={87-96},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005303500870096},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - A Unified Framework for Coarse-to-Fine Recognition of Traffic Signs using Bayesian Network and Visual Attributes
SN - 978-989-758-090-1
AU - Habibi Aghdam H.
AU - Jahani Heravi E.
AU - Puig D.
PY - 2015
SP - 87
EP - 96
DO - 10.5220/0005303500870096