Novel Parallel Algorithm for Object Recognition with the Ensemble of Classifiers based on the Higher-Order Singular Value Decomposition of Prototype Pattern Tensors

Boguslaw Cyganek, Katarzyna Socha

2014

Abstract

In this paper a novel parallel algorithm for the tensor based classifiers for object recognition in digital images is presented. Classification is performed with an ensemble of base classifiers, each operating in the orthogonal subspaces obtained with the Higher-Order Singular Value Decomposition (HOSVD) of the prototype pattern tensors. Parallelism of the system is realized through the functional and data decompositions on different levels of computations. First, the parallel implementation of the HOSVD is presented. Then, the second level of parallelism is gained by partitioning the input dataset. Each of the partitions is used to train a separate tensor classifiers of the ensemble. Despite the computational speed-up and lower memory requirements, also accuracy of the ensemble showed to be higher compared to a single classifier. The method was tested in the context of object recognition in computer vision. The experiments show high accuracy and accelerated performance both in the training and classification stages.

References

  1. Cichocki, A., Zdunek, R., Amari, S., 2009. Nonnegative Matrix and Tensor Factorization. IEEE Signal Processing Magazine, Vol. 25, No. 1, pp. 142-145.
  2. Chapman, B., Jost, G., Van Der Pas, A.R., 2008. Using OpenMP. Portable Shared Memory Parallel Programming. MIT Press.
  3. Cyganek, B., 2010. An Analysis of the Road Signs Classification Based on the Higher-Order Singular Value Decomposition of the Deformable Pattern Tensors, Lecture Notes in Computer Science, Vol. 6475, Springer, pp. 191-202.
  4. Cyganek, B., 2011. Adding Parallelism to The Hybrid Image Processing Library in Multi-Threading and Multi-Core Systems. IEEE International Conference on Networked Embedded Systems for Enterprise Applications, pp. 103-110.
  5. Cyganek, B., 2012. Ensemble of Tensor Classifiers Based on The Higher-Order Singular Value Decomposition. Lecture Notes in Artificial Intelligence, Vol. 7209, Springer, pp. 578-589.
  6. Cyganek, B., 2013. Object Detection in Digital Images. Theory and Practice, Wiley.
  7. Duda, R. O., Hart, P. E., Stork, D. G. 2000. Pattern Classification. Wiley.
  8. Hull, J., 1994. A Database for Handwritten Text Recognition Research. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 16, No. 5, pp. 550-554.
  9. Intel, 2013. www.intel.com.
  10. Kolda, T. G., Bader, B. W., 2008. Tensor Decompositions and Applications. SIAM Review, Vol. 51, No. 3, pp. 455-500.
  11. Kuncheva, L. I., 2005. Combining Pattern Classifiers. Wiley.
  12. Lathauwer de, L., 1997. Signal Processing Based on Multilinear Algebra. PhD dissertation, Katholieke Universiteit Leuve.
  13. Lathauwer de, L., Moor de, B., Vandewalle, J., 2000. A Multilinear Singular Value Decomposition. SIAM Journal of Matrix Analysis and Applications, Vol. 21, No. 4, pp. 1253-1278.
  14. LeCun, Y., Bottou, L., Bengio, Y., Haffner, P., 1998. Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE on Speech & Image Processing. Vol. 86, No. 11, pp. 2278-2324.
  15. OpenMP, 2013. www.openmp.org.
  16. Polikar, R., 2006. Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine. pp. 21- 45.
  17. Savas, B., Eldén, L., 2007. Handwritten Digit Classification Using Higher Order Singular Value. Pattern Recognition, Vol. 40, No. 3, pp. 993-1003.
  18. Turk, M., Pentland, A., 1991. Eigenfaces for Recognition. Journal of Cognitive Neuroscience Vol. 3, No. 1, pp. 71-86.
  19. Vasilescu, M.A.O., Terzopoulos, D., 2002. Multilinear Analysis of Image Ensembles: TensorFaces, Lecture Notes in Computer Science, Vol. 2350, Springer, pp. 447-460.
Download


Paper Citation


in Harvard Style

Cyganek B. and Socha K. (2014). Novel Parallel Algorithm for Object Recognition with the Ensemble of Classifiers based on the Higher-Order Singular Value Decomposition of Prototype Pattern Tensors . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 648-653. DOI: 10.5220/0004745606480653


in Bibtex Style

@conference{visapp14,
author={Boguslaw Cyganek and Katarzyna Socha},
title={Novel Parallel Algorithm for Object Recognition with the Ensemble of Classifiers based on the Higher-Order Singular Value Decomposition of Prototype Pattern Tensors},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={648-653},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004745606480653},
isbn={978-989-758-004-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)
TI - Novel Parallel Algorithm for Object Recognition with the Ensemble of Classifiers based on the Higher-Order Singular Value Decomposition of Prototype Pattern Tensors
SN - 978-989-758-004-8
AU - Cyganek B.
AU - Socha K.
PY - 2014
SP - 648
EP - 653
DO - 10.5220/0004745606480653