Extracting Dynamics from Multi-dimensional Time-evolving Data using a Bag of Higher-order Linear Dynamical Systems

Kosmas Dimitropoulos, Panagiotis Barmpoutis, Alexandors Kitsikidis, Nikos Grammalidis

2016

Abstract

In this paper we address the problem of extracting dynamics from multi-dimensional time-evolving data. To this end, we propose a linear dynamical model (LDS), which is based on the higher order decomposition of the observation data. In this way, we are able to extract a new descriptor for analyzing data of multiple elements coming from of the same or different data sources. Each sequence of data is modeled as a collection of higher order LDS descriptors (h-LDSs), which are estimated in equally sized temporal segments of data. Finally, each sequence is represented as a term frequency histogram following a bag-of-systems approach, in which h-LDSs are used as feature descriptors. For evaluating the performance of the proposed methodology to extract dynamics from time evolving multidimensional data and using them for classification purposes in various applications, in this paper we consider two different cases: dynamic texture analysis and human motion recognition. Experimental results with two datasets for dynamic texture analysis and two datasets for human action recognition demonstrate the great potential of the proposed method.

References

  1. Avgerinakis, K., Briassouli, A., Kompatsiaris, I., 2012. "Smoke Detection Using Temporal HOGHOF Descriptors and Energy Colour Statistics from Video," in Int'l Workshop on Multi-Sensor Systems and Networks for Fire Detection and Management.
  2. Barmpoutis, P., Dimitropoulos, K., Grammalidis, N., 2014. "Smoke Detection Using Spatio-Temporal Analysis, Motion Modeling and Dynamic Texture Recognition", 22nd European Signal Processing Conference (EUSIPCO 2014), Lisbon, Portugal, 1-5 September.
  3. Boots, B., 2009. Learning stable linear dynamical systems. M.S. Thesis in Machine Learning, Carnegie Mellon University.
  4. Chan, A., Vasconcelos, N., 2005. "Probabilistic Kernels for the Classification of Auto-Regressive Visual Processes," in IEEE Conf. Computer Vision and Pattern Recognition.
  5. Chan, A., Vasconcelos, N., 2007. "Classifying Video with Kernel Dynamic Textures," in IEEE Conf. Computer Vision and Pattern Recognition.
  6. Cock, K. D., Moor, B. D., 2002. "Subspace angles and distances between ARMA models," System and Control Letters, vol. 4, pp. 265-270.
  7. Dimitropoulos, K., Tsalakanidou, F., Grammalidis, N., 2012. "Flame detection for video-based early fire warning systems and 3D visualization of fire propagation," in 13th IASTED Int'l Conf. on Computer Graphics and Imaging.
  8. Dimitropoulos, K., Barboutis, P., Grammalidis, N., 2015. "Spatio-Temporal Flame Modeling and Dynamic Texture Analysis for Automatic Video-Based Fire Detection", IEEE Transactions on Circuits and Systems for Video Technology, vol. 25, no. 2, pp. 339-351.
  9. Doretto, G., Chiuso, A., Wu, Y. N., Soatto, S., 2003. "Dynamic Textures," Int'l J. of Computer Vision, vol. 51, no. 2, pp. 91-109.
  10. Fothergill, S., Mentis, H. M., Kohli, P., Nowozin, S., 2012. Instructing people for training gestural interactive systems. In J. A. Konstan, E. H. Chi, and K. Hook, editors, CHI, pages 1737-1746. ACM.
  11. Kaufman, L., Rousseeuw, P.J., 1987. Clustering by means of Medoids. In Statistical Data Analysis Based on the L1-Norm and Related Methods, edited by Y. Dodge, North-Holland, 405-416.
  12. Kuo, C. T., 2013. "Higher order SVD: theory and algorithms".
  13. McFarlane, N., Schofield, C., 1995. "Segmentation and tracking of piglets in images," British Machine Vision and Applications, vol. 8, pp. 187-193.
  14. Ravichandran, A., Chaudhry, R., Vidal, R., 2013. "Categorizing dynamic textures using a bag of dynamical systems," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 35, no. 2, pp. 342-353, February.
  15. Soatto, S., Doretto, G., Wu, Y., 2001. Dynamic Textures. Intl. Conf. on Computer Vision.
  16. Turaga, P., Veeraraghavan, A., Srivastava A. Chellappa R., 2011. "Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video based Recognition," IEEE Trans. on Pattern Analysis and Machine Intelligence, November.
  17. Vishwanathan, S., Smola, A., Vidal, R., 2007. "BinetCauchy Kernels on Dynamical Systems and Its Application to the Analysis of Dynamic Scenes," Int'l J. Computer Vision, vol. 73, no. 1, pp. 95-119.
  18. Vondrick, C., Khosla, A., Malisiewicz T., Torralba, A., 2013. "HOGgles: Visualizing Object Detection Features," in Int'l Conf. on Computer Vision, Sydney, Australia, December.
Download


Paper Citation


in Harvard Style

Dimitropoulos K., Barmpoutis P., Kitsikidis A. and Grammalidis N. (2016). Extracting Dynamics from Multi-dimensional Time-evolving Data using a Bag of Higher-order Linear Dynamical Systems . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 683-688. DOI: 10.5220/0005844006830688


in Bibtex Style

@conference{rgb-spectralimaging16,
author={Kosmas Dimitropoulos and Panagiotis Barmpoutis and Alexandors Kitsikidis and Nikos Grammalidis},
title={Extracting Dynamics from Multi-dimensional Time-evolving Data using a Bag of Higher-order Linear Dynamical Systems},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)},
year={2016},
pages={683-688},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005844006830688},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: RGB-SpectralImaging, (VISIGRAPP 2016)
TI - Extracting Dynamics from Multi-dimensional Time-evolving Data using a Bag of Higher-order Linear Dynamical Systems
SN - 978-989-758-175-5
AU - Dimitropoulos K.
AU - Barmpoutis P.
AU - Kitsikidis A.
AU - Grammalidis N.
PY - 2016
SP - 683
EP - 688
DO - 10.5220/0005844006830688