Vehicle Pair Activity Classification using QTC and Long Short Term Memory Neural Network

Rahulan Radhakrishnan, Alaa Alzoubi

2022

Abstract

The automated recognition of vehicle interaction is crucial for self-driving, collision avoidance and security surveillance applications. In this paper, we present a novel Long-Short Term Memory Neural Network (LSTM) based method for vehicle trajectory classification. We use Qualitative Trajectory Calculus (QTC) to represent the relative motion between a pair of vehicles. The spatio-temporal features of the interacting vehicles are captured as a sequence of QTC states and then encoded using one hot vector representation. Then, we develop an LSTM network to classify QTC trajectories that represent vehicle pairwise activities. Most of the high performing LSTM models are manually designed and require expertise in hyperparameter configuration. We adapt Bayesian Optimisation method to find an optimal LSTM architecture for classifying QTC trajectories of vehicle interaction. We evaluated our method on three different datasets comprising 7257 trajectories of 9 unique vehicle activities in different traffic scenarios. We demonstrate that our proposed method outperforms the state-of-the-art techniques. Further, we evaluated our approach with a combined dataset of the three datasets and achieved an error rate of no more than 1.79%. Though, our work mainly focuses on vehicle trajectories, the proposed method is generic and can be used on pairwise analysis of other interacting objects.

Paper Citation

in Harvard Style

Radhakrishnan R. and Alzoubi A. (2022). Vehicle Pair Activity Classification using QTC and Long Short Term Memory Neural Network. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 236-247. DOI: 10.5220/0010903500003124

in Bibtex Style

@conference{visapp22,
author={Rahulan Radhakrishnan and Alaa Alzoubi},
title={Vehicle Pair Activity Classification using QTC and Long Short Term Memory Neural Network},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP},
year={2022},
pages={236-247},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010903500003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP
TI - Vehicle Pair Activity Classification using QTC and Long Short Term Memory Neural Network
SN - 978-989-758-555-5
AU - Radhakrishnan R.
AU - Alzoubi A.
PY - 2022
SP - 236
EP - 247
DO - 10.5220/0010903500003124
PB - SciTePress