Using Recurrent Neural Networks for Action and Intention Recognition of Car Drivers

Martin Torstensson, Boris Duran, Cristofer Englund

2019

Abstract

Traffic situations leading up to accidents have been shown to be greatly affected by human errors. To reduce these errors, warning systems such as Driver Alert Control, Collision Warning and Lane Departure Warning have been introduced. However, there is still room for improvement, both regarding the timing of when a warning should be given as well as the time needed to detect a hazardous situation in advance. Two factors that affect when a warning should be given are the environment and the actions of the driver. This study proposes an artificial neural network-based approach consisting of a convolutional neural network and a recurrent neural network with long short-term memory to detect and predict different actions of a driver inside a vehicle. The network achieved an accuracy of 84% while predicting the actions of the driver in the next frame, and an accuracy of 58% 20 frames ahead with a sampling rate of approximately 30 frames per second.

Paper Citation

in Harvard Style

Torstensson M., Duran B. and Englund C. (2019). Using Recurrent Neural Networks for Action and Intention Recognition of Car Drivers.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 232-242. DOI: 10.5220/0007682502320242

in Bibtex Style

@conference{icpram19,
author={Martin Torstensson and Boris Duran and Cristofer Englund},
title={Using Recurrent Neural Networks for Action and Intention Recognition of Car Drivers},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={232-242},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007682502320242},
isbn={978-989-758-351-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Using Recurrent Neural Networks for Action and Intention Recognition of Car Drivers
SN - 978-989-758-351-3
AU - Torstensson M.
AU - Duran B.
AU - Englund C.
PY - 2019
SP - 232
EP - 242
DO - 10.5220/0007682502320242