Hard Spatio-Multi Temporal Attention Framework for Driver Monitoring at Nighttime

Karam Abdullah, Karam Abdullah, Imen Jegham, Mohamed Mahjoub, Anouar Ben Khalifa, Anouar Ben Khalifa

2023

Abstract

Driver distraction and inattention is recently reported to be the major factor in traffic crashes even with the appearance of various advanced driver assistance systems. In fact, driver monitoring is a challenging vision-based task due to the high number of issues present including the dynamic and cluttered background and high in-vehicle actions similarities. This task becomes more and more complex at nighttime because of the low illumination. In this paper, to efficiently recognize driver actions at nighttime, we unprecedentedly propose a hard spatio-multi-temporal attention network that exclusively focuses on dynamic spatial information of the driving scene and more specifically driver motion, then using a batch split unit only relevant temporal information is considered in the classification. Experiments prove that our proposed approach achieves high recognition accuracy compared to state-of-the art-methods on the unique realistic available dataset 3MDAD.

Paper Citation

in Harvard Style

Abdullah K., Jegham I., Mahjoub M. and Ben Khalifa A. (2023). Hard Spatio-Multi Temporal Attention Framework for Driver Monitoring at Nighttime. In Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-626-2, pages 51-61. DOI: 10.5220/0011637400003411

in Bibtex Style

@conference{icpram23,
author={Karam Abdullah and Imen Jegham and Mohamed Mahjoub and Anouar Ben Khalifa},
title={Hard Spatio-Multi Temporal Attention Framework for Driver Monitoring at Nighttime},
booktitle={Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2023},
pages={51-61},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011637400003411},
isbn={978-989-758-626-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Hard Spatio-Multi Temporal Attention Framework for Driver Monitoring at Nighttime
SN - 978-989-758-626-2
AU - Abdullah K.
AU - Jegham I.
AU - Mahjoub M.
AU - Ben Khalifa A.
PY - 2023
SP - 51
EP - 61
DO - 10.5220/0011637400003411