Estimating Driver Unawareness of Pedestrian based on Visual Behaviors and Driving Behaviors

Minh Tien Phan, Indira Thouvenin, Vincent Fremont, Véronique Cherfaoui


Taking into account the driver's state is a major challenge for designing new advanced driver assistance systems. In the context of pedestrian safety, a lot of research and many applications are able to detect the pedestrian with in-vehicle sensors and inform the driver of their presence. However, most of these alert systems do not adapt to the driver, they become distracting and are often ignored or deactivated. In this paper, we present a discussion on the danger to pedestrian that is related to the driver. We talk about the problem of pedestrian detectability. We do a review on the methods that help to detect the inattention state of the driver. Finally, we propose a new approach to analyze directly the driver’s awareness or unawareness of pedestrian based on driver’s visual and driving behaviors.


  1. Akamatsu, M.; Sakaguchi, Y. and Okuwa, M. 2003. “Modeling of Driving Behavior When Approaching an Intersection Based on Measured Behavioral Data on An Actual Road”. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47, 1895- 1899.
  2. Akin, M.; Kurt, M.; Sezgin, N. and Bayram, M. 2008.”Estimating vigilance level by using EEG and EMG signals”. Neural Computing and Applications, Springer-Verlag, 17, 227-236.
  3. Arun, S.; Sundaraj, K. & Murugappan, M.2012 “Driver inattention detection methods: A review” Sustainable Utilization and Development in Engineering and Technology (STUDENT), 2012 IEEE Conference on, 1-6
  4. Benedetto, S.; Pedrotti, M.; Minin, L.; Baccino, T.; Re, A. and Montanari, R. 2011. “Driver workload and eye blink duration”.Transportation Research Part F: Traffic Psychology and Behaviour , 14, 199 - 208.
  5. Bergasa, L.; Nuevo, M.; Barea, R. and Lopez, E. Prokhorov, D. (Ed.). 2008. “Visual Monitoring of Driver Inattention”. Computational Intelligence in Automotive Applications, Springer Berlin Heidelberg, 132, 19-37.
  6. Doshi, A. and Trivedi, M. 2009.”Head and gaze dynamics in visual attention and context learning” Computer Vision and Pattern Recognition Workshops, 2009. CVPR Workshops 2009. IEEE Computer Society Conference on, 77-84.
  7. Doshi, A. and Trivedi, M. 2012. “Head and eye gaze dynamics during visual attention shifts in complex environments” Journal of Vision, 12
  8. Engel, D. and Curio, C. 2011. “Predicting human perception performance with machine vision”. Intelligent Vehicles Symposium (IV), 2011 IEEE, 429-435.
  9. Engel, D. and Curio, C. 2012. “Detectability prediction in dynamic scenes for enhanced environment perception” Intelligent Vehicles Symposium (IV), 2012 IEEE, 178- 183.
  10. Fletcher, L. and Zelinsky, A. 2009. “Driver Inattention Detection based on Eye Gaze-Road Event Correlation”. Int. J. Rob. Res., Sage Publications, Inc., 28, 774-801.
  11. Fukagawa, Y. and Yamada, K. 2013. “Estimating Driver Awareness of Pedestrians from Driving Behavior based on a Probabilistic Model”. Intelligent Vehicles Symposium (IV).
  12. Harbluk, J. L.; Noy, Y. I.; Trbovich, P. L. and Eizenman, M. 2007. “An on-road assessment of cognitive distraction: Impacts on driver's visual behavior and braking performance”. Accident Analysis & Prevention, 39, 372 - 379.
  13. Imamura, T.; Yamashita, H.; bin Othman, R.; Zhang, Z. and Miyake, T. 2008. “Driving behavior classification river sensing based on vehicle steering wheel operations”. SICE Annual Conference, 2008, 2714-2718.
  14. Jensen, M. and Wagner, J. 2011. “Analysis of In-Vehicle Driver Behaviour Data for Improved Safety”. International Journal of Vehicle Safety. 197-212.
  15. Li, W.; chang He, Q.; min Fan, X. and min Fei, Z.2012. “Evaluation of driver fatigue on two channels of EEG data”. Neuroscience Letters, 506, 235 - 239.
  16. Lin, S. T.; Tan, Y. Y.; Chua, P. Y.; Tey, L. K. & Ang, C. H. 2012 “PERCLOS Threshold for Drowsiness Detection during Real Driving” Journal of Vision, 12, 546.
  17. Mohamad-Hoseyn Sigari, Mahmood Fathy and Soryani, M. 2013. “A Driver Face Monitoring System for Fatigue and Distraction Detection”. International Journal of Vehicular Technology, 11.
  18. Östlund, J; and al. 2004. “Delivrable 2- HMI and safety related driver performance”. Human Machine Interface and the Safety of Traffic in Europe (HASTE) project.
  19. Regan, M. A.; Hallett, C. and Gordon, C. P. 2011. “Driver distraction and driver inattention: Definition, relationship and taxonomy”. Accident Analysis & Prevention, 43, 1771 -1781.
  20. Santana Diaz, A.; Jammes, B.; Esteve, D. and Gonzalez Mendoza, M. 2002. “Driver hypovigilance diagnosis using wavelets and statistical analysis”. 2002. Intelligent Transportation Systems. Proceedings. The IEEE 5th International Conference on, 162-167
  21. Trivedi, M. M.; G, T. and Mccall, J. 2007. “Looking-in and looking-out of a vehicle: Computer-vision-based enhanced vehicle safety”. IEEE Trans. Intell. Transp. Syst, 8, 108-120.
  22. Ueno, H.; Kaneda, M. and Tsukino, M. 1994. “Development of drowsiness detection system”. Vehicle Navigation and Information Systems Conference, 1994. Proceedings. 1994, 15-20.
  23. Wakayama, M.; Deguchi, D.; Doman, K.; Ide, I.; Murase, H. and Tamatsu, Y.2012. ”Estimation of the human performance for pedestrian detectability based on visual search and motion features”.Pattern Recognition (ICPR), 2012 21st International Conference on, 1940-1943.
  24. WHO, World Health Organization, 2013. “Global Status Report on Road Safety Supporting a decade of action”.

Paper Citation

in Harvard Style

Tien Phan M., Thouvenin I., Fremont V. and Cherfaoui V. (2014). Estimating Driver Unawareness of Pedestrian based on Visual Behaviors and Driving Behaviors . In Doctoral Consortium - DCVISIGRAPP, (VISIGRAPP 2014) ISBN Not Available, pages 35-39

in Bibtex Style

author={Minh Tien Phan and Indira Thouvenin and Vincent Fremont and Véronique Cherfaoui},
title={Estimating Driver Unawareness of Pedestrian based on Visual Behaviors and Driving Behaviors},
booktitle={Doctoral Consortium - DCVISIGRAPP, (VISIGRAPP 2014)},
isbn={Not Available},

in EndNote Style

JO - Doctoral Consortium - DCVISIGRAPP, (VISIGRAPP 2014)
TI - Estimating Driver Unawareness of Pedestrian based on Visual Behaviors and Driving Behaviors
SN - Not Available
AU - Tien Phan M.
AU - Thouvenin I.
AU - Fremont V.
AU - Cherfaoui V.
PY - 2014
SP - 35
EP - 39
DO -