Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment

Viking Forsman, Markus Wallmyr, Markus Wallmyr, Taufik Akbar Sitompul, Taufik Akbar Sitompul, Rikard Lindell

2021

Abstract

Visual perception plays an important role for recognizing possible hazards. In the context of heavy machinery, relevant visual information can be obtained from the machine’s surrounding and from the human-machine interface that exists inside the cabin. In this paper, we propose a method that classifies the occurring collisions by combining the data collected by the eye tracker and the automatic logging mechanism in the mixed reality simulation. Thirteen participants were asked to complete a test scenario in the mixed reality simulation, while wearing an eye tracker. The results demonstrate that we could classify the occurring collisions based on two visual perception conditions: (1) whether the colliding objects were visible from the participants’ field of view and (2) whether the participants have seen the information presented on the human-machine interface before the collisions occurred. This approach enabled us to interpret the occurring collisions differently, compared to the traditional approach that uses the total number of collisions as the representation of participants’ performance.

Paper Citation

in Harvard Style

Forsman V., Wallmyr M., Sitompul T. and Lindell R. (2021). Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP; ISBN 978-989-758-488-6, SciTePress, pages 255-262. DOI: 10.5220/0010386702550262

in Bibtex Style

@conference{hucapp21,
author={Viking Forsman and Markus Wallmyr and Taufik Akbar Sitompul and Rikard Lindell},
title={Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP},
year={2021},
pages={255-262},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010386702550262},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP
TI - Classifying Excavator Collisions based on Users’ Visual Perception in the Mixed Reality Environment
SN - 978-989-758-488-6
AU - Forsman V.
AU - Wallmyr M.
AU - Sitompul T.
AU - Lindell R.
PY - 2021
SP - 255
EP - 262
DO - 10.5220/0010386702550262
PB - SciTePress