Incorporating the User Attention in User Interface Logs

A. Martínez-Rojas, A. Jiménez-Ramírez, J. Enríquez, D. Lizcano-Casas

2022

Abstract

Business process analysis is a key factor in the lifecycle of Robotic Process Automation. Currently, task mining techniques provide mechanisms to analyze information about the process tasks to be automated, e.g., identify repetitive tasks or process variations. Existing proposals mainly rely on the user interactions with the UIs of the system (i.e., keyboard and mouse level) and information that can be gathered from them (e.g., the window name) which is stored in a UI event log. In some contexts, the latter information is limited because the system is accessed through virtualized environments (e.g., Citrix or Teamviewer). Other approaches extend the UI Log, including screenshots to address this issue. Regardless of the context, the aim is to store as much information as possible in the UI Log so that is can be analyzed later on, e.g., by extracting features from the screenshots. This amount of information can introduce much noise in the log that messes up what is relevant to the process. To amend this, the current approach proposes a method to include a gaze analyzer, which helps to identify which is process-relevant information between all the information. More precisely, the proposal extends the UI Log definition with the attention change level, which records when the user’s attention changes from one element on the screen to another. This paper sets the research settings for the approach and enumerates the future steps to conduct it.

Paper Citation

in Harvard Style

Martínez-Rojas A., Jiménez-Ramírez A., Enríquez J. and Lizcano-Casas D. (2022). Incorporating the User Attention in User Interface Logs. In Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-613-2, pages 415-421. DOI: 10.5220/0011568000003318

in Bibtex Style

@conference{webist22,
author={A. Martínez-Rojas and A. Jiménez-Ramírez and J. Enríquez and D. Lizcano-Casas},
title={Incorporating the User Attention in User Interface Logs},
booktitle={Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2022},
pages={415-421},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011568000003318},
isbn={978-989-758-613-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Incorporating the User Attention in User Interface Logs
SN - 978-989-758-613-2
AU - Martínez-Rojas A.
AU - Jiménez-Ramírez A.
AU - Enríquez J.
AU - Lizcano-Casas D.
PY - 2022
SP - 415
EP - 421
DO - 10.5220/0011568000003318