Reciprocal Adaptation Measures for Human-Agent Interaction Evaluation

Jieyeon Woo, Catherine Pelachaud, Catherine Achard

2023

Abstract

Recent works focus on creating socially interactive agents (SIAs) that are social, engaging, and human-like. SIA development is mainly on endowing the agent with human capacities such as communication and behavior adaptation skills. Nevertheless, the task of evaluating the agent’s quality remains as a challenge. Especially, the way of objectively evaluating human-agent interactions is not evident. To address this problem, we propose new measures to evaluate the agent’s interaction quality. This paper focuses on interlocutors’ continuous, dynamic, and reciprocal behavior adaptation during an interaction, which we refer to as reciprocal adaptation. Our reciprocal adaptation measures capture this adaptation by measuring the synchrony of behaviors including their absence of response and by assessing the behavior entrainment loop. We investigate the nonverbal adaptation, notably for smile, in dyads. Statistical analyses are conducted to improve the understanding of the adaptation phenomenon. We also studied how the presence of reciprocal adaptation may be related to different aspects of the interaction dynamics and conversational engagement. We investigate how the influence of the social dimensions of warmth and competence along with the engagement is related to reciprocal adaptation.

Paper Citation

in Harvard Style

Woo J., Pelachaud C. and Achard C. (2023). Reciprocal Adaptation Measures for Human-Agent Interaction Evaluation. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-623-1, pages 114-125. DOI: 10.5220/0011779300003393

in Bibtex Style

@conference{icaart23,
author={Jieyeon Woo and Catherine Pelachaud and Catherine Achard},
title={Reciprocal Adaptation Measures for Human-Agent Interaction Evaluation},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2023},
pages={114-125},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011779300003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Reciprocal Adaptation Measures for Human-Agent Interaction Evaluation
SN - 978-989-758-623-1
AU - Woo J.
AU - Pelachaud C.
AU - Achard C.
PY - 2023
SP - 114
EP - 125
DO - 10.5220/0011779300003393