Towards Automated Decision Making in Dating Apps Through Pupillary Responses

Jan Ehlers, Sebastian Alfonso, Arup Mazumder

2024

Abstract

Decision making is a multi-stage process that involves a series of rational evaluations. Recently, bodily arousal has been identified as a factor that mediates individual decisions, particularly during partner selection. The current study investigates pupil size changes in response to facial images of the opposite sex from controlled eye-tracking data (Experiment 1) and by reading out signals from front-facing smartphone cameras in noisy environments (Experiment 2). The aim is to enable automated decision-making in dating apps using arousal-based information. The rating results showed a tendency towards moderate evaluations when coping with facial attractiveness, while pupil diameter did not clearly discriminate between all four rating categories. However, a ROCKET model was trained on the pupil data from Experiment 1 with a prediction accuracy of 77% for binary classification of clearly preferred and non-preferred images. Ambiguous responses will therefore continue to pose a problem for cognition-aware systems. Capturing pupil diameter from mobile phone cameras resulted in a high proportion of inadequate recordings, probably due to a lack of experimental control. However, an overly systematic approach should run contrary to the intended scenario of lifelike mobile dating app usage.

Paper Citation

in Harvard Style

Ehlers J., Alfonso S. and Mazumder A. (2024). Towards Automated Decision Making in Dating Apps Through Pupillary Responses. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP; ISBN 978-989-758-679-8, SciTePress, pages 522-529. DOI: 10.5220/0012471100003660

in Bibtex Style

@conference{hucapp24,
author={Jan Ehlers and Sebastian Alfonso and Arup Mazumder},
title={Towards Automated Decision Making in Dating Apps Through Pupillary Responses},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP},
year={2024},
pages={522-529},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012471100003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: HUCAPP
TI - Towards Automated Decision Making in Dating Apps Through Pupillary Responses
SN - 978-989-758-679-8
AU - Ehlers J.
AU - Alfonso S.
AU - Mazumder A.
PY - 2024
SP - 522
EP - 529
DO - 10.5220/0012471100003660
PB - SciTePress