![](bg8.png)
from the bottom to the top of the axis. The graph
comprehension is as follows: the lower right region
of the heatmap shows Ar
H
and positive assessment
of impression, and the upper right region shows Ar
H
and negative assessment of impression. As shown in
Table 1, the number of auditory stimuli classified by
(V
i
, Ar
i
, At
j
) is almost equal. Therefore, the antici-
pated distribution of subjective impression results in
Figure 4 comprises approximately equivalent peaks
for each feature of auditory stimulus. For exam-
ple, (V
++
, At
+
) has two strong distributions around
(Ar
i
, S
ai
) ∼ (Ar
L
∨ Ar
H
, 1 ∼ 2) and is expected to
have more strongly positive (here S
ai
∼ 1) results for
Ar
H
than for Ar
L
.
Overall, these results suggest that the short sen-
tence impression expected from the combination
of (V
i
, Ar
i
, At
j
) and the participant’s subjective
impression assessment are generally consistent for
short sentences. However, short sentences with the
(V
++
, Ar
H
, At
+
) feature require more work. This in-
dicates that, at least for EIW, it is sufficient to check
V
i
and Ar
i
and incorporate them into short sentences.
We will investigate the relationship between At
j
and
pupillary response to understand the relationship be-
tween subjective impression assessment of the short
sentence and pupillary response. Further, this sug-
gests that the relationship with memory can be re-
ferred to in the future.
6 CONCLUSION
The purpose of this study was to detect relationship
between the response of individual participants to the
EIW characterized by valence and arousal, and their
memory of short sentences. We designed a short sen-
tence containing an EIW as an auditory stimulus to
facilitate measurement of the pupil dilation response,
based on the idea that the EIW could be characterized
by valence and arousal and related to emotion. Partic-
ipants were then presented with auditory stimuli, and
their impressions of the auditory stimuli, pupil dila-
tion response, and remembered sentences were mea-
sured. The results suggest that the r
myd
/ r
mio
of au-
ditory stimuli, such as narration, can be easily memo-
rized by measuring the content of the auditory stimuli.
Based on this finding, it will be possible in the future
to create and present narration-like commentaries tai-
lored to individual characteristics.
ACKNOWLEDGEMENTS
This work was partly supported by JSPS KAKENHI
Grant Number 19K12232, 19K12246, 20H04290,
and 22K12284. MH also wants to thank to Nagai
N · S Promotion Foundation For Science of Percep-
tion for their finantial support.
REFERENCES
Bradley, M. M. and Lang, P. J. (1994). Measuring emotion:
The self-assessment manikin and the semantic differ-
ential. Journal of Behavior Therapy and Experimental
Psychiatry, 25(1):49–59.
Bradley, M. M. and Lang, P. J. (1999). Affective Norms
for English Words (ANEW): Instruction Manual and
Affective Ratings.
Gomes, C., Brainerd, C., and Stein, L. (2012). Effects
of emotional valence and arousal on recollective and
nonrecollective recall. Journal of experimental psy-
chology. Learning, memory, and cognition, 39:663–
677.
Hirabayashi, R., Shino, M., Nakahira, K. T., and Kita-
jima, M. (2020). How auditory information presen-
tation timings affect memory when watching omnidi-
rectional movie with audio guide. In Proceedings of
the 15th International Joint Conference on Computer
Vision, Imaging and Computer Graphics Theory and
Applications - Volume 2: HUCAPP, pages 162–169.
INSTICC, SciTePress.
Honma, Y. (2014). Drawing up of the japanese word stimu-
lus based on the emotional valence and arousal of the
word. Bulletin of Aichi Institute of Technology, 49:13–
24.
Lavoie, M. and O’Connor, K. (2013). Effect of emo-
tional valence on episodic memory stages as indexed
by event-related potentials. World Journal of Neuro-
science, 03:250–262.
Megalakaki, O., Ballenghein, U., and Baccino, T. (2019).
Effects of valence and emotional intensity on the com-
prehension and memorization of texts. Frontiers in
Psychology, 10.
Murakami, M., Shino, M., Nakahira, K., and Kitajima, M.
(2021). Effects of emotion-induction words on mem-
ory of viewing visual stimuli with audio guide. In Pro-
ceedings of the 16th International Joint Conference
on Computer Vision, Imaging and Computer Graph-
ics Theory and Applications - Volume 1: HUCAPP,
pages 89–100. INSTICC, SciTePress.
Russell, J. (1980). A circumplex model of affect. Journal
of Personality and Social Psychology, 39:1161–1178.
Zekveld, A. A., Koelewijn, T., and Kramer, S. E. (2018).
The pupil dilation response to auditory stimuli:
Current state of knowledge. Trends in Hearing,
22:2331216518777174. PMID: 30249172.
HUCAPP 2023 - 7th International Conference on Human Computer Interaction Theory and Applications
220