Communication Support System for Deaf and Hard of Hearing People by Captions Considering Sound Source and Sound Direction

Nobuko Kato, Marie Kepler

2022

Abstract

For a deaf and hard of hearing (DHH) visitor to be able to understand all information in a museum, it is necessary to present not only the human voice as captions, but also the sounds in the environment in such a way that the DHH visitor can understand. For this reason, we investigated communication support methods in a way that not only presents speech content as captions but also presents sound information, such as the source and direction of the sound source. In this paper, we examine a case in which the direction of the sound source is indicated by flowing text, and another case where the sound source is indicated not only by text but also by photos and pictograms, using the following two presentation methods: wearable AR glasses and floor projection.

Paper Citation

in Harvard Style

Kato N. and Kepler M. (2022). Communication Support System for Deaf and Hard of Hearing People by Captions Considering Sound Source and Sound Direction. In Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-562-3, pages 675-680. DOI: 10.5220/0011077800003182

in Bibtex Style

@conference{csedu22,
author={Nobuko Kato and Marie Kepler},
title={Communication Support System for Deaf and Hard of Hearing People by Captions Considering Sound Source and Sound Direction},
booktitle={Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2022},
pages={675-680},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011077800003182},
isbn={978-989-758-562-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Communication Support System for Deaf and Hard of Hearing People by Captions Considering Sound Source and Sound Direction
SN - 978-989-758-562-3
AU - Kato N.
AU - Kepler M.
PY - 2022
SP - 675
EP - 680
DO - 10.5220/0011077800003182