Development of an Automatic Location-determining Function for Balloon-type Dialogue in a Puppet Show System for the Hearing Impaired

Ryohei Egusa, Shuya Kawaguchi, Tsugunosuke Sakai, Fusako Kusunoki, Hiroshi Mizoguchi, Miki Namatame, Shigenori Inagaki

Abstract

People with hearing impairments have a tendency to experience difficulties in obtaining audio information. They have difficult to watch puppet shows. In this study, we have undertaken the development of a dialogue presentation function in a puppet show system for the hearing impaired. The dialogue presentation function that was developed is an automatic location-determination system for balloon-type dialogue. The balloon-type dialogue turns the lines of dialogue into text and displays it as balloons in the background animation of the puppet show. This function automatically places the balloon-type dialogue in the vicinity of the locations of the puppets. In the evaluation test, 24 college students with a hearing impairment were used as participants, and a comparison was made between a system that implemented the automatic location-determination function for balloon-type dialogue and a system that did not implement said function. These results indicate the effectiveness of the location tracking function for balloon-type dialogue as a means for ensuring access to audio information in puppet shows.

References

  1. Blumenthal, E. (2005). Puppetry: A World history 1st Edition. Abrams, New York, NY.
  2. Egusa, R., Sakai, T., Tamaki, H., Kusunoki, F., Namatame, M., Mizoguchi, H. and Inagaki, S. (2016). Designing a Collaborative Interaction Experience for a Puppet Show System for Hearing-Impaired Children. In Computers Helping People with Special Needs, ICCHP2016, Part II, LNCS 9759, pp.424-432.
  3. Fukamauchi F., Nishioka, T., Matsuda, T., Matsushima, E. and Namatame, M. (2007). Exploratory Eye Movements in Hearing Impaired Students - Utilizing Horizontal S-shaped Figures -. In National University Corporation Tsukuba University of Technology Techno Report, 14, pp.177-181.
  4. Hisaki, I., Nanjo, H. and Yoshimi, T. (2010). Evaluation of Speech Balloon Captions for Auditory Information Support in Small Meetings. In the 20th International Congress on Acoustics. Sydney, Australia: Australian Acoustical Society, pp.1-5.
  5. Hong, R., Wang, M., Xu, M., Yan, S. and Chua, T-S. (2010). Dynamic captioning: video accessibility enhancement for hearing impairment. In the 18th ACM international conference on Multimedia. Firenze, Italy: ACM, pp.421-430.
  6. Hu, Y., Kautz, J., Yu, Y. and Wang, W. (2015). SpeakerFollowing Video Subtitles. In ACM Transactions on Multimedia Computing, Communications, Applications, 11(2), Article 32, 17 pages.
  7. Los Angeles County Museum. And Zweers, J. U., 1959. History of Puppetry. Los Angeles County Museum. L.A., CA.
  8. Marschark, M. and Hauser, P. C. (2012). How Deaf Children Learn. Oxford University Press, Inc., Oxford, UK.
  9. Rander, A. and Looms, P. O. (2010). The Accessibility of Television News with Live Subtitling on Digital Television. In the 8th International Interactive Conference on Interactive TV & Video. Tampere, Finland: ACM, pp.155-160.
  10. Stinson, M. S., Francis, P., Elliot, L. B. and Easton, D. (2014). Real-time Caption Challenge: C-print. In the 16th international ACM SIGACCESS Conference on Computers & Accessibility. Rochester, NY, USA: ACM, pp.317-318.
  11. Wald, M. (2008). Captioning Multiple Speakers using Speech Recognition to Assist Disabled People. In Computers Helping People with Special Needs, ICCHP 2008, LNCS5105, pp.617-623.
Download


Paper Citation


in Harvard Style

Egusa R., Kawaguchi S., Sakai T., Kusunoki F., Mizoguchi H., Namatame M. and Inagaki S. (2017). Development of an Automatic Location-determining Function for Balloon-type Dialogue in a Puppet Show System for the Hearing Impaired . In Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-240-0, pages 340-344. DOI: 10.5220/0006377203400344


in Bibtex Style

@conference{csedu17,
author={Ryohei Egusa and Shuya Kawaguchi and Tsugunosuke Sakai and Fusako Kusunoki and Hiroshi Mizoguchi and Miki Namatame and Shigenori Inagaki},
title={Development of an Automatic Location-determining Function for Balloon-type Dialogue in a Puppet Show System for the Hearing Impaired},
booktitle={Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2017},
pages={340-344},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006377203400344},
isbn={978-989-758-240-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Development of an Automatic Location-determining Function for Balloon-type Dialogue in a Puppet Show System for the Hearing Impaired
SN - 978-989-758-240-0
AU - Egusa R.
AU - Kawaguchi S.
AU - Sakai T.
AU - Kusunoki F.
AU - Mizoguchi H.
AU - Namatame M.
AU - Inagaki S.
PY - 2017
SP - 340
EP - 344
DO - 10.5220/0006377203400344