USING AUDEMES AS A LEARNING MEDIUM FOR THE VISUALLY IMPAIRED

Steve Mannheimer, Mexhid Ferati, Donald Huckleberry, Mathew Palakal

2009

Abstract

In this paper we demonstrate the utility of short, nonverbal sound symbols—called “audemes”—in the encoding and recalling of text-based educational materials. In weekly meetings over a school year with blind and visually impaired pre-college students, we explored their capacity for long-term memory of individual audemes, audeme sequences, and textual content presented in conjunction with these. Through interviews and group discussions, we also explored the ability of these students to create intuitive narratives enabling memory of complex audemes and series of audemes. Further, we explored the mnemonic power of positive affect in audemes, and the impact of thematic association of information-to-audeme. Our results showed that the use of audemes can improve encoding and recall of educational content in the visually impaired population. The ultimate goal of our work is implementation of an “acoustic interface” allowing users to access a database of audemes and associated text-to-speech content.

References

  1. Back, M. and Des, D. (1996) “Micro-Narratives in Sound Design: Context, Character, and Caricature in Waveform Manipulation,” ICAD.
  2. Blattner M.M., Sumikawa D.A. and M. Greenberg R.M. (1989) “Earcons and Icons: Their structure and common design principles.” Human-Computer Interaction, Vol. 4, pp. 11-44.
  3. Brewster, Stephen A, (1994) “Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces,” PhD thesis, University of York.
  4. Conversy, S. (1998) “Ad-hoc synthesis of auditory icons,” ICAD.
  5. Doucet, M.-E., Guillemot, J.-P., Lassonde, M., Gagne, J.- P., Leclerc, C. & Lepore, F. (2004) Blind subjects process auditory spectral cues more efficiently than sighted individuals. Springer-Verlag.
  6. Edwards, A.N.D. (1989) Modelling Blind Users' Interactions with an Auditory Computer Interface, International Journal of Man-Machine Studies.
  7. Frohlich, P. and Pucher, M. (2005) “Combining Speech and Sound in the User Interface,” ICAD 7805.
  8. Gaver, W.W. (1989) The SonicFinder: An Interface That Uses Auditory Icons, W.W. Gaver, Human-Computer Interaction, Vol. 4, No. 1, pp. 67-94.
  9. Mynatt, E. D. (1994) Designing with auditory icons: how well do we identify auditory cues? Proceedings of the 2nd International Conference on Auditory Display.
  10. Sanchez, J & Flores H (2004) AudioMath: blind children learning mathematics through audio. Proceedings of Fifth Conf. Disability, Virtual Reality & Assoc. Tech., Oxford, UK.
  11. Sanchez, J. & Jorquera, L. (2001) Interactive virtual environments for blind children: usability and cognition. Department of Computer Science, University of Chile.
  12. Sanchez, J. & Flores, H. (2004). Memory enhancement through Audio. Department of Computer Science, Chile.
  13. Smither, J.A. (1993) Short term memory demands in processing synthetic speech by old and young adults. Behaviour & Information Technology Vol. 12, No 6: 330-335.
  14. Stevens, RD and Brewster, SA. (1994) Providing an audio glance at algebra for blind readers, Proceedings of ICAD.
  15. Turnbull, D., Barrington, L., Torres, D. & Lanckriet, G. (2006) Modeling the Semantics of Sound. Department of Computer Science and Engineering, UCSD.
Download


Paper Citation


in Harvard Style

Mannheimer S., Ferati M., Huckleberry D. and Palakal M. (2009). USING AUDEMES AS A LEARNING MEDIUM FOR THE VISUALLY IMPAIRED . In Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2009) ISBN 978-989-8111-63-0, pages 175-180. DOI: 10.5220/0001532801750180


in Bibtex Style

@conference{healthinf09,
author={Steve Mannheimer and Mexhid Ferati and Donald Huckleberry and Mathew Palakal},
title={USING AUDEMES AS A LEARNING MEDIUM FOR THE VISUALLY IMPAIRED },
booktitle={Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2009)},
year={2009},
pages={175-180},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001532801750180},
isbn={978-989-8111-63-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2009)
TI - USING AUDEMES AS A LEARNING MEDIUM FOR THE VISUALLY IMPAIRED
SN - 978-989-8111-63-0
AU - Mannheimer S.
AU - Ferati M.
AU - Huckleberry D.
AU - Palakal M.
PY - 2009
SP - 175
EP - 180
DO - 10.5220/0001532801750180