CABA2 L A BLISS PREDICTIVE COMPOSITION ASSISTANT FOR AAC COMMUNICATION SOFTWARE

Nicola Gatti, Matteo Matteucci

2004

Abstract

In order to support the residual communication capabilities of verbal impaired peoples softwares allowing Augmentative and Alternative Communication (AAC) have been developed. AAC communication software aids provide verbal disables with an electronic table of AAC languages (i.e. Bliss, PCS, PIC, etc.) symbols in order to compose messages, exchange them via email, or vocally synthetize them, and so on. A current open issue, in thins kind of software, regards human-computer interaction in verbal impaired people suffering motor disorders. They can adopt only ad-hoc input device, such as buttons or switches, which require an intelligent automatic scansion of the AAC symbols table in order to compose messages. In such perspective we have developed C A BA2 L an innovative composition assistant exploiting an user linguistic behavior model adopting a semantic/probabilistic approach for predictive Bliss symbols scansion. C A BA 2 L is based on an original discrete implementation of auto-regressive hidden Markov model called DAR-HMM and it is able to predict a list of symbols as the most probable ones according to both the previous selected symbol and the semantic categories associated to the symbols. We have implemented the composition assistant as a component of BL I S S 2003 an AAC communication software centered on Bliss language and experimentally validated it with both synthetic and real data.

References

  1. Aliprandi, C., Barsocchi, D., Fanciulli, F., Mancarella, P., Pupillo, D., Raffaelli, R., and Scudellari, C. (2003). AWE, an innovative writing prediction environment. In Proc. of the Int. Human Computer Conf., Crete, Greece.
  2. Amari, S., Finke, M., Muller, K. R., Murata, N., and Yang, H. (1995). Asymptotic statistical theory of overtraining and cross-validation. Technical Report METR 95-06, Dep. of Math. Eng. and Inf., Physics, Uni. of Tokyo, Tokyo.
  3. Bilmes, J. (1998). A gentle tutorial of the EM Algorithm and its application to parameter estimation for Gaussian Mixture and Hidden Markov Models. Technical report, Dep. of Electrical Eng. and Comp. Sci. at Uni. of California, Berkeley.
  4. Bliss, C. K. (1966). Semantography. Semantography Blissymbolic Communication, Sidney, Australia.
  5. Bloomberg, K. and Johnson, H. (1990). A statewide demographic survey of people with severe communication impairments. Augmentative and Alternative Communication, 6:50-60.
  6. Caruana, R., Lawrence, S., and Giles, C. L. (2001). Over tting in neural networks: Backpropagation, conjugate gradient, and early stopping. In Advances in Neural Information Processing Systems, Denver, Colorado.
  7. Cronk, S. and Schubert, R. (1987). Development of a real time expert system for automatic adaptation of scanning rates. In Proc. of the Conf. on Rehabilitation Technology, RESNA, volume 7, pages 109-111, Washington, DC, USA.
  8. Dempster, A., Laird, N., and Rubin, D. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of Royal Statistical Society B, 39:1- 38.
  9. Fodor, J. (1983). The modularity of mind. MIT Press, Cambridge, USA.
  10. Ghahramani, Z. (2001). An introduction to hidden markov models and bayesian networks. International Journal of Pattern Recognition and Arti cial Intelligence, 1:9- 42.
  11. Higginbotham, D. J., Lesher, G. W., and Moulton, B. J. (1998). Techniques for augmenting scanning communication. Augmentative and Alternative Communication, 14:81-101.
  12. ISAAC (1983). Int. Soc. for Augmentative and Alternative Communication, Internet site. http://www.isaaconline.org. Last accessed October 1th, 2003.
  13. Juang, B. and Rabiner, L. (1990). The segmental k-means algorithm for estimating parameters of hidden markov models. In IEEE Trans. on Acoustics Speech and Signal processing, ASSP-38, pages 1639-1641. IEEE Computer Society Press.
  14. Juang, B., Rabiner, L., and Wilpon, G. (1986). A segmental k-means training procedure for connected word recognition. AT&T Technical Journal, 65:21-31.
  15. Koester, H. and Levine, S. (1994). Learning and performance of ablebodied individuals using scanning systems with and without word prediction. Assistive Technology, page 42.
  16. Lee, H.-Y., Yeh, C.-K., Wu, C.-M., and Tsuang, M.-F. (2001). Wireless communication for speech impaired subjects via portable augmentative and alternative system. In Proc. of the Int. Conf. of the IEEE on Eng. in Med. and Bio. Soc., volume 4, pages 3777-3779, Washington, DC, USA.
  17. Prechelt, L. (1996). Early stopping-but when? In Neural Networks: Tricks of the Trade, pages 55-69.
  18. Quillian, M. (1968). Semantic memory. In Minsky ed. Semantic Information Processing. MIT Press, Cambridge.
  19. Rabiner, L. (1989). A tutorial on hidden markov models and selected applications in speech recognition. In Proc. of the IEEE, 77, pages 257-286. IEEE Computer Society Press.
  20. Shane, B. (1981). Augmentative Communication: an introduction. Blackstone, Toronto, Canada.
  21. Simpson, R. C. and Koester, H. H. (1999). Adaptive oneswitch row-column scanning. IEEE Trans. on Rehabilitation Engineering, 7:464-473.
  22. Swif n, A. L., Pickering, J. A., and Newell, A. F. (1987). Adaptive and predictive techniques in a cammunication prosthesis. Augmentative and Alternative Communication, 3:181-191.
Download


Paper Citation


in Harvard Style

Gatti N. and Matteucci M. (2004). CABA2 L A BLISS PREDICTIVE COMPOSITION ASSISTANT FOR AAC COMMUNICATION SOFTWARE . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 972-8865-00-7, pages 89-96. DOI: 10.5220/0002606600890096


in Bibtex Style

@conference{iceis04,
author={Nicola Gatti and Matteo Matteucci},
title={CABA2 L A BLISS PREDICTIVE COMPOSITION ASSISTANT FOR AAC COMMUNICATION SOFTWARE},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2004},
pages={89-96},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002606600890096},
isbn={972-8865-00-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - CABA2 L A BLISS PREDICTIVE COMPOSITION ASSISTANT FOR AAC COMMUNICATION SOFTWARE
SN - 972-8865-00-7
AU - Gatti N.
AU - Matteucci M.
PY - 2004
SP - 89
EP - 96
DO - 10.5220/0002606600890096