TOWARD A SILENT SPEECH INTERFACE BASED ON UNSPOKEN SPEECH

Alejandro Antonio Torres García, Carlos Alberto Reyes García, Luis Villaseñor Pineda

Abstract

This work aims to interpret the EEG signals associated with actions to imagine the pronunciation of words that belong to a reduced vocabulary without moving the articulatory muscles and without uttering any audible sound (unspoken speech). Specifically, the vocabulary reflects movements to control the cursor on the computer. We have recorded EEG signals from 21 subjects using a markers based basic protocol. The discrete wavelet transform (DWT) is used to extract features from the delimited windows, and a subset of them with frequency ranges below 32 Hz is further selected. These subsets are used to train four classifiers: Naive Bayes (NB), Random Forests (RF), support vector machine (SVM), and Bagging-RF. The results are still preliminary but encouraging because the accuracy rates are above 20%, i.e. up to chance for five classes. The implementation process as well as some experiments with their corresponding results are shown.

References

  1. Brigham, K. and Kumar, B. (2010). Imagined Speech Classification with EEG Signals for Silent Communication: A Preliminary Investigation into Synthetic Telepathy. In Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on, pages 1-4. IEEE.
  2. DaSalla, C. S., Kambara, H., Koike, Y., and Sato, M. (2009). Spatial filtering and single-trial classification of EEG during vowel speech imagery. In i-CREATe 7809: Proceedings of the 3rd International Convention on Rehabilitation Engineering & Assistive Technology, pages 1-4, New York, NY, USA. ACM.
  3. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J., and Brumberg, J. (2010). Silent speech interfaces. Speech Communication, 52(4):270-287.
  4. Dietterich, T. (2000). Ensemble methods in machine learning. Multiple classifier systems, pages 1-15.
  5. D'Zmura, M., Deng, S., Lappas, T., Thorpe, S., and Srinivasan, R. (2009). Toward EEG sensing of imagined speech. Human-Computer Interaction. New Trends, pages 40-48.
  6. Geschwind, N. (1972). Language and the brain. Scientific American.
  7. Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., and Arnald, B. (2007). A review of classication algorithms for EEG-based brain-computer interfaces. Journal of Neural Engineering, 4:r1-r13.
  8. Porbadnigk, A. (2008). EEG-based Speech Recognition: Impact of Experimental Design on Performance. Master's thesis, Institut für Theoretische Informatik Universität Karlsruhe (TH), Karlsruhe, Germany.
  9. Suppes, P., Lu, Z., and Han, B. (1997). Brain wave recognition of words. Proceedings of the National Academy of Sciences of the United States of America, 94(26):14965.
  10. Wester, M. (2006). Unspoken Speech - Speech Recognition Based On Electroencephalography. Master's thesis, Institut für Theoretische Informatik Universität Karlsruhe (TH), Karlsruhe, Germany.
Download


Paper Citation


in Harvard Style

Antonio Torres García A., Alberto Reyes García C. and Villaseñor Pineda L. (2012). TOWARD A SILENT SPEECH INTERFACE BASED ON UNSPOKEN SPEECH . In Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2012) ISBN 978-989-8425-89-8, pages 370-373. DOI: 10.5220/0003769603700373


in Bibtex Style

@conference{biosignals12,
author={Alejandro Antonio Torres García and Carlos Alberto Reyes García and Luis Villaseñor Pineda},
title={TOWARD A SILENT SPEECH INTERFACE BASED ON UNSPOKEN SPEECH},
booktitle={Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2012)},
year={2012},
pages={370-373},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003769603700373},
isbn={978-989-8425-89-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2012)
TI - TOWARD A SILENT SPEECH INTERFACE BASED ON UNSPOKEN SPEECH
SN - 978-989-8425-89-8
AU - Antonio Torres García A.
AU - Alberto Reyes García C.
AU - Villaseñor Pineda L.
PY - 2012
SP - 370
EP - 373
DO - 10.5220/0003769603700373