A Multimodal User Interface using the Webinos Platform to Connect a Smart Input Device to the Web of Things

E. Baccaglini, M. Gavelli, M. Morello, P. Vergori

2015

Abstract

We propose an innovative overlay architecture among heterogeneous devices that works on different operating systems and an application based on standard web technologies that leverages on such architecture to perform a broad range of functions using audio commands. To achieve this, a secure web runtime platform allows connecting different devices such as an Android mobile device, a single board computer and a Web of Things (WoT) sensor/actuator in a secure and independent manner. Methods and functions have been created in order to capture the audio from the microphone on personal computers and on mobile phones, and to safely transfer files to a single board computer, in which a speech recognition engine is embedded. Therefore, by recording the audio command from one of these devices and performing voice command identification using the speech engine, it is possible to perform different actions previously defined by the user on one of his devices. This work demonstrates how open source platforms can interconnect and operate with proprietary architecture in a complementary and secure manner.

References

  1. Botsikas, C., Lasak, M., and Vergori, P. (2013). webinosTV: the multi-screen switchboard for seamless interaction with distributed content. In Proceedings of EuroITV.
  2. Catania, V., Torre, G. L., Monteleone, S., Patti, D., Vercelli, S., and Ricciato, F. (2012). A novel approach to Web of Things: M2M and enhanced Javascript technologies. In Green Computing and Communications (GreenCom), 2012 IEEE International Conference on, pages 726-730.
  3. Gajecki, L. (2014). Architectures of neural networks applied for LVCSR language modeling. Neurocomputing, pages 46-53.
  4. Guinard, D., Trifa, V., Mattern, F., and Wilde, E. (2011). From the Internet of Things to the Web of Things: Resource-oriented architecture and best practices. In Architecting the Internet of Things, pages 97-129. Springer Berlin Heidelberg.
  5. Hosn, R. (1997). Key challenges in deploying a voice activated premier dialing application. In Automatic Speech Recognition and Understanding, IEEE Workshop on, pages 575-582. IEEE.
  6. Juang, B. H. and Rabiner, L. R. (1991). Hidden Markov models for speech recognition. In Technometrics, volume 3, pages 251-272.
  7. Jurafsky, D. and Martin, J. H. (2000). Speech and language processing. Pearson Education India.
  8. Kurniawati, E., Celetto, L., Capovilla, N., and George, S. (2012). Personalized voice command systems in multi modal user interface. In Emerging Signal Processing Applications (ESPA), 2012 IEEE International Conference on, pages 45-47. IEEE.
  9. Recordon, D. and Reed, D. (2006). OpenID 2.0: a platform for user-centric identity management. In Proceedings of the 2nd ACM workshop on Digital identity management, pages 11-16. ACM.
  10. Richardson, L. and Ruby, S. (2008). RESTful web services. O'Reilly Media, Inc.
  11. Tan, B. T., Gu, Y., and Thomas, T. (1998). Implementation and evaluation of a voice-activated dialling system. In Interactive Voice Technology for Telecommunications Applications, 4th Workshop on, pages 83-86. IEEE.
  12. Vergori, P., Ntanos, C., Gavelli, M., and Askounis, D. (2013). The webinos architecture: a developer's point of view. In Mobile Computing, Applications, and Services, pages 391-399. Springer Berlin Heidelberg.
Download


Paper Citation


in Harvard Style

Baccaglini E., Gavelli M., Morello M. and Vergori P. (2015). A Multimodal User Interface using the Webinos Platform to Connect a Smart Input Device to the Web of Things . In Proceedings of the 5th International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS, ISBN 978-989-758-084-0, pages 104-108. DOI: 10.5220/0005231001040108


in Bibtex Style

@conference{peccs15,
author={E. Baccaglini and M. Gavelli and M. Morello and P. Vergori},
title={A Multimodal User Interface using the Webinos Platform to Connect a Smart Input Device to the Web of Things},
booktitle={Proceedings of the 5th International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,},
year={2015},
pages={104-108},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005231001040108},
isbn={978-989-758-084-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pervasive and Embedded Computing and Communication Systems - Volume 1: PECCS,
TI - A Multimodal User Interface using the Webinos Platform to Connect a Smart Input Device to the Web of Things
SN - 978-989-758-084-0
AU - Baccaglini E.
AU - Gavelli M.
AU - Morello M.
AU - Vergori P.
PY - 2015
SP - 104
EP - 108
DO - 10.5220/0005231001040108