Using SCXML to Integrate Semantic Sensor Information into Context-aware User Interfaces

Alvaro Sigüenza, José Luis Blanco, Jesús Bernat, Luis A. Hernández


This paper describes a novel architecture to introduce automatic annotation and processing of semantic sensor data within context-aware applications. Based on the well-known state-charts technologies, and represented using W3C SCXML language combined with Semantic Web technologies, our architecture is able to provide enriched higher-level semantic representations of user’s context. This capability to detect and model relevant user situations allows a seamless modeling of the actual interaction situation, which can be integrated during the design of multimodal user interfaces (also based on SCXML) for them to be adequately adapted. Therefore, the final result of this contribution can be described as a flexible context-aware SCXML-based architecture, suitable for both designing a wide range of multimodal context-aware user interfaces, and implementing the automatic enrichment of sensor data, making it available to the entire Semantic Sensor Web.


  1. Presser, M., Gluhak, A., Krco, S., Hoeller, J. and Herault, l.: SENSEI - Integrating the Physical with the Digital World of the Network of the Future, 17th ICT Mobile Summit, Stockholm, Sweden, 10-12 June (2008)
  2. Dey,A.K., Abowd, G.D., and Salber, D.: A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16, 97-166 (2001)
  3. FIDIS deliverable, D7.3: “Report on Actual and Possible Profiling Techniques in the Field of Ambient Intelligence”, Editors: Wim Schreurs, Mireille Hildebrandt (VUB, Belgium), Mark Gasson, Kevin Warwick (Reading University, UK), August (2005).
  4. Sathish, S.: Using Declarative Models in Multi-device Smart Space Environments, Workshop on Declarative Models of Distributed Web Applications, Dublin, Ireland, June (2007)
  5. Berners-Lee, T., Lendler, J. and Lassila, O.: The Semantic Web, Scientific American, vol. 284, no. 5 (2001)
  6. Angioni, M., Demontis, R., Deriu, M., De Vita, E., Lai, C., Marcialis, I., Paddeu G., Pintus, A., Piras, A., Sanna, R., Soro, A., and Tuveri, F.: A Collaborative, Semantic and ContextAware Search Engine. In -, editor, Proc. Of ICEIS 2007 - Software Agents And Internet Computing. Volume 1, (2007)
  7. Mohamed A. F., Mounir M., Ismail K. I.: A Novel Approach for Ontology Distribution in Ubiquitous Environments, International Journal of Web Information Systems, Vol. 2 Iss: 3/4, pp.225 - 231 (2007)
  8. Bell, D., Heravi, B. and Lycett, M.: Sensory semantic user interfaces (SenSUI), 2nd International Workshop on Semantic Sensor Networks 2009, Washington, October (2009)
  9. Huang, V. and Stefanov, S.: Semantic Sensor Information Description and Processing, Proceedings of the Second International Conference on Sensor Technologies and Applications, pp. 456-461 (2008)
  10. Noguchi, H., Mori, T., and Sato, T.: Automatic Generation and Connection of Program Components based on RDF Sensor Description in Network Middleware, IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2008-2014 (2006)
  11. SOFIA project - Smart Objects For Intelligent Applications, funded through the European Artemis program,
  12. Wilcock, G. and Jokinen, K.: SCXML, Multimodal Dialogue Systems and MMI Architecture, Workshop on W3C Multimodal Architecture and Interfaces, Fujisawa, Japan (2007)
  13. W3C: State Chart XML (SCXML): State Machine Notation for Control Abstraction,, W3C Working Draft 13 May (2010)
  14. Harel, D. (1987). StateCharts: A visual Formalism for Complex Systems. In: Science of Computer Programming 8, North-Holland.
  15. Young, S.: Cognitive User Interfaces" IEEE Signal Processing Magazine,27(3): 128-140, (2010)
  16. W3C: Voice Extensible Markup Language (VoiceXML) Version 2.0, W3C Recommendation 16 March (2004)
  17. OGC® Open Geospatial Consortium, Inc. : Sensor Web Enablement (SWE),
  18. W3C Semantic Sensor Network Incubator Group,
  19. Nishimoto, T, Shioya, M., Takahashi, J., and Daigo, H.: A study on Dialogue Management Principles Corresponding to the Driver's Workload. Advances for In-Vehicle and Mobile Systems:251 -264. (2007)
  20. Amditis, A., Kussmann, H., Polynchronopoulos, A., Engström, J., and Andreone, L.: System Architecture for integrated adaptive HMI solutions. In: Intelligent Vehicles Symposium. Tokyo, Japan (2006)
  21. OGC® Open Geospatial Consortium, Inc.: Observations and Measurements (O&M),
  22. W3C: RDFa Primer. Bridging the Human and Data Webs. W3C Working Group Note 14 October 2008

Paper Citation

in Harvard Style

Sigüenza A., Blanco J., Bernat J. and A. Hernández L. (2010). Using SCXML to Integrate Semantic Sensor Information into Context-aware User Interfaces . In Proceedings of the International Workshop on Semantic Sensor Web - Volume 1: SSW, (IC3K 2010) ISBN 978-989-8425-33-1, pages 47-59. DOI: 10.5220/0003116100470059

in Bibtex Style

author={Alvaro Sigüenza and José Luis Blanco and Jesús Bernat and Luis A. Hernández},
title={Using SCXML to Integrate Semantic Sensor Information into Context-aware User Interfaces},
booktitle={Proceedings of the International Workshop on Semantic Sensor Web - Volume 1: SSW, (IC3K 2010)},

in EndNote Style

JO - Proceedings of the International Workshop on Semantic Sensor Web - Volume 1: SSW, (IC3K 2010)
TI - Using SCXML to Integrate Semantic Sensor Information into Context-aware User Interfaces
SN - 978-989-8425-33-1
AU - Sigüenza A.
AU - Blanco J.
AU - Bernat J.
AU - A. Hernández L.
PY - 2010
SP - 47
EP - 59
DO - 10.5220/0003116100470059