Testing Multimodal Interactive Applications by Means of the TTT Language

Le Thanh Long, Nguyen Thanh Binh, Ioannis Parissis

2016

Abstract

Developing interactive applications is a complex activity as they must deal with various kinds of human-computer interactions. This is especially true when these interactions use multiple modalities (voice, gesture…). As a result, thoroughly testing such applications is particularly important and requires more effort than for traditional interactive applications. In this paper, we propose an approach for automating the test generation of such multimodal applications. This approach is based on the definition of a new test modelling language, TTT. Test models provided in TTT can be translated intest generators.TTT deals with a well-known class of multimodality properties: the CARE properties. The whole approach is illustrated on a case study.

References

  1. Cortier, A., D'Ausbourg, B., and Ait-Ameur, Y., 2007. Formal validation of java/swing user interfaces with the event B method. In HCI (1), pages 1062-1071.
  2. Dittmar, A., 2000. More precise descriptions of temporal relations within task models. In Interactive Applications: Design, Specification, and Verification, 7th International Workshop DSV-IS, Proceedings, pages 151-168, Limerick, Ireland.
  3. Bouchet, J., Madani, L., Nigay, L., Oriat, C. and Parissis, I. 2007. Formal testing of multimodal interactive systems. In EIS'2007 Engineering Interactive Systems, Salamanca, Spain, 36-52.
  4. D'Ausbourg, B., 1998. Using model checking for the automatic validation of user interface systems. In Design, Specification and Verification of Interactive Systems'98, Proceedings of the Fifth International Eurographics Workshop, pages 242-260, Abingdon, United Kingdom.
  5. Coutaz, J., Nigay, L., Salber, D., Blandford, A., May, J. and Young, R. M. 1995. Four easy pieces for assessing the usability of multimodal interaction: the care properties. In INTERACT, 115-120. Chapman & Hall.
  6. Du Bousquet, L., Ouabdesselam, F., and Richier, J.-L. 1998. Expressing and implementing operational profiles for reactive software validation. In 9th International Symposium on Software Reliability Engineering, Paderborn, Germany.
  7. Duke, D. J. and Harrison, M. D., 1993. Abstract interaction objects. Computer Graphics Forum, 12(3):25-36.
  8. Paternò, F. and Faconti, G., 1993. On the use of LOTOS to describe graphical interaction. In HCI'92: Proceedings of the conference on People and computers VII, pages 155-173, New York, NY, USA. Cambridge University Press.
  9. Bouchet, J., and Nigay, L., 2004. ICARE: a componentbased approach for the design and development of multimodal interfaces. In Extended abstracts of the 2004 Conference on Human Factors in Computing Systems, CHI 2004, pages 1325-1328, Vienna, Austria, 24 - 29.
  10. Le TL., Nguyen TB, Parissis I., 2013. A New Test Modeling Language for Interactive Applications Based on Task Trees, In Proceedings of the 4th International symposium on information and communication Technology, pp.285-293.
  11. Le TL., Nguyen TB., Parissis, I., 2014. A solution of generate test data for interactive applications, In Proceedings of the 7th National Conference on Fundamental and Applied Information Technology Research (FAIR'7), pp.134-143.
  12. Madani, L. and Parissis, I. 2009. Automatically testing interactive applications using extended task trees. J. Log. Algebr. Program., 78(6):454-471.
  13. Madani, L., Oriat, C., Parissis, I., Bouchet, J., and Nigay, L., 2005. Synchronous testing of multimodal systems: An operational profile-based approach. In 16th International Symposium on Software Reliability Engineering (ISSRE 2005), pages 325-334, Chicago, IL, USA, 8-11.
  14. Madani, L. and Parissis, I., 2011. Automatically testing interactive multimodal systems using task trees and fusion models. In 6th international workshop on Automation of software test (AST 7811), Hawai, USA.
  15. Du Bousquet, L., Ouabdesselam, F. , Richier, J.-L. and Zuanon, N., 1999. Lutess: a specification driven testing environment for synchronous software. In 21st International Conference on Software Engineering, pages 267-276. ACM Press.
  16. Musa, J. 1993. Operational Profiles in Software-Reliability Engineering. IEEE Software, 14-32.
  17. Palanque P., Bastide R., 1995. Verification of Interactive Software by Analysis of its Formal Specification. INTERACT'95, Norway.
  18. Richard K. Shehady and Daniel P. Siewiorek, 1997. A method to automate user interface testing using variable finite state machines. In FTCS 7897: Proceedings of the 27th International Symposium on Fault-Tolerant Computing (FTCS 7897), page 80, Washington, DC, USA, 1997. IEEE Computer Society.
  19. Ait-Ameur, Y. and Kamel, N., 2004. A generic formal specification of fusion of modalities in a multimodal HCI. In Rene Jacquart, editor, IFIP Congress Topical Sessions, pages 415-420. Kluwer, 2004.
  20. Ter Beek, M.H., Faconti, G.P. Massink, M., Palanque, P.A. and Winckler, M., 2009. Resilience of Interaction Techniques to Interrupts: A Formal Model-Based Approach. In Human-Computer Interaction - INTERACT 2009: Part I of the Proceedings of the 12th IFIP TC 13 International Conference on HumanComputer Interaction (INTERACT'09), Uppsala, Sweden (T. Gross et al., eds.), Lecture Notes in Computer Science 5726, Springer, Berlin, 494-509.
  21. Paternò, F., Mancini, C., and Meniconi, S., 1997. ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models. In Proceedings of the 6th IFIP TC 13 International Conference on HumanComputer Interaction (INTERACT'97), Sydney, Australia (S. Howard, J. Hammond, and G. Lindgaard, eds.), Chapman & Hall, Boca Raton, 362-369.
  22. Palanque, P., Winckler, M., Ladry, J.-F., Ter Beek, M.H., Faconti, G., and Massink, M., 2009. A Formal Approach Supporting the Comparative Predictive Assessment of the Interruption-Tolerance of Interactive Systems. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS'09), Pittsburgh, PA, USA (G. Calvary, T.C.N. Graham, and P. Gray, eds.), ACM Press, 211-220.
  23. Kamel, N. and Aït Ameur, Y., 2007. A Formal Model for CARE Usability Properties Verification in Multimodal HCI. In Proceedings of the IEEE International Conference on Pervasive Services (ICPS'07), Istanbul, Turkey, IEEE Computer Society, 341-348.
  24. Kamel, N., Aït Ameur, Y., Selouani, S.-A. and Hamam, H., 2008. A formal model to handle the adaptability of multimodal user interfaces. In Proceedings of the 1st International ICST Conference on Ambient Media and Systems (AMBI-SYS'08), Quebec, Canada (B. Liang and R.M. Whitaker, eds.).
  25. Mohand-Oussaïd, L., Aït-Sadoune, I., Aït Ameur, Y., and Ahmed-Nacer, M., 2015. A formal model for output multimodal HCI - An Event-B formalization. Computing 97, 713-740.
Download


Paper Citation


in Harvard Style

Thanh Long L., Thanh Long L., Thanh Binh N., Thanh Binh N., Parissis I. and Parissis I. (2016). Testing Multimodal Interactive Applications by Means of the TTT Language . In Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016) ISBN 978-989-758-166-3, pages 23-32. DOI: 10.5220/0005842500230032


in Bibtex Style

@conference{amaretto16,
author={Le Thanh Long and Le Thanh Long and Nguyen Thanh Binh and Nguyen Thanh Binh and Ioannis Parissis and Ioannis Parissis},
title={Testing Multimodal Interactive Applications by Means of the TTT Language},
booktitle={Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)},
year={2016},
pages={23-32},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005842500230032},
isbn={978-989-758-166-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)
TI - Testing Multimodal Interactive Applications by Means of the TTT Language
SN - 978-989-758-166-3
AU - Thanh Long L.
AU - Thanh Long L.
AU - Thanh Binh N.
AU - Thanh Binh N.
AU - Parissis I.
AU - Parissis I.
PY - 2016
SP - 23
EP - 32
DO - 10.5220/0005842500230032