Automated Generation of User Interfaces - Based on Use Case or Interaction Design Specifications?

Hermann Kaindl, Roman Popp, David Raneburger


Instead of manually creating (graphical) user interfaces (UIs), automatically generating them is desirable, especially since UIs are needed today for diverse devices like PCs and smartphones. The basis for such automated generation can be a UI specification, but most of the related research takes task models as input, which are on a higher level of abstraction. More recently, another modeling language employing discourse-based models for specifying communicative interaction has been proposed, which completely abstracts from specifics of a particular UI and even its type. From such models, UIs can be generated automatically through model transformations. Some research, however, claims that UIs can be generated from use cases. While it would be desirable to utilize such a form of requirements definition without having to create another specification, we found that these approaches actually use additional information attached to the use cases, usually UI-related attachments. In addition to contrasting different kinds of specifications, we propose a synthesis through a combination. In fact, we found that discourse-based models can be also viewed as specifying classes of scenarios, i.e., use cases more precisely than the main-stream approach using UML and use-case reports.


  1. Cecez-Kecmanovic, D. and Janson, M. (1999). Communicative action theory: An approach to understanding the application of information systems. In Proceedings of the Tenth Australasian Conference on Information Systems (ACIS99), pages 183-195.
  2. Costa, D., Nóbrega, L., and Nunes, N. (2007). An MDA approach for generating web interfaces with UML ConcurTaskTrees and canonical abstract prototypes. In Coninx, K., Luyten, K., and Schneider, K., editors, Task Models and Diagrams for Users Interface Design, volume 4385 of Lecture Notes in Computer Science, pages 137-152. Springer Berlin / Heidelberg. 10.1007/978-3-540-70816-2 11.
  3. da Silva, P. and Paton, N. (2003). User interface modeling in UMLi. IEEE Software, 20(4):62-69.
  4. Elkoutbi, M., Khriss, I., and Keller, R. K. (2006). Automated prototyping of user interfaces based on UML scenarios. Automated Software Engineering, 13(1):5- 40.
  5. Falb, J., Kaindl, H., Horacek, H., Bogdan, C., Popp, R., and Arnautovic, E. (2006). A discourse model for interaction design based on theories of human communication. In Extended Abstracts on Human Factors in Computing Systems (CHI 7806), pages 754-759. ACM Press: New York, NY.
  6. Falb, J., Kaindl, H., Popp, R., and Raneburger, D. (2011). Automated WIMP-UI generation based on communication models. i-com, 10(3):48-55.
  7. Falb, J., Kavaldjian, S., Popp, R., Raneburger, D., Arnautovic, E., and Kaindl, H. (2009). Fully automatic user interface generation from discourse models. In Proceedings of the 13th International Conference on Intelligent User Interfaces (IUI 7809), pages 475-476. ACM Press: New York, NY.
  8. Fatolahi, A., Som, S. S., and Lethbridge, T. C. (2008). Towards a semi-automated model-driven method for the generation of web-based applications from use cases. In Proceedings of the workshop on Speech and Natural Language.
  9. Habermas, J. (1984). The Theory of Communicative Action - Reason and the Rationalisation of Society, volume I. Boston, MA: Beacon Press.
  10. Habermas, J. (1987). The Theory of Communicative Action - the Critique of a Functionalist Reason, volume II. Boston, MA: Beacon Press.
  11. Hennicker, R. and Koch, N. (2001). Modeling the user interface of web applications with UML. In Workshop of the pUML-Group held together with the «UML»2001 on Practical UML-Based Rigorous Development Methods - Countering or Integrating the eXtremists, pages 158-172. GI.
  12. Kaindl, H. and Jezek, R. (2002). From usage scenarios to user interface elements in a few steps. In Kolski, C. and Vanderdonckt, J., editors, Proceedings of CADUI'02, pages 91-102. Kluwer.
  13. Luff, P., Frohlich, D., and Gilbert, N. (1990). Computers and Conversation. Academic Press, London, UK.
  14. Mann, W. C. and Thompson, S. (1988). Rhetorical Structure Theory: Toward a functional theory of text organization. Text, 8(3):243-281.
  15. Mori, G., Paternò , F., and Santoro, C. (2002). CTTE: Support for developing and analyzing task models for interactive system design. IEEE Transactions on Software Engineering, 28:797-813.
  16. Pastor, O., Espan˜ a, S., Panach, J. I., and Aquino, N. (2008). Model-driven development. Informatik Spektrum, 31(5):394-407.
  17. Paternò , F., Santoro, C., and Spano, L. D. (2009). Maria: A universal, declarative, multiple abstraction-level language for service-oriented applications in ubiquitous environments. ACM Trans. Comput.-Hum. Interact., 16:19:1-19:30.
  18. Popp, R. and Raneburger, D. (2011). A High-Level Agent Interaction Protocol Based on a Communication Ontology. In Huemer, C., Setzer, T., Aalst, W., Mylopoulos, J., Sadeh, N. M., Shaw, M. J., and Szyperski, C., editors, E-Commerce and Web Technologies, volume 85 of Lecture Notes in Business Information Processing, pages 233-245. Springer Berlin Heidelberg. 10.1007/978-3-642-23014-1 20.
  19. Raneburger, D., Popp, R., Kaindl, H., Falb, J., and Ertl, D. (2011a). Automated Generation of Device-Specific WIMP UIs: Weaving of Structural and Behavioral Models. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS 7811, pages 41-46, New York, NY, USA. ACM.
  20. Raneburger, D., Popp, R., Kavaldjian, S., Kaindl, H., and Falb, J. (2011b). Optimized GUI generation for small screens. In Hussmann, H., Meixner, G., and Zuehlke, D., editors, Model-Driven Development of Advanced User Interfaces, volume 340 of Studies in Computational Intelligence, pages 107-122. Springer Berlin / Heidelberg.
  21. Searle, J. R. (1969). Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press, Cambridge, England.
  22. van den Bergh, J. and Coninx, K. (2007). From task to dialog model in the UML. In Proceedings of the 6th International Workshop on Task Models and Diagrams for User Interface Design (TAMODIA 2007), LNCS 4849, pages 98-111, Toulouse, France. Springer.
  23. Vanderdonckt, J. M. (2008). Model-driven engineering of user interfaces: Promises, successes, and failures. In Proceedings of 5th Annual Romanian Conf. on Human-Computer Interaction, pages 1-10. Matrix ROM.

Paper Citation

in Harvard Style

Kaindl H., Popp R. and Raneburger D. (2012). Automated Generation of User Interfaces - Based on Use Case or Interaction Design Specifications? . In Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT, ISBN 978-989-8565-19-8, pages 303-308. DOI: 10.5220/0004136203030308

in Bibtex Style

author={Hermann Kaindl and Roman Popp and David Raneburger},
title={Automated Generation of User Interfaces - Based on Use Case or Interaction Design Specifications?},
booktitle={Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,},

in EndNote Style

JO - Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,
TI - Automated Generation of User Interfaces - Based on Use Case or Interaction Design Specifications?
SN - 978-989-8565-19-8
AU - Kaindl H.
AU - Popp R.
AU - Raneburger D.
PY - 2012
SP - 303
EP - 308
DO - 10.5220/0004136203030308