FACIAL EXPRESSIONS AND BODY GESTURES AS METAPHORS FOR B2C INTERFACES - An Empirical Study

Dimitrios Rigas, Nikolaos Gazepidis

Abstract

This paper describes an initial survey and an experiment that investigate the use of facial expressions and body language in e-Business applications. Our aim in this research is to investigate the usability aspects of B2C interfaces that utilise speech, non-speech, avatars with facial expressions and gestures in addition to the typical visual graphical metaphors that are currently used. The initial survey was performed with 25 users and the main experiment with 42 users. Results were encouraging and enabled us to understand some of the research issues involved in the use of multimodal metaphors in e-Business. The results indicated that avatars with facial expressions were most preferred by users for e-transactions and the full animated body was the second most preferred option by the users. The text was the least preferred option. These findings enabled us to understand several design issues of multimodal systems for e-Business applications. For example there were issues of multimodal presentation and combination of the different modalities, e.g. speech, avatars, facial expressions, graphics, and text.

References

  1. Barnes - Vieyra, P., Claycomb, C., 2001. Business-toBusiness E-Commerce: Models and Managerial Decisions. Business Horizons / May-June.
  2. Bartneck, C., Takahashi, T., Katagiri, Y., 2004. CrossCultural Study of Expressive Avatars.
  3. Benyon, D., Turner, P., Turner, S., 2005. Designing Interactive Systems - People, Activities, Contexts, Technologies. Addison-Wesley.
  4. Beskow, J., 1996a. Talking heads - communication, articulation and animation. Department of Speech, Music and Hearing, KTH.
  5. Beskow, J., 1996b. Animation of Talking Agents. Centre for Speech Technology, KTH, Stockholm, Sweden.
  6. Borden, G., 2002, An Aural User Interface for Ubiquitous Computing. Sharp Laboratories of America.
  7. Böszörményi, L,. Hellwagner, H., Kosch, H., 2001. Multimedia Technologies for E-Business Systems and Processes. Institut für Informationstechnologie, Universität Klagenfurt.
  8. Bjur, J., 1998. Auditory Icons in an Information Space. Department of Industrial Design, School of Design and Craft, Göteborg University, Sweden.
  9. Brewster, S., Wright, P., Edwards, A., 1993. An Evaluation of Earcons for Use in Auditory HumanComputer Interfaces. Department of Computer Science, University of York, U.K.
  10. Brewster, S,. Raty, V.K., Kortekangas A., 1996. Earcons as a Method of Providing Navigational Cues in a Menu Hierarchy.
  11. Brewster, S., 1997. Using Non-Speech Sound to Overcome Information Overload. Glasgow Interactive Systems Group, Department of Computing Science, The University of Glasgow, U.K.
  12. Brewster, S., 1998a. Using Earcons to Improve the Usability of a Graphics Package. Glasgow Interactive Systems Group, Department of Computing Science, University of Glasgow, Glasgow, G12, 8QQ, UK.
  13. Brewster, S., 1998b. Using Earcons to Improve the Usability of Tool Pallettes. Glasgow Interactive Systems Group, Department of Computer Science.
  14. Brewster, S., 1998c. The Design of Sonically-Enhanced Widgets. Glasgow Interactive Systems Group, Department of Computing Science, The University of Glasgow, U.K.
  15. Burford, D., Blake, E., 1999. Real-Time Facial Animation for Avatars in Collaborative Virtual Environments Collaborative Visual Computing, Department of Computer Science, University of Cape Town.
  16. Dickey, M., 2003. 3D Virtual Worlds: An Emerging Technology for Traditional and Distance Learning Miami University.
  17. Dix, A., Finlay, J., Abowd, G., Beale, R., 2004. HumanComputer Interaction. 3rd Edition, Prentice Hall, pp. 379-381.
  18. Dutoit, T., 1999. A Short Introduction to Text-to-Speech Synthesis. TTS research team, TCTS Lab.
  19. Fabri, M., Gerhard, M., Moore, D., Hobbs, D., 1999. Perceiving the Others: Cognitive Processes in Collaborative Virtual Environments. Virtual Learning Environment Research Group, School of Computing, Leeds Metropolitan University.
  20. Fabri, M., Moore, D., 2005. The use of emotionally expressive avatars in Collaborative Virtual Environments ISLE Research Group, School of Computing, Leeds Metropolitan University.
  21. Gaver, W., 1989. The SonicFinder: An interface that uses auditory icons Human-Computer Interaction. vol. 4, pp. 67-74.
  22. Gaver, W., 1993. Synthesizing Auditory Icons. Rank Xerox Cambridge, EuroPARC, U.K.
  23. Heckman, C., Wobbrock, J., 2000. Put Your Best Face Forward: Anthropomorphic Agents, E-Commerce Consumers, and the Law.
  24. Hoorn, J., 2003. Personification: Crossover between Metaphor and Fictional Character in Computer Mediated Communication. Free University, Amsterdam, The Netherlands.
  25. Jalali-Sohi, M., Baskaya, F., 2001. A Multimodal Shopping Assistant for Home E-Commerce Fraunhofer Institute for Computer Graphics, 2001.
  26. Janse, E., 2002. Time-Compressing Natural and Synthetic Speech. University of Utrecht, The Netherrlands.
  27. Kouroupetroglou, G., Mitsopoulos, E., 2000. Speechenabled e-Commerce for Disabled and Elderly Persons, University of Athens, Greece.
  28. Krenn, B., Neumayr, B., Gstrein, E., Grice, M., 2004. Life-like Agents for the Internet: A Cross-Cultural Case Study.
  29. Lemmetty, S., Karjalainen, M., 1999. Review of Speech Synthesis Technology. Department of Electrical and Communications Engineering, Helsinki University of Technology.
  30. Lines, L., Home, K., 2002. Older Adults' Evaluations of Speech Output. Department of Information Systems & Computing, Brunel University, Uxbridge, Middlesex, U.K.
  31. Mahadevan, B,. 2002. Emerging Market Mechanism in Business-to-Business E-Commerce: A framework. Rome, Italy.
  32. Prasolova-Førland, E., Divitini, M., 2002. Supporting learning communities with collaborative virtual environments: Different spatial metaphors. IDI, Norwegian University of Science and Technology.
  33. Preece, J,. Rogers, Y., Sharp, H., Benyon, D., Holland, S., Carrey, T., 1994. Human-Computer Interaction. Addison-Wesley, pp. 252-253.
  34. Qiu, L., Benbasat, I., 2005. Online Consumer Trust and Live Help Interfaces: The Effects of Text-to-Speech Voice and 3D Avatars. Sauder School of Business, University of British Columbia.
  35. Reynolds, M., Isaacs-Duvall, C., Haddox, M. L., 2002. A Comparison of Learning Curves in Natural and Synthesized Speech Comprehension. Marshall University, Huntington, West Virginia.
  36. Rigas, D., Alty, J., 1998. Using Sound to Communicate Program Execution. Euromicro, p. 20625, 24th. EUROMICRO Conference Volume 2.
  37. Salem, B., Earle, N., 2000. Designing a Non-Verbal Language for Expressive Avatars. University of Plymouth, U.K.
  38. Schroeter, J., Ostermann, J., Graf, H.P., Beutnagel, M., Cosatto, E., Syrdal, A., Conkie, A., Stylianou, Y., 2000. Multimodal Speech Synthesis. AT&T Labs - Research, New Jersey, USA.
  39. Tassabehji, R,. 2003. Applying E-Commerce in
  40. Turban, E,. King, D., 2003. Introduction to E-Commerce, Prentice Hall. Upper Saddle River, New Jersey, pp. 3.
  41. Villa-Uriol, M-C., Sainz, M., Kuester, F., Bagherzadeh, N., 1994. Automatic Creation of Three-Dimensional Avatars. University of California. Irvine.
  42. Wendler, S., Shi, D., 2001. E-Commerce Strategy on
  43. Wouters, J., Rundle, B., Macon, M., 1999. Authoring Tools for Speech Synthesis Using the Sable Markup Standard.
  44. Xydas, G., Kouroupetroglou, G., 2000. Text-to-Speech Scripting Interface for Appropriate Vocalisation of eTexts, University of Athens, Greece.
Download


Paper Citation


in Harvard Style

Rigas D. and Gazepidis N. (2006). FACIAL EXPRESSIONS AND BODY GESTURES AS METAPHORS FOR B2C INTERFACES - An Empirical Study . In Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2006) ISBN 978-972-8865-62-7, pages 275-282. DOI: 10.5220/0001425102750282


in Bibtex Style

@conference{ice-b06,
author={Dimitrios Rigas and Nikolaos Gazepidis},
title={FACIAL EXPRESSIONS AND BODY GESTURES AS METAPHORS FOR B2C INTERFACES - An Empirical Study},
booktitle={Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2006)},
year={2006},
pages={275-282},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001425102750282},
isbn={978-972-8865-62-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on e-Business - Volume 1: ICE-B, (ICETE 2006)
TI - FACIAL EXPRESSIONS AND BODY GESTURES AS METAPHORS FOR B2C INTERFACES - An Empirical Study
SN - 978-972-8865-62-7
AU - Rigas D.
AU - Gazepidis N.
PY - 2006
SP - 275
EP - 282
DO - 10.5220/0001425102750282