What Could a Body Tell a Social Robot that It Does Not Know?

Dennis Küster, Arvid Kappas

2014

Abstract

Humans are extremely efficient in interacting with each other. They not only follow goals to exchange information, but modulate the interaction based on nonverbal cues, knowledge about situational context, and person information in real time. What comes so easy to humans poses a formidable challenge for artificial systems, such as social robots. Providing such systems with sophisticated sensor data that includes expressive behavior and physiological changes of their interaction partner holds much promise, but there is also reason to be skeptical. We will discuss issues of specificity and stability of responses with view to different levels of context.

References

  1. Baron-Cohen, S., Tager-Flusberg, H., Cohen, D. J., 2000. Understanding other minds: Perspectives from developmental cognitive neuroscience, Oxford University Press. Oxford, UK.
  2. Bargh, J. A., Chen, M., Burrows, L., 1996. Automaticity and social behavior: Direct effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 71, 230-244.
  3. Batson, C. D., 2009. These things called empathy: Eight related but distinct phenomena. In: J. Decety & W. Ickes (Eds.), The Social Neuroscience of Empathy (pp. 3-15), MIT Press. Cambridge, UK.
  4. Boucsein, W., 2012. Electrodermal activity, Springer. New York.
  5. Boucsein, W., Fowles, D. C., Grimnes, S., Ben-Shakhar, G., Roth, W. T., Dawson, M. E., Filion, D. L., 2012. Publication recommendations for electrodermal measurements. Psychophysiology, 49, 1017-1034.
  6. Bradley, M. M., Codispoti, M., Cuthbert, B. N., Lang, P. J., 2001. Emotion and motivation I: Defensive and appetitive reactions in picture processing. Emotion, 1, 276-298.
  7. Calvo, R. A., D'Mello, S., 2010. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1, 18-37.
  8. Cacioppo, J. T., Tassinary, L. G., 1990. Principles of psychophysiology: Physical, social, and inferential elements. New York: Cambridge University Press.
  9. Cacioppo, J. T., Tassinary, L. G., Berntson, G. G., 2000. Psychophysiological science. In: J.T. Cacioppo, L.G. Tassinary, G.G. Berntson (Eds.), Handbook of Psychophysiology (3-23), Cambridge University Press. Cambridge, UK, 2nd edition.
  10. Cacioppo, J. T., Tassinary, L. G., Berntson, G. G., 2007. Handbook of Psychophysiology, Cambridge University Press. UK, 3rd edition.
  11. Chu, W.-S., de la Torre, F., Cohn, J. F., 2013. Selective transfer machine for facial action unit detection. IEEE International conference on Computer Vision and Pattern recognition. Portland, OR.
  12. Dautenhahn, K., 2007. Methodology & themes of humanrobot interaction: A growing research field. International Journal of Advanced Robotic Systems, 4, 103-108.
  13. Dawson, M. E., Schell, A. M., Filion, D. L., 2000. The electrodermal system. In: J. T. Cacioppo, L. G. Tassinary, G. G. Berntson (Eds.), Handbook of Psychophysiology (200-223), Cambridge University Press. Cambridge, UK.
  14. Ekman, P., Friesen, W. V., 1978. The Facial Action Coding System, Consulting Psychologists Press. Paolo Alto, CA., 2nd edition.
  15. Ekman, P., O'Sullivan, 1991. “Who can catch a liar?” American Psychologist, 46, 913-920.
  16. Fridlund, A. J., 1991. Sociality of solitary smiling: Potentiation by an implicit audience. Journal of Personality and Social Psychology, 60, 229-240.
  17. Fridlund, A. J., 1994. Human facial expression: An evolutionary view. Academic Press. San Diego, CA.
  18. Fridlund, A. J., Cacioppo, J. T. 1986. Guidelines for human electromyographic research. Psychophysiology, 23, 567-588.
  19. Frijda, N. H., Kuipers, P., ter Schure, E., 1989. Relations among emotion, appraisal, and emotional action readiness. Journal of Personality and Social Psychology, 57, 212-228.
  20. Hess, U., Banse, R., Kappas, A., 1995. The intensity of facial expression is determined by underlying affective state and social situation. Journal of Personality and Social Psychology, 69, 280-288.
  21. Jonhston, L., Miles, L., Macrae, C. N., 2010. Why are you smiling at me? Social functions of enjoyment of nonenjoyment smiles. British Journal of Social Psychology, 49, 107-127.
  22. Kappas, A., 2010. Smile when you read this, whether you like it or not: Conceptual challenges to affect detection. IEEE Transactions on Affective Computing, 1, 38-41.
  23. Kappas, A., Küster, B., Basedow, C., Dente, P., 2013. A validation study of the Affectiva Q-Sensor in different social laboratory situations. Poster presented at the 53rd Annual Meeting of the Society for Psychophysiological Research. Florence, Italy.
  24. Katkin, E. S., Morell, M. A., Goldband, S., Bernstein, G. L., Wise, J. A., 1982. Individual differences in heartbeat discrimination. Psychophysiology, 19, 160- 166.
  25. Kuhlen, A. K., Brennan, S. E., 2013. Language in dialogue: When confederates might be hazardous to your data. Psychonomic Bulletin & Review, 20, 54-72.
  26. Küster, D., 2008. The relationship between emotional experience, social context, and the face: An investigation of processes underlying facial activity (Doctoral dissertation). Retrieved from http://www.jacobs-university.de/phd/files/1199465732 .pdf.
  27. Leite, I., Henriques, R., Martinho, C., Paiva, A., 2013. Sensors in the wild: Exploring electrodermal activity in child-robot interaction. Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction. ACM/IEEE Press.
  28. Krumhuber, E., Kappas, A., 2005. Moving smiles: The role of dynamic components for the perception of the genuineness of smiles. Journal of Nonverbal Behavior, 29, 3-24.
  29. Krumhuber, E., Manstead, A.S.R., Kappas, A., 2007. Temporal aspects of facial displays in person and expression perception: The effects of smile dynamics, head-tilt, and gender. Journal of Nonverbal Behavior, 31, 39-56.
  30. Lang, P. J., Greenwald, M. K., Bradley, M. M., Hamm, A. O., 1993. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30, 261-273.
  31. Larsen, J. T., Norris, C. J., Cacioppo, J. T., 2003. Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology, 40, 776-785.
  32. Manstead, A. S. R., Fischer, A. H., Jakobs, E., 1999. The social and emotional functions of facial displays. In P. Philippot, R.S. Feldman, E.J. Coats (Eds.), The social context of nonverbal behavior (pp. 287-313), Cambridge University Press. Cambridge, UK.
  33. Mauss, I. B., Robinson, M. D., 2009. Measures of emotion: A review. Cognition & Emotion, 23, 209- 237.
  34. Paulhus, D. L., 1991. Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & Wrightsman Eds., Measures of personality and social psychological attitudes (pp. 17-59), Academic Press, Inc. San Diego, CA.
  35. Paulhus, D. L., 2002. Socially desirable responding: The evolution of a construct. In H.I. Braun, D. N. Jackson, & D. E. Wiley (Eds.), The role of constructs in psychological and educational measurement (pp. 49- 46), Erlbaum. Mahwah, N.J.
  36. Payne, F. H., Dawson, M. E., Schell, A. M., Kulwinder, S., Courtney, C. G., 2013. Con you give me a hand? A comparison of hands and feet as optimal anatomical sites for skin conductance recording. Psychophysiology, 50, 1065-1069.
  37. Picard, R. W., 1999, Affective Computing for HCI. Proceedings HCI, 1999. Munich, Germany.
  38. Prkachin, G. C., Casey, C., Prkachin, K. M., 2009. Alexithymia and perception of facial expressions of emotion. Personality and Individual Differences, 46, 412-417.
  39. Rantanen, V., Venesvirta, H., Spakov, O., Verho, J., Vetek, A., Surakka, V., Lekkala, J., 2013. Capacitive measurement of facial activity intensity. IEEE Sensors Journal, 13, 4329-4338.
  40. Riek, L. D., 2012. Wizard of Oz studies in HRI: A systematic review and new reporting guidelines. Journal of Human-Robot Interaction, 1, 119-136.
  41. Rosengren, K. E., 2000. Communication: An introduction, Sage. London.
  42. Russell, J. A., Bachorowski, J.-A., Fernández-Dols, J.-M., 2003. Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329-349.
  43. Scherer, K. R., 2003. Vocal communication of emotion: A review of research paradigms. Speech Communication, 40, 227-256.
  44. Schmidt, K. L., Ambadar, Z., Cohn, J. F., Reed, L. I., 2006. Movement differences between deliberate and spontaneous facial expressions: Zygomaticus major action in smiling. Journal of Nonverbal Behavior, 30, 37-52.
  45. Searle, J. T., 1976. A classification of illocutionary acts. Language in Society, 5, 1-23.
  46. Theunis, M., Tsankova, E., Küster, D., Kappas, A., 2012. Emotion in computer-mediated-communication: A fine-grained perspective. Poster presented at the 7th Emotion Pre-Conference to the Annual Meeting of the Society for Personality and Social Psychology. San Diego, California.
  47. Valstar, M. F., Mehu, M., Jiang, B., Pantic, M., Scherer, K., 2012. Meta-analysis of the first facial expression recognition challenge. IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics, 42, 966- 979.
  48. va Boxtel, A., 2010. Facial EMG as a tool for inferring affective states. In A. J. Spink, F. Grieco, O. E. Krips, L. W. W. Loijens, L. P. J. J. Noldus, & P. H. Zimmerman (Eds.), Proceedings of Measuring Behavior 2010 (pp. 104-108). Eindhoven, The Netherlands.
  49. van Dooren, M., de Vries, J. J. G., Janssen, J. H., 2012. Emotional sweating across the body: Comparing 16 different skin conductance measurement locations. Physiology & Behavior, 106, 298-304.
Download


Paper Citation


in Harvard Style

Küster D. and Kappas A. (2014). What Could a Body Tell a Social Robot that It Does Not Know? . In Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014) ISBN 978-989-758-006-2, pages 358-367. DOI: 10.5220/0004892503580367


in Bibtex Style

@conference{oasis14,
author={Dennis Küster and Arvid Kappas},
title={What Could a Body Tell a Social Robot that It Does Not Know?},
booktitle={Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014)},
year={2014},
pages={358-367},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004892503580367},
isbn={978-989-758-006-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014)
TI - What Could a Body Tell a Social Robot that It Does Not Know?
SN - 978-989-758-006-2
AU - Küster D.
AU - Kappas A.
PY - 2014
SP - 358
EP - 367
DO - 10.5220/0004892503580367