Automated Annotation of Multimedia Audio Data with Affective Labels for Information Management

Ching Hau Chan, Gareth J. F. Jones

2005

Abstract

The emergence of digital multimedia systems is creating many new opportunities for rapid access to huge content archives. In order to fully exploit these information sources, the content must be annotated with significant features. An important aspect of human interpretation of multimedia data, which is often overlooked, is the affective dimension. Such information is a potentially useful component for content-based classification and retrieval. Much of the affective in- formation of multimedia content is contained within the audio data stream. Emotional features can be defined in terms of arousal and valence levels. In this study low-level audio features are extracted to calculate arousal and valence levels of multimedia audio streams. These are then mapped onto a set of keywords with predetermined emotional interpretations. Experimental results illustrate the use of this system to assign affective annotation to multimedia data.

References

  1. Smeaton, A.F., Lee, H. and McDonald, K.: Experiences of Creating Four Video Library Collections with the Fischlar System, International Journal on Digital Libraries, 4(10) (2004) 42-44
  2. Hauptmann, A.G., Christel, M.G.: Successful Approaches in the TREC Video Retrieval Evaluations, Proceedings of ACM Multimedia 2004, New York City, ACM (2004) 668-675
  3. Zhang, T., Kuo, C. C. J.: Content-Based Audio Classification and Retrieval for Audiovisual Data Parsing, Kluwer Academic Publishers, (2001)
  4. Hanjalic, A., Xu, L.-Q.: User-Oriented Affective Video Content Analysis, Proceedings of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'01), IEEE (2001) 50-57.
  5. Picard, R.W., Cosier, G.: Affective Intelligence - the Missing Link?, BT Technology Journal Vol 14 No 4, (1997)
  6. Inanoglu, Z., Caneel, R.: Emotive Alert: HMM-Based Emotion Detection In Voicemail Messages, Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI 7805), San Diego, ACM (2005) 251-253
  7. Salway, A. and Graham, M.: Extracting Information about Emotions in Films, Proceedings of ACM Multimedia, Berkeley, ACM (2003) 299-302
  8. Russell, J., Mehrabian, A.: Evidence for a Three-Factor Theory of Emotions, Journal of Research in Personality, 11 (1977) 273-294
  9. Bradley, M. M.: Emotional Memory: A Dimensional Analysis. In: van Groot, S., van de Poll, N.E., Sargeant, J. (eds.) The Emotions: Essays on Emotion Theory, Hillsdale, NJ: Erlbaum (1994) 97-134
  10. Dietz, R., Lang, A.: Affective Agents: Effects of Agent Affect on Arousal, Attention, Liking and Learning, Proceedings of the Third International Cognitive Technology Conference, San Francisco (1999)
  11. Ortony, A, Clore, G.L., Coolins, A.: The Cognitive Structure of Emotions, Cambridge University Press (1988)
  12. Picard, R: Affective Computing, MIT Press (1997) Sequence: Magic (Bul et Trick clip) Length: 35 seconds Sequence: Magic (Bul et Trick clip) Length: 35 seconds 1 Fig. 10. Enigma 60: Valence Graph.
Download


Paper Citation


in Harvard Style

Hau Chan C. and J. F. Jones G. (2005). Automated Annotation of Multimedia Audio Data with Affective Labels for Information Management . In Proceedings of the 5th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2005) ISBN 972-8865-28-7, pages 94-103. DOI: 10.5220/0002576800940103


in Bibtex Style

@conference{pris05,
author={Ching Hau Chan and Gareth J. F. Jones},
title={Automated Annotation of Multimedia Audio Data with Affective Labels for Information Management},
booktitle={Proceedings of the 5th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2005)},
year={2005},
pages={94-103},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002576800940103},
isbn={972-8865-28-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2005)
TI - Automated Annotation of Multimedia Audio Data with Affective Labels for Information Management
SN - 972-8865-28-7
AU - Hau Chan C.
AU - J. F. Jones G.
PY - 2005
SP - 94
EP - 103
DO - 10.5220/0002576800940103