THE SONG PICTURE - On Musical Information Visualization for Audio and Video Editing

Marcelo Cicconet, Paulo Cezar Carvalho

2010

Abstract

Most audio and video editors employ a representation of music pieces based on the Pulse Code Modulation waveform, from which not much information, besides the energy envelope, can be visually captured. In the present work we discuss the importance of presenting to the user some hints about the melodic content of the audio to improve the visual segmentation of a music piece, thereby speeding up editing tasks. Such a representation, although powerful in the mentioned sense, is of simple computation, a desirable property because loading an audio or video should be done very fast in an interactive environment.

References

  1. Azar, J., Saleh, H., and Al-Alaoui, M. (2007). Sound visualization for the hearing impaired. International Journal of Emerging Technologies in Learning.
  2. Cicconet, M. and Carvalho, P. (2009). Eigensound: Song visualization for edition purposes. In Sibgrapi 2009, 22nd Brazilian Symposium on Computer Graphics and Image Processing - Poster Section.
  3. Cooper, M. and Foote, J. (2003). Summarizing popular music via structural similarity analysis. In Workshop on Applications of Signal Processing to Audio and Acoustics.
  4. Ferguson, S., Moere, A., and Cabrera, D. (2005). Seeing sound : Real-time sound visualisation in visual feedback loops used for training musicians. In Ninth International Conference on Information Visualisation.
  5. Foote, J. (1999). Visualizing music and audio using selfsimilarity. In 7th ACM international conference on Multimedia.
  6. Jehan, T. (2005). Creating Music by Listening. PhD thesis, Massachusetts Institute of Technology.
  7. Kolhoff, P., Preuss, J., and Loviscash, J. (2006). Music icons: Procedural glyphs for audio files. In Sibgrapi 2006, 19st Brazilian Symposium on Computer Graphics and Image Processing.
  8. Lee, M., Dolson, J., and Trivi, J. (2007). Automated visualization for enhanced music playback. United States Patent Application Publication.
  9. Sedes, A., Courribet, B., and Thibaut, J. (2004). Visualization of sound as a control interface. In 7th Internacional Conference on Digital Audio Effects.
  10. Verbeeck, M. and Solum, H. (2009). Method for visualizing audio data. United States Patent Application Publication.
  11. Ware, C. (2004). Information Visualization: Perception for Design. Morgan Kaufmann.
Download


Paper Citation


in Harvard Style

Cicconet M. and Cezar Carvalho P. (2010). THE SONG PICTURE - On Musical Information Visualization for Audio and Video Editing . In Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2010) ISBN 978-989-674-027-6, pages 85-90. DOI: 10.5220/0002825000850090


in Bibtex Style

@conference{ivapp10,
author={Marcelo Cicconet and Paulo Cezar Carvalho},
title={THE SONG PICTURE - On Musical Information Visualization for Audio and Video Editing},
booktitle={Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2010)},
year={2010},
pages={85-90},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002825000850090},
isbn={978-989-674-027-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2010)
TI - THE SONG PICTURE - On Musical Information Visualization for Audio and Video Editing
SN - 978-989-674-027-6
AU - Cicconet M.
AU - Cezar Carvalho P.
PY - 2010
SP - 85
EP - 90
DO - 10.5220/0002825000850090