A Neural Network Model of Cortical Auditory-visual Interactions - A Neurocomputational Analysis of the Shams-Illusion

Cristiano Cuppini, Elisa Magosso, Mauro Ursino

Abstract

The perception of the external world is based on the integration of data from different sensory modalities. Recent theories and experimental findings have suggested that this phenomenon is present since the early low-level cortical areas. The mechanisms underlying these early processes and the organization of the underlying circuitries is still a matter of debate. Here, by using a simple neural network to reproduce and analyse a well-known cross-modal illusion occurring in the visual cortex, we suggest that a fundamental role is played by direct excitatory synapses between visual and auditory regions.

References

  1. Schroeder, C. E., Foxe, J., 2005. Multisensory contributions to low-level 'unisensory' processing. Curr. Opin. Neurobiol. 15, 454- 458.
  2. Shams, L., Kamitani, Y., Shimojo, S. 2002. Visual illusion induced by sound. Cogn. Brain Res. Vol. 14, pp. 147-152.
  3. Stein, B. E., Meredith, M. A., 1993. The merging of the senses, The MIT Press. Cambridge MA.
  4. Watkins, S., Shams, L., Tanaka, S., Haynes, J.D., Rees, G., 2006. Sound alters activity in human V1 in association with illusory visual perception. NeuroImage 31, 1247-1256.
  5. Watkins, S., Shams, L., Josephs, O., Rees, G., 2007. Activity in human V1 follows multisensory perception. NeuroImage 37, 572-578.
Download


Paper Citation


in Harvard Style

Cuppini C., Magosso E. and Ursino M. (2012). A Neural Network Model of Cortical Auditory-visual Interactions - A Neurocomputational Analysis of the Shams-Illusion . In Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012) ISBN 978-989-8565-33-4, pages 639-642. DOI: 10.5220/0004155306390642


in Bibtex Style

@conference{ncta12,
author={Cristiano Cuppini and Elisa Magosso and Mauro Ursino},
title={A Neural Network Model of Cortical Auditory-visual Interactions - A Neurocomputational Analysis of the Shams-Illusion},
booktitle={Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012)},
year={2012},
pages={639-642},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004155306390642},
isbn={978-989-8565-33-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2012)
TI - A Neural Network Model of Cortical Auditory-visual Interactions - A Neurocomputational Analysis of the Shams-Illusion
SN - 978-989-8565-33-4
AU - Cuppini C.
AU - Magosso E.
AU - Ursino M.
PY - 2012
SP - 639
EP - 642
DO - 10.5220/0004155306390642