Feature, Configuration, History - A Bio-inspired Framework for Information Representation in Neural Networks

Frédéric Alexandre, Maxime Carrere, Randa Kassab

2014

Abstract

Artificial Neural Networks are very efficient adaptive models but one of their recognized weaknesses is about information representation, often carried out in an input vector without a structure. Beyond the classical elaboration of a hierarchical representation in a series of layers, we report here inspiration from neuroscience and argue for the design of heterogenous neural networks, processing information at feature, configuration and history levels of granularity, and interacting very efficiently for high-level and complex decision making. This framework is built from known characteristics of the sensory cortex, the hippocampus and the prefrontal cortex and is exemplified here in the case of pavlovian conditioning, but we propose that it can be advantageously applied in a wider extent, to design flexible and versatile information processing with neuronal computation.

References

  1. Alexandre, F. (2000). Biological Inspiration for Multiple Memories Implementation and Cooperation. In In V. Kvasnicka P. Sincak, J. Vascak and R. Mesiar, editors, International Conference on Computational Intelligence.
  2. Bengio, Y., Courville, A. C., and Vincent, P. (2013). Representation learning: A review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell., 35(8):1798- 1828.
  3. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience & Biobehavioral Reviews, 26(3):321-352.
  4. Deco, G., Jirsa, V. K., Robinson, P. A., Breakspear, M., and Friston, K. (2008). The dynamic brain: From spiking neurons to neural masses and cortical fields. PLoS Comput. Biol., 4(8).
  5. Doya, K. (1999). What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks, 12:961-974.
  6. Fuster, J. M. (2001). The Prefrontal CortexAn Update : Time Is of the Essence. Neuron, 30(2):319-333.
  7. Herry, C., Ciocchi, S., Senn, V., Demmou, L., Muller, C., and Luthi, A. (2008). Switching on and off fear by distinct neuronal circuits. Nature, 454(7204):600-606.
  8. Holland, P. C. and Gallagher, M. (1999). Amygdala circuitry in attentional and representational processes. Trends in cognitive sciences, 3(2):65-73.
  9. Hubel, D. and Wiesel, T. (1962). Receptive fields, binocular interaction and functional architecture in the cat visual cortex. J Physiol, 160:106-154.
  10. Johnson, L. R., Hou, M., Prager, E. M., and LeDoux, J. E. (2011). Regulation of the Fear Network by Mediators of Stress: Norepinephrine Alters the Balance between Cortical and Subcortical Afferent Excitation of the Lateral Amygdala. Frontiers in Behavioral Neuroscience, 5.
  11. Koechlin, E., Ody, C., and Kouneiher, F. (2003). The Architecture of Cognitive Control in the Human Prefrontal Cortex. Science, 302(5648):1181-1185.
  12. Kouneiher, F., Charron, S., and Koechlin, E. (2009). Motivation and cognitive control in the human prefrontal cortex. Nature Neuroscience, 12(7):939-945.
  13. Le Pelley, M. E. (2004). The role of associative history in models of associative learning: a selective review and a hybrid model. The Quarterly Journal of Experimental Psychology, 57(3):193-243.
  14. LeDoux, J. (2007). The amygdala. Current Biology, 17(20):R868-R874.
  15. Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82(4):276-298.
  16. McClelland, J. L., McNaughton, B. L., and O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological review, 102(3):419-457.
  17. O'Reilly, R. C. and Rudy, J. W. (2001). Conjunctive Representations in Learning and Memory: Principles of Cortical and Hippocampal Function. Psychological Review, 108(2):311-345.
  18. Pauli, W. M., Hazy, T. E., and O'Reilly, R. C. (2011). Expectancy, Ambiguity, and Behavioral Flexibility: Separable and Complementary Roles of the Orbital Frontal Cortex and Amygdala in Processing Reward Expectancies. Journal of Cognitive Neuroscience, 24(2):351-366.
  19. Paz, R., Bauer, E. P., and Paré, D. (2009). Measuring correlations and interactions among four simultaneously recorded brain regions during learning. Journal of neurophysiology, 101(5):2507-2515.
  20. Pearce, J. M. and Hall, G. (1980). A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli. Psychological review, 87(6).
  21. Rescorla, R. and Wagner, A. (1972). A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In Classical Conditioning II: Current Research and Theory, pages 64- 99. Appleton Century Crofts.
  22. Rousselet, G., Thorpe, S., and Fabre-Thorpe, M. (2004). How parallel is visual processing in the ventral path? TRENDS in Cognitive Sciences, 8(8):363-370.
  23. Schmajuk, N. and DiCarlo, J. (1992). Stimulus configuration, classical conditioning and the hippocampus. Psychological Review, 99:268-305.
  24. Sperduti, A., Sperduti, R., and Starita, A. (1997). Supervised neural networks for the classification of structures. IEEE Transactions on Neural Networks, 8:714- 735.
  25. Sun, R. and Alexandre, F., editors (1997). Connectionist - Symbolic Integration: from Unified to Hybrid Approaches. Lawrence Erlbaum Associates.
  26. Yu, A. J. and Dayan, P. (2005). Uncertainty, neuromodulation, and attention. Neuron, 46(4):681-692.
Download


Paper Citation


in Harvard Style

Alexandre F., Carrere M. and Kassab R. (2014). Feature, Configuration, History - A Bio-inspired Framework for Information Representation in Neural Networks . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014) ISBN 978-989-758-054-3, pages 316-321. DOI: 10.5220/0005156003160321


in Bibtex Style

@conference{ncta14,
author={Frédéric Alexandre and Maxime Carrere and Randa Kassab},
title={Feature, Configuration, History - A Bio-inspired Framework for Information Representation in Neural Networks},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)},
year={2014},
pages={316-321},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005156003160321},
isbn={978-989-758-054-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)
TI - Feature, Configuration, History - A Bio-inspired Framework for Information Representation in Neural Networks
SN - 978-989-758-054-3
AU - Alexandre F.
AU - Carrere M.
AU - Kassab R.
PY - 2014
SP - 316
EP - 321
DO - 10.5220/0005156003160321