Beyond Machine Learning: Autonomous Learning

Frédéric Alexandre

2016

Abstract

Recently, Machine Learning has achieved impressive results, surpassing human performances, but these powerful algorithms are still unable to define their goals by themselves or to adapt when the task changes. In short, they are not autonomous. In this paper, we explain why autonomy is an important criterion for really powerful learning algorithms. We propose a number of characteristics that make humans more autonomous than machines when they learn. Humans have a system of memories where one memory can compensate or train another memory if needed. They are able to detect uncertainties and adapt accordingly. They are able to define their goals by themselves, from internal and external cues and are capable of self-evaluation to adapt their learning behavior. We also suggest that introducing these characteristics in the domain of Machine Learning is a critical challenge for future intelligent systems.

References

  1. Alexandre, F. (2000). Biological Inspiration for Multiple Memories Implementation and Cooperation. In In V. Kvasnicka P. Sincak, J. Vascak and R. Mesiar, editors, International Conference on Computational Intelligence.
  2. Alexandre, F. and Carrere, M. (2016). Modeling neuromodulation as a framework to integrate uncertainty in general cognitive architectures. In Steunebrink, B., Wang, P., and Goertzel, B., editors, Artificial General Intelligence: 9th International Conference, AGI 2016, New York, NY, USA, July 16-19, 2016, Proceedings, pages 324-333. Springer International Publishing.
  3. Badre, D. (2008). Cognitive control, hierarchy, and the rostrocaudal organization of the frontal lobes. Trends in Cognitive Sciences, 12(5):193-200.
  4. Cardinal, R. N., Parkinson, J. A., Hall, J., and Everitt, B. J. (2002). Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neuroscience & Biobehavioral Reviews, 26(3):321-352.
  5. Carrere, M. and Alexandre, F. (2015). A pavlovian model of the amygdala and its influence within the medial temporal lobe. Frontiers in Systems Neuroscience, 9(41).
  6. Carrere, M. and Alexandre, F. (2016a). A system-level model of noradrenergic function. In The Sixth Joint IEEE International Conference on Developmental Learning and Epigenetic Robotics, September 19th 22nd 2016 Cergy-Pontoise. IEEE.
  7. Carrere, M. and Alexandre, F. (2016b). A system-level model of noradrenergic function. In Villa, E. A., Masulli, P., and Pons Rivero, J. A., editors, Artificial Neural Networks and Machine Learning - ICANN 2016: 25th International Conference on Artificial Neural Networks, Barcelona, Spain, September 6-9, 2016, Proceedings, Part I, pages 214-221. Springer International Publishing.
  8. Clark, C. and Storkey, A. J. (2015). Training Deep Convolutional Neural Networks to Play Go. In Proceedings of the 32nd International Conference on Machine Learning, volume 37, pages 1766-1774.
  9. Cohen, J. D., McClure, S. M., and Yu, A. J. (2007). Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration. Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 362(1481):933-942.
  10. Craig, A. D. (2003). Interoception: the sense of the physiological condition of the body. Current Opinion in Neurobiology, 13(4):500-505.
  11. Denoyelle, N., Pouget, F., Viéville, T., and Alexandre, F. (2014). VirtualEnaction: A Platform for Systemic Neuroscience Simulation. In International Congress on Neurotechnology, Electronics and Informatics, Rome, Italy.
  12. Donoso, M., Collins, A. G., and Koechlin, E. (2014). Foundations of human reasoning in the prefrontal cortex. Science (New York, N.Y.), 344(6191):1481-1486.
  13. Doya, K. (2002). Metalearning and neuromodulation. Neural Networks, 15(4-6):495-506.
  14. Farabet, C., Couprie, C., Najman, L., and LeCun, Y. (2013). Learning hierarchical features for scene labeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8):1915-1929.
  15. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. In Proceedings of the National Academy of Sciences, USA, pages 2554-2558.
  16. Humphries, M. D., Khamassi, M., and Gurney, K. (2012). Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Frontiers in Neuroscience, 6(9).
  17. Kassab, R. and Alexandre, F. (2015). Integration of exteroceptive and interoceptive information within the hippocampus: a computational study. Frontiers in Systems Neuroscience, 9(87).
  18. Kim, D., Paré, D., and Nair, S. S. (2013). Mechanisms contributing to the induction and storage of Pavlovian fear memories in the lateral amygdala. Learning & memory (Cold Spring Harbor, N.Y.), 20(8):421-430.
  19. Koechlin, E., Ody, C., and Kouneiher, F. (2003). The Architecture of Cognitive Control in the Human Prefrontal Cortex. Science, 302(5648):1181-1185.
  20. Kolling, N., Behrens, T. E. J., Wittmann, M. K., and Rushworth, M. F. S. (2016). Multiple signals in anterior cingulate cortex. Current Opinion in Neurobiology, 37:36-43.
  21. Krasne, F. B., Fanselow, M. S., and Zelikowsky, M. (2011). Design of a Neurally Plausible Model of Fear Learning. Frontiers in Behavioral Neuroscience, 5:41+.
  22. LeCun, Y., Bengio, Y., and Hinton, G. (2015). Deep learning. Nature, 521(7553):436-444.
  23. Mannella, F., Gurney, K., and Baldassarre, G. (2013). The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Frontiers in behavioral neuroscience, 7.
  24. McClelland, J. L., McNaughton, B. L., and O'Reilly, R. C. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological review, 102(3):419-457.
  25. O'Reilly, R. C. and Rudy, J. W. (2001). Conjunctive Representations in Learning and Memory: Principles of Cortical and Hippocampal Function. Psychological Review, 108(2):311-345.
  26. Oudeyer, P.-Y., Kaplan, F., and Hafner, V. (2007). Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation, 11(2):265-286.
  27. Pauli, W. M. and O'Reilly, R. C. (2008). Attentional control of associative learning-a possible role of the central cholinergic system. Brain Research, 1202:43-53.
  28. Piron, C., Kase, D., Topalidou, M., Goillandeau, M., Rougier, N. P., and Boraud, T. (2016). The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox. Movement Disorders.
  29. Rosenblatt, F. (1958). The perceptron: a probabilistic model for information storage and organization in the brain. In Anderson, J. A. and Rosenfeld, E., editors, Neurocomputing: Foundations of Research (1989), pages 89-92. The MIT Press.
  30. Squire, L. R. (1992). Declarative and nondeclarative memory: multiple brain systems supporting learning and memory. J Cogn Neurosci, 4(3):232-243.
  31. Yu, A. J. and Dayan, P. (2005). Uncertainty, Neuromodulation, and Attention. Neuron, 46(4).
  32. Zahm, D. S. (1999). Functional-anatomical implications of the nucleus accumbens core and shell subterritories. Annals of the New York Academy of Sciences, 877:113-128.
Download


Paper Citation


in Harvard Style

Alexandre F. (2016). Beyond Machine Learning: Autonomous Learning . In Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (IJCCI 2016) ISBN 978-989-758-201-1, pages 97-101. DOI: 10.5220/0006090300970101


in Bibtex Style

@conference{ncta16,
author={Frédéric Alexandre},
title={Beyond Machine Learning: Autonomous Learning},
booktitle={Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (IJCCI 2016)},
year={2016},
pages={97-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006090300970101},
isbn={978-989-758-201-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Joint Conference on Computational Intelligence - Volume 3: NCTA, (IJCCI 2016)
TI - Beyond Machine Learning: Autonomous Learning
SN - 978-989-758-201-1
AU - Alexandre F.
PY - 2016
SP - 97
EP - 101
DO - 10.5220/0006090300970101