LEARNING BY OBSERVATION IN SOFTWARE AGENTS

Paulo Costa, Luis Botelho

2012

Abstract

In a society of similar agents, all of them using the same kind of knowledge representation, learning with others could be achieved through direct transfer of knowledge from experts to apprentices. However, not all agents use the same kind of representation methods, hence learning by direct communication of knowledge is not always possible. In such cases, learning by observation might be of key importance. This paper presents an agent architecture that provides software agents with learning by observation capabilities similar to those observed in superior mammals. The main contribution of our proposal is to let software agents learn by direct observation of the actions being performed by expert agents. This is possible because, using the proposed architecture, agents may see one another.

References

  1. Alpaydin, E. (2004). Introduction to machine learning. MIT Press, Cambridge Mass.
  2. Argall, B. D., Chernova, S., Veloso, M., and Browning, B. (2009). A Survey of Robot Learning from Demonstration, volume Robotics and Autonomous Systems, pages 469-483. Elsevier.
  3. Bandura, A. (1977). Social learning theory. Prentice Hall.
  4. Billard, A. and Dautenhahn, K. (1999). Experiments in learning by imitation - grounding and use of communication in robotic agents.
  5. Costa, P. and Botelho, L. (2011). Software image for learning by observation. Proceedings of 15th Portuguese Conference on Artificial Intelligence (EPIA 2011), pages 872-884.
  6. Dautenhahn, K. (1994). Trying to imitate - a step towards releasing robots from social isolation. Proceedings of From perception to action conference, pages 290-301.
  7. Demiris, J. and Hayes, G. (2002). Imitation as a dual-route process featuring predictive and learning components. a biologically plausible computational model. In Dautenhahn, K. and Nehaniv, C., editors, Imitation in animals and artifacts, pages 327-361. Cambridge, MIT press edition.
  8. di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., and Rizzolatti, G. (1992). Understanding motor events: a neurophysiological study. Experimental brain research. Experimentelle Hirnforschung. Expérimentation cérébrale, 91(1):176-180.
  9. Kerstin, T. Q., Dautenhahn, K., and Nehaniv, C. L. (1999). The essence of embodiment: A framework for understanding and exploiting structural coupling between system and environment.
  10. Meunier, M., Monfardini, E., and Boussaoud, D. (2007). Learning by observation in rhesus monkeys. Neurobiol Learn Mem, 88(2):243-8.
  11. Milstein, M., Linick, S., Lonsdorf, E., and Ross, S. (2008). A comparison between chimpanzee (pan troglodytes) and gorilla (gorilla gorilla gorilla) social tolerance at an artificial termite mound. AMERICAN JOURNAL OF PRIMATOLOGY.
  12. Mitchell, T. M. (1997). Machine Learning. McGraw-Hill, New York.
  13. Moore, B. (1992). Avian movement imitation and a new form of mimicry: tracing the evolution of a complex form of learning. Behaviour, 122:231-263.
  14. Ramachandran, V. S. (2003). The emerging mind: the Reith Lectures 2003. Profile Books.
  15. Ramachandran, V. S. (2006). Mirror neurons and imitation learning as the driving force behind ”the great leap forward” in human evolution. Edge Foundation.
  16. Rizzolatti, G., Fadiga, L., Gallese, V., and Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Brain research. Cognitive brain research, 3(2):131-141.
Download


Paper Citation


in Harvard Style

Costa P. and Botelho L. (2012). LEARNING BY OBSERVATION IN SOFTWARE AGENTS . In Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-96-6, pages 276-281. DOI: 10.5220/0003834502760281


in Bibtex Style

@conference{icaart12,
author={Paulo Costa and Luis Botelho},
title={LEARNING BY OBSERVATION IN SOFTWARE AGENTS},
booktitle={Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2012},
pages={276-281},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003834502760281},
isbn={978-989-8425-96-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - LEARNING BY OBSERVATION IN SOFTWARE AGENTS
SN - 978-989-8425-96-6
AU - Costa P.
AU - Botelho L.
PY - 2012
SP - 276
EP - 281
DO - 10.5220/0003834502760281