Quantum Probability in Operant Conditioning - Behavioral Uncertainty in Reinforcement Learning

Eduardo Alonso, Esther Mondragon

2014

Abstract

An implicit assumption in the study of operant conditioning and reinforcement learning is that behavior is stochastic, in that it depends on the probability that an outcome follows a response and on how the presence or absence of the output affects the frequency of the response. In this paper we argue that classical probability is not the right tool to represent uncertainty operant conditioning and propose an interpretation of behavioral states in terms of quantum probability instead.

References

  1. Busemeyer, J. R., Pothos, E. M., Franco, R. & Trueblood, J. S. (2011) A quantum theoretical explanation for probability judgment errors. Psychological Review 118(2):193-218.
  2. Domjan, M. (1994). Formulation of a behavior system for sexual conditioning. Psychonomic Bulletin & Review, 1, 421-428.
  3. Fanselow, M. S. (1994). Neural organization of the defensive behavior system responsible for fear. Psychonomic Bulletin & Review, 1, 429-438.
  4. Hughes, R. I. G. (1989) The structure and interpretation of quantum mechanics. Harvard University Press.
  5. Isham, C. J. (1989) Lectures on quantum theory. World Scientific.
  6. Killeen, P. R. (1992). Mechanics of the animate. Journal of the Experimental Analysis of Behavior, 57, 429- 463.
  7. Kolmogorov, A. N. (1933/1950) Foundations of the theory of probability. Chelsea Publishing Co.
  8. Pothos, E. M. & Busemeyer, J. R. (2009) A quantum probability explanation for violations of “rational” decision theory. Proceedings of the Royal Society B 276:2171-78.
  9. Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. Oxford, England: AppletonCentury.
  10. Staddon, J.E., & Cerutti, D. T. (2003). Operant behavior, Annual Review of Psychology, vol. 54, 115-144.
  11. Sutton, S. R., and Barto, A. G. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
  12. Timberlake, W., & Silva, K. M. (1995). Appetitive behavior in psychology, ethology, and behavior systems. In N. Thompson (Ed.), Perspectives in ethology: Vol. 11. Behavioral design, pp. 212-254. NY: Plenum.
Download


Paper Citation


in Harvard Style

Alonso E. and Mondragon E. (2014). Quantum Probability in Operant Conditioning - Behavioral Uncertainty in Reinforcement Learning . In Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-015-4, pages 548-551. DOI: 10.5220/0004903205480551


in Bibtex Style

@conference{icaart14,
author={Eduardo Alonso and Esther Mondragon},
title={Quantum Probability in Operant Conditioning - Behavioral Uncertainty in Reinforcement Learning},
booktitle={Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2014},
pages={548-551},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004903205480551},
isbn={978-989-758-015-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Quantum Probability in Operant Conditioning - Behavioral Uncertainty in Reinforcement Learning
SN - 978-989-758-015-4
AU - Alonso E.
AU - Mondragon E.
PY - 2014
SP - 548
EP - 551
DO - 10.5220/0004903205480551