Adaptation Schemes for Question's Level to be Proposed by Intelligent Tutoring Systems

Rina Azoulay, Esther David, Dorit Hutzler, Mireille Avigal

2014

Abstract

The main challenge in developing a good Intelligent Tutoring System (ITS) is suit the difficulty level of questions and tasks to the current student's capabilities. According to state of the art, most ITS systems use the Q-learning algorithm for this adaptation task. Our paper presents innovative results that compare the performance of several methods, most of which have not been previously applied for ITS, to handle the above challenge. In particular, to the best of our knowledge, this is the first attempt to apply the Bayesian inference algorithm to question level matching in ITS. To identify the best adaptation scheme based on this groundwork research, for the evaluation phase we used an artificial environment with simulated students. The results were benchmarked with the optimal performance of the system, assuming the user model (abilities) is completely known to the ITS. The results show that the best performing method, in most of the environments considered, is based on a Bayesian Inference, which achieved 90% or more of the optimal performance. Our conclusion is that it may be worthwhile to integrate Bayesian inference based algorithms to adapt questions to a student's level in ITS. Future work is required to apply these empirical results to environments with real students.

References

  1. Auer, P., Cesa-Bianchi, N. & Fischer, P., 2002, Finitetime Analysis of the Multiarmed Bandit Problem, Machine Learning, 47, 235-256.
  2. Azoulay-Schwartz, R., Katz, R. & Kraus, S. 2013, Efficient Bidding Strategies for Cliff-Edge Problems, Autonoumous agenst and multi-agent systems.
  3. Azoulay-Schwartz, R., Kraus, S. & Wilkenfeld, J., 2004, Explotation vs. Exploration in Ecommerce: Choosing a Supplier in an Environment of Incomplete Information, International Journal on Decision Support Systems and Electronic Commerce 381, p. 1-18.
  4. Beck, J. E., Woolf, B. P. & Beal, C. R. 2000, ADVISOR: A machine learning architecture for intelligent tutor construction. National Conference on Artificial Intelligence.
  5. Conitzer, V. & Garera, N., 2006, Learning algorithms for online principal-agent problems and selling 1416 goods online, Proceedings of the International Conference on Machine Learning, p. 209-216.
  6. Gittins, J. C., 1989, Multi-armed Bandit Allocation Indices. John Wiley & Sons.
  7. Harmon, M. E. & Harmon, S. S., 1997, Reinforcement Learning: A Tutorial. Publisher: Citeseer 1997. Volume: 21, Issue: 2.
  8. Iglesias, A., Martínez, P., Aler, R. & Fernández, F. 2008, Learning teaching strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning. Applied Intelligence. Volume 31, Number 1. p. 89-106.
  9. Malpani, A., Ravindran, B., & Murthy, H., 2009, Personalized Intelligent Tutoring System Using Reinforcement Learning. Twenty-Fourth International Florida Artificial Intelligence Research Society Conferences.
  10. Martin, K. N. & Arroyo, I., 2004, AgentX: Using Reinforcement Learning to Improve the Effectiveness of Intelligent Tutoring Systems. Lecture Notes in Computer Science, 2004, Volume 3220/2004, p. 564-572.
  11. Rusell, S. & Norving, P., 1995, Artificial Intelligence, A modern approach. Perntice hall, Inc.
  12. Sarma, H., 2007, Intelligent Tutoring Systems Using Reinforcement Learning, A Thesis, Thesis Sreenivasa, Indian Institute of Technology, Madras.
  13. Sarma, H., & Ravindran, B., 2007, Intelligent Tutoring Systems using Reinforcement Learning to teach Autistic students. Conference on Home/Community Oriented ICT for the Next Billion (HOIT).
  14. Sutton, R. S. & Barto, A. G., 2005, Reinforcement Learning: An Introduction. The MIT Press Cambridge, Massachusetts.
  15. Vreind, N., 1997. Will reasoning improve learning? Economics Letters, 55(1), p. 9-18.
  16. Woolf, B. P., 2009, Building Intelligent Interactive Tutors Student-centered strategies for revolutionizing elearning. Elsevier Inc.
Download


Paper Citation


in Harvard Style

Azoulay R., David E., Hutzler D. and Avigal M. (2014). Adaptation Schemes for Question's Level to be Proposed by Intelligent Tutoring Systems . In Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-015-4, pages 245-255. DOI: 10.5220/0004732402450255


in Bibtex Style

@conference{icaart14,
author={Rina Azoulay and Esther David and Dorit Hutzler and Mireille Avigal},
title={Adaptation Schemes for Question's Level to be Proposed by Intelligent Tutoring Systems},
booktitle={Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2014},
pages={245-255},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004732402450255},
isbn={978-989-758-015-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Adaptation Schemes for Question's Level to be Proposed by Intelligent Tutoring Systems
SN - 978-989-758-015-4
AU - Azoulay R.
AU - David E.
AU - Hutzler D.
AU - Avigal M.
PY - 2014
SP - 245
EP - 255
DO - 10.5220/0004732402450255