ON THE USE OF AN ON-LINE FREE-TEXT SCORING SYSTEM INDIVIDUALLY OR COLLABORATIVELY

Diana Pérez-Marín, Ismael Pascual-Nieto, Pilar Rodríguez

2009

Abstract

Willow is an adaptive web-based application that allows students to review course material. The system analyzes the students’ free-text answers providing immediate feedback to the students. In the past, Willow has been used by individuals working alone. However, the trend of improving learning performance by allowing students to cooperate inspired us to develop a collaborative version of Willow. Our hypothesis was that students working together can reach understanding of ideas better than working individually with Willow. Therefore, in this paper, we explore the collaborative use of the system. We describe from a computer-science perspective, the minimum changes that have to be done to the system in order to permit a collaborative review. Furthermore, we provide the preliminary results of an experiment in which 22 students were given the possibility of using the individual or collaborative version of Willow.

References

  1. Aguilar, G., Kaijiri, K., 2007. Design overview of an adaptive computer-based assessment system. Interactive Educational Multimedia, 116-130.
  2. Ausubel, D. (1963), The Psychology of meaningful verbal learning, New York: Grune and Stratton.
  3. Cicognani, A., 2000. Concept Mapping as a Collaborative Tool for Enhanced Online Learning, Educational Technology & Society 3(3), 150-158.
  4. Gokhale, A., 1995. Collaborative learning enhances critical thinking, Journal of Technology Education 7(1).
  5. Guetl, C., Dreher, H., Williams, R. 2005. E-tester: A computer-based tool for autogenerated question and answer assessment. E-Learn, AACE.
  6. Hearst, M., 2000. The debate on automated essay grading. IEEE Intelligent Systems 5(15), 22-37.
  7. Hermet, M., Szpakowicz, S., 2006. Symbolic assessment of free text answers in a second language tutoring system. Proceedings of the 10th Computer Assisted Assessment conference, Loughborough University.
  8. Johnson, R., Johnson, D., 1986. Action research: Cooperative learning in the science classroom. Science and Children 24, 31-32.
  9. McCafferty, S.; Jacobs, G. & Iddings, A. 2006, Cooperative Learning and Second Language Teaching, Cambridge University Press.
  10. Page, E., 1966. The imminence of grading essays by computer. Phi Delta Kappan 47(1), 238-243.
  11. Pérez-Marín, D., Alfonseca, E., Rodríguez, P. & PascualNieto, I. (2006). Willow: Automatic and adaptive assessment of students free-text answers, in Proceedings of the 22nd International Conference of the Spanish Society for the Natural Language Processing (SEPLN), 367-368.
  12. Pérez-Marín, D. 2007. Adaptive Computer Assisted Assessment of free-text students' answers: an approach to automatically generate students' conceptual models, PhD thesis, Universidad Autónoma de Madrid, Spain.
  13. Puntambekar, S.; Stylianou, A. & Hubscher, R. 2003. Improving Navigation and Learning in Hypertext Environments With Navigable Concept Maps, Human-Computer Interaction 18(4), 395--428.
  14. Smith, K.; Sheppard, S.; Johnson, D. & Johnson, R. (2005), 'Pedagogies of Engagement: Classroom-Based Practices', Journal of Engineering Education 94(1), 87-101.
  15. Rueda, U.; Larrañaga, M.; Elorriaga, J. & Arruarte, A. 2004, Validating DynMap as a mechanism to visualize the student's evolution through the learning process, Lecture notes in computer science 3320, 864-866.
  16. Valenti, S., Neri, F., Cucchiarelli, A., 2003. An Overview of Current Research on Automated Essay Grading. Journal of Information Technology Education 2.
  17. Vygotsky, L., 1978. Mind in society: The development of higher psychological processes, Cambridge: Harvard University Press.
  18. Zapata-Rivera, J. & Greer, J. 2001. Externalising Learner Modelling Representations, Proceedings of Workshop on External Representations of AIED: Multiple Forms and Multiple Roles, 71-76.
  19. Zapata-Rivera, J. 2004. Interacting with Inspectable Bayesian Student Models, International Journal of Artificial Intelligence in Education 14(2), 127-163.
Download


Paper Citation


in Harvard Style

Pérez-Marín D., Pascual-Nieto I. and Rodríguez P. (2009). ON THE USE OF AN ON-LINE FREE-TEXT SCORING SYSTEM INDIVIDUALLY OR COLLABORATIVELY . In Proceedings of the Fifth International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-8111-81-4, pages 501-506. DOI: 10.5220/0001820305010506


in Bibtex Style

@conference{webist09,
author={Diana Pérez-Marín and Ismael Pascual-Nieto and Pilar Rodríguez},
title={ON THE USE OF AN ON-LINE FREE-TEXT SCORING SYSTEM INDIVIDUALLY OR COLLABORATIVELY},
booktitle={Proceedings of the Fifth International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2009},
pages={501-506},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001820305010506},
isbn={978-989-8111-81-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fifth International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - ON THE USE OF AN ON-LINE FREE-TEXT SCORING SYSTEM INDIVIDUALLY OR COLLABORATIVELY
SN - 978-989-8111-81-4
AU - Pérez-Marín D.
AU - Pascual-Nieto I.
AU - Rodríguez P.
PY - 2009
SP - 501
EP - 506
DO - 10.5220/0001820305010506