AN EXPERIMENTAL PROTOTYPE FOR AUTOMATICALLY TESTING STUDENT PROGRAMS USING TOKEN PATTERNS

Chung Man Tang, Yuen Tak Yu, Chung Keung Poon

2010

Abstract

Automated systems and tools for assessing student programs are now commonly used for enhancing the teaching and learning of computer programming. However, many such systems employ rudimentary techniques in comparing program outputs when testing student programs for determining their correctness. These comparison techniques are typically inflexible and disallow even slight deviations of program output which a human assessor would normally tolerate. This may give rise to student frustrations and other undesirable pedagogical issues that can undermine the benefits of using these assessment tools. This paper presents an experimental prototype we have developed that adopts a token-pattern-based approach to accommodate more tolerant output comparisons in testing student programs, followed by a preliminary validation of the prototype by showing how it can be configured to handle the assessment of variants of program outputs.

References

  1. Ala-Mutka, K., 2005. A survey of automated assessment approaches for programming assignments. Computer Science Education, 15(2), 83-102.
  2. Choy, M., Lam, S., Poon, C. K., Wang, F. L., Yu, Y. T., Yuen, L., 2008. Design and implementation of an automated system for assessment of computer programming assignments. In Advances in Web-based Learning (LNCS 4823), 584-596. Springer.
  3. Choy, M., Lam, S., Poon, C. K., Wang, F. L., Yu, Y. T., Yuen, L., 2007. Towards blended learning of computer programming supported by an automated system. In Workshop on Blended Learning 2007. Pearson: Prentice Hall.
  4. Helmick, M. T., 2007. Interface-based programming assignments and automated grading of Java programs. In 12th Conference on Innovation and Technology in Computer Science Education (ITiCSE). ACM Press.
  5. Higgins, C., Hergazy, T., Symeonidis, P., Tsinsifas, A., 2003. The CourseMarker CBA system: Improvements over Ceilidh. Education and Information Technologies, 8(3), 287-304.
  6. Jackson, D., 1991. Using software tools to automate the assessment of student programs. Computers & Education, 17(2), 133-143.
  7. Jackson, D., Usher, M., 1997. Grading student programs using ASSYST. In SIGCSE'97, Technical Symposium on Computer Science Education. ACM Press.
  8. Joy, M., Griffiths, N., Royatt, R., 2005. The BOSS online submission and assessment system. ACM Journal on Educational Resources in Computing, 5(3), Article 2.
  9. Lam, M. S. W., Chan, E. Y. K., Lee, V. C. S., Yu, Y. T., 2008. Designing an automatic debugging assistant for improving the learning of computer programming. In ICHL 2008, International Conference on Hybrid Learning (LNCS 5169), 359-370. Springer.
  10. Law, K. M. Y., Lee, V. C. S., Yu, Y. T., 2010. Learning motivation in e-learning facilitated computer programming courses. Computers & Education, in press.
  11. Morris, D. S., 2003. Automatic grading of student's programming assignments: An interactive process and suite of programs. In 33rd ASEE/IEEE Frontiers in Education Conference. IEEE Computer Society Press.
  12. Tang, C. M., Yu, Y. T., Poon, C. K., 2009a. An approach towards automatic testing of student programs using token patterns. In ICCE 2009, 17th International Conference on Computers in Education.
  13. Tang, C. M., Yu, Y. T., Poon, C. K., 2009b. Automated systems for testing student programs: Practical issues and requirements. In SPECIAL 2009, International Workshop on Strategies for Practical Integration of Emerging and Contemporary Technologies in Assessment and Learning.
  14. Yu, Y. T., Choy, M. Y., Poon, C. K., 2006. Experiences with PASS: Developing and using a programming assignment assessment system. In QSIC 2006, 6th International Conference on Quality Software. IEEE Computer Society Press.
Download


Paper Citation


in Harvard Style

Man Tang C., Tak Yu Y. and Keung Poon C. (2010). AN EXPERIMENTAL PROTOTYPE FOR AUTOMATICALLY TESTING STUDENT PROGRAMS USING TOKEN PATTERNS . In Proceedings of the 2nd International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-674-024-5, pages 144-149. DOI: 10.5220/0002800301440149


in Bibtex Style

@conference{csedu10,
author={Chung Man Tang and Yuen Tak Yu and Chung Keung Poon},
title={AN EXPERIMENTAL PROTOTYPE FOR AUTOMATICALLY TESTING STUDENT PROGRAMS USING TOKEN PATTERNS},
booktitle={Proceedings of the 2nd International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2010},
pages={144-149},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002800301440149},
isbn={978-989-674-024-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - AN EXPERIMENTAL PROTOTYPE FOR AUTOMATICALLY TESTING STUDENT PROGRAMS USING TOKEN PATTERNS
SN - 978-989-674-024-5
AU - Man Tang C.
AU - Tak Yu Y.
AU - Keung Poon C.
PY - 2010
SP - 144
EP - 149
DO - 10.5220/0002800301440149