Paper Unlock

Authors: Anaga Mani 1 ; Divya Venkataramani 1 ; Jordi Petit 2 and Salvador Roura 2

Affiliations: 1 SASTRA University, India ; 2 Universitat Politècnica de Catalunya, Spain

ISBN: 978-989-758-021-5

ISSN: 2184-5026

Keyword(s): Online Programming Judges, Automatic Assessment, Data Mining.

Related Ontology Subjects/Areas/Topics: Assessment Software Tools ; Computer-Aided Assessment ; Computer-Supported Education ; e-Learning ; e-Learning Platforms ; Learning/Teaching Methodologies and Assessment ; Simulation and Modeling ; Simulation Tools and Platforms

Abstract: The verdicts of most online programming judges are, essentially, binary: the submitted codes are either “good enough” or not. Whilst this policy is appropriate for competitive or recruitment platforms, it can hinder the adoption of online judges on educative settings, where it could be adequate to provide better feedback to a student (or instructor) that has submitted a wrong code. An obvious option would be to just show him or her an instance where the code fails. However, that particular instance could be not very significant, and so could induce unreflectively patching the code. The approach considered in this paper is to data mine all the past incorrect submissions by all the users of the judge, so to extract a small subset of private test cases that may be relevant to most future users. Our solution is based on parsing the test files, building a bipartite graph, and solving a Set Cover problem by means of Integer Linear Programming. We have tested our solution with a hundred prob lems in Jutge.org. Those experiments suggest that our approach is general, efficient, and provides high quality results. (More)

PDF ImageFull Text


Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mani, A.; Venkataramani, D.; Petit, J. and Roura, S. (2014). Better Feedback for Educational Online Judges.In Proceedings of the 6th International Conference on Computer Supported Education - Volume 3: CSEDU, ISBN 978-989-758-021-5, ISSN 2184-5026, pages 176-183. DOI: 10.5220/0004842801760183

author={Anaga Mani. and Divya Venkataramani. and Jordi Petit. and Salvador Roura.},
title={Better Feedback for Educational Online Judges},
booktitle={Proceedings of the 6th International Conference on Computer Supported Education - Volume 3: CSEDU,},


JO - Proceedings of the 6th International Conference on Computer Supported Education - Volume 3: CSEDU,
TI - Better Feedback for Educational Online Judges
SN - 978-989-758-021-5
AU - Mani, A.
AU - Venkataramani, D.
AU - Petit, J.
AU - Roura, S.
PY - 2014
SP - 176
EP - 183
DO - 10.5220/0004842801760183

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.