On Few-Shot Prompting for Controllable Question-Answer Generation in Narrative Comprehension

Bernardo Leite, Bernardo Leite, Henrique Cardoso, Henrique Cardoso

2024

Abstract

Question Generation aims to automatically generate questions based on a given input provided as context. A controllable question generation scheme focuses on generating questions with specific attributes, allowing better control. In this study, we propose a few-shot prompting strategy for controlling the generation of question-answer pairs from children’s narrative texts. We aim to control two attributes: the question’s explicitness and underlying narrative elements. With empirical evaluation, we show the effectiveness of controlling the generation process by employing few-shot prompting side by side with a reference model. Our experiments highlight instances where the few-shot strategy surpasses the reference model, particularly in scenarios such as semantic closeness evaluation and the diversity and coherency of question-answer pairs. However, these improvements are not always statistically significant. The code is publicly available at github.com/bernardoleite/few-shot-prompting-qg-control.

Paper Citation

in Harvard Style

Leite B. and Cardoso H. (2024). On Few-Shot Prompting for Controllable Question-Answer Generation in Narrative Comprehension. In Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU; ISBN 978-989-758-697-2, SciTePress, pages 63-74. DOI: 10.5220/0012623800003693

in Bibtex Style

@conference{csedu24,
author={Bernardo Leite and Henrique Cardoso},
title={On Few-Shot Prompting for Controllable Question-Answer Generation in Narrative Comprehension},
booktitle={Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU},
year={2024},
pages={63-74},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012623800003693},
isbn={978-989-758-697-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU
TI - On Few-Shot Prompting for Controllable Question-Answer Generation in Narrative Comprehension
SN - 978-989-758-697-2
AU - Leite B.
AU - Cardoso H.
PY - 2024
SP - 63
EP - 74
DO - 10.5220/0012623800003693
PB - SciTePress