Extracting Queryable Knowledge Graphs from User Stories: An Empirical Evaluation

Ayodeji Ladeinde, Chetan Arora, Hourieh Khalajzadeh, Tanjila Kanij, John Grundy

2023

Abstract

User stories are brief descriptions of a system feature told from a user’s point of view. During requirements elicitation, users and analysts co-specify these stories using natural language. A number of approaches have tried to use Natural Language Processing (NLP) techniques to extract different artefacts, such as domain models and conceptual models, and reason about software requirements, including user stories. However, large collections of user story models can be hard to navigate once specified. We extracted different components of user story data, including actors, entities and processes, using NLP techniques and modelled them with graphs. This allows us to organise and link the structures and information in user stories for better analysis by different stakeholders. Our NLP-based automated approach further allows the stakeholders to query the model to view the parts of multiple user stories of interest. This facilitates project development discussions between technical team members, domain experts and users. We evaluated our tool on user story datasets and through a user study. The evaluation of our approach shows an overall precision above 96% and a recall of 100%. The user study with eight participants showed that our querying approach is beneficial in practical contexts.

Paper Citation

in Harvard Style

Ladeinde A., Arora C., Khalajzadeh H., Kanij T. and Grundy J. (2023). Extracting Queryable Knowledge Graphs from User Stories: An Empirical Evaluation. In Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-758-647-7, SciTePress, pages 684-692. DOI: 10.5220/0011994400003464

in Bibtex Style

@conference{enase23,
author={Ayodeji Ladeinde and Chetan Arora and Hourieh Khalajzadeh and Tanjila Kanij and John Grundy},
title={Extracting Queryable Knowledge Graphs from User Stories: An Empirical Evaluation},
booktitle={Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2023},
pages={684-692},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011994400003464},
isbn={978-989-758-647-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - Extracting Queryable Knowledge Graphs from User Stories: An Empirical Evaluation
SN - 978-989-758-647-7
AU - Ladeinde A.
AU - Arora C.
AU - Khalajzadeh H.
AU - Kanij T.
AU - Grundy J.
PY - 2023
SP - 684
EP - 692
DO - 10.5220/0011994400003464
PB - SciTePress