Using Model Scoping with Expected Model Elements to Support Software Model Inspections: Results of a Controlled Experiment

Carlos Gracioli Neto, Amadeu Anderlin Neto, Marcos Kalinowski, Daniel Cardoso Moraes de Oliveira, Marta Sabou, Dietmar Winkler, Stefan Biffl

2019

Abstract

Context: Software inspection represents an effective way to identify defects in early phase software artifacts, such as models. Unfortunately, large models and associated reference documents cannot be thoroughly inspected in one inspection session of typically up to two hours. Considerably longer sessions have shown a much lower defect detection efficiency due to cognitive fatigue. Goal: The goal of this paper is to propose and evaluate a Model Scoping approach to allow inspecting specific parts of interest in large models. Method: First, we designed the approach, which involves identifying Expected Model Elements (EMEs) in selected parts of the reference document and then using these EMEs to scope the model (i.e., remove unrelated parts). These EMEs can also be used to support inspectors during defect detection. We conducted a controlled experiment using industrial artifacts. Subjects were asked to conduct UML class diagram inspections based on selected parts of functional specifications. In the experimental treatment, Model Scoping was applied and inspectors were provided with the scoped model and the EMEs. The control group used the original model directly, without EMEs. We measured the inspectors’ defect detection effectiveness and efficiency and collected qualitative data on the perceived complexity. Results: Applying Model Scoping prior to the inspection significantly increased the inspector defect detection effectiveness and efficiency, with large effect sizes. Qualitative data allowed observing a perception of reduced complexity during the inspection. Conclusion: Being able to effectively and efficiently inspect large models against selected parts of reference documents is a practical need, in particular in the context of incremental and agile process models. The experiment showed promising results for supporting such inspections using the proposed Model Scoping approach.

Paper Citation

in Harvard Style

Neto C., Neto A., Kalinowski M., Moraes de Oliveira D., Sabou M., Winkler D. and Biffl S. (2019). Using Model Scoping with Expected Model Elements to Support Software Model Inspections: Results of a Controlled Experiment.In Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-372-8, pages 107-118. DOI: 10.5220/0007691001070118

in Bibtex Style

@conference{iceis19,
author={Carlos Neto and Amadeu Neto and Marcos Kalinowski and Daniel Moraes de Oliveira and Marta Sabou and Dietmar Winkler and Stefan Biffl},
title={Using Model Scoping with Expected Model Elements to Support Software Model Inspections: Results of a Controlled Experiment},
booktitle={Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2019},
pages={107-118},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007691001070118},
isbn={978-989-758-372-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Using Model Scoping with Expected Model Elements to Support Software Model Inspections: Results of a Controlled Experiment
SN - 978-989-758-372-8
AU - Neto C.
AU - Neto A.
AU - Kalinowski M.
AU - Moraes de Oliveira D.
AU - Sabou M.
AU - Winkler D.
AU - Biffl S.
PY - 2019
SP - 107
EP - 118
DO - 10.5220/0007691001070118