loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Faiz Ali Shah ; Kairit Sirts and Dietmar Pfahl

Affiliation: Institute of Computer Science, University of Tartu, J. Liivi 2, 50409, Tartu and Estonia

Keyword(s): App Feature Extraction, Supervised Machine Learning, Annotation Guidelines, Requirements Engineering.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Knowledge Management and Information Sharing ; Knowledge-Based Systems ; Requirements Engineering ; Symbolic Systems

Abstract: The quality of automatic app feature extraction from app reviews depends on various aspects, e.g. the feature extraction method, training and evaluation datasets, evaluation method etc. Annotation guidelines used to guide the annotation of training and evaluation datasets can have a considerable impact to the quality of the whole system but it is one of the aspects that is often overlooked. We conducted a study in which we explore the effects of annotation guidelines to the quality of app feature extraction. We propose several changes to the existing annotation guidelines with the goal of making the extracted app features more useful to app developers. We test the proposed changes via simulating the application of the new annotation guidelines and evaluating the performance of the supervised machine learning models trained on datasets annotated with initial and simulated annotation guidelines. While the overall performance of automatic app feature extraction remains the same as compa red to the model trained on the dataset with initial annotations, the features extracted by the model trained on the dataset with simulated new annotations are less noisy and more informative to app developers. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.235.75.229

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Shah, F.; Sirts, K. and Pfahl, D. (2019). Simulating the Impact of Annotation Guidelines and Annotated Data on Extracting App Features from App Reviews. In Proceedings of the 14th International Conference on Software Technologies - ICSOFT; ISBN 978-989-758-379-7; ISSN 2184-2833, SciTePress, pages 384-396. DOI: 10.5220/0007909703840396

@conference{icsoft19,
author={Faiz Ali Shah. and Kairit Sirts. and Dietmar Pfahl.},
title={Simulating the Impact of Annotation Guidelines and Annotated Data on Extracting App Features from App Reviews},
booktitle={Proceedings of the 14th International Conference on Software Technologies - ICSOFT},
year={2019},
pages={384-396},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007909703840396},
isbn={978-989-758-379-7},
issn={2184-2833},
}

TY - CONF

JO - Proceedings of the 14th International Conference on Software Technologies - ICSOFT
TI - Simulating the Impact of Annotation Guidelines and Annotated Data on Extracting App Features from App Reviews
SN - 978-989-758-379-7
IS - 2184-2833
AU - Shah, F.
AU - Sirts, K.
AU - Pfahl, D.
PY - 2019
SP - 384
EP - 396
DO - 10.5220/0007909703840396
PB - SciTePress