Long Term-short Memory Neural Networks and Word2vec for Self-admitted Technical Debt Detection

Rafael Santos, Israel Santos, Methanias Rodrigues Júnior, Manoel Neto

2020

Abstract

Context: In software development, new functionalities and bug fixes are required to ensure a better user experience and to preserve software value for a longer period. Sometimes developers need to implement quick changes to meet deadlines rather than a better solution that would take longer. These easy choices, known as Technical Debt, can cause long-term negative impacts because they can bring extra effort to the team in the future. Technical debts must be managed and detected so that the team can evaluate the best way to deal with them and avoid more serious problems. One way to detect technical debts is through source code comments. Developers often insert comments in which they admit that there is a need to improve that part of the code later. This is known as Self-Admitted Technical Debt (SATD). Objective: Evaluate a Long short-term memory (LSTM) neural network model combined with Word2vec for word embedding to identify design and requirement SATDs from comments in source code. Method: We performed a controlled experiment to evaluate the quality of the model compared with two language models from literature and LSTM without word embedding in a labelled dataset. Results: The results showed that the LSTM model with Word2vec have improved in recall and f-measure. The LSTM model without word embedding achieves greater recall, but perform worse in precision and f-measure. Conclusion: Overall, we found that the LSTM model and word2vec can outperform other models.

Paper Citation

in Harvard Style

Santos R., Santos I., Rodrigues Júnior M. and Neto M. (2020). Long Term-short Memory Neural Networks and Word2vec for Self-admitted Technical Debt Detection.In Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-423-7, pages 157-165. DOI: 10.5220/0009796001570165

in Bibtex Style

@conference{iceis20,
author={Rafael Santos and Israel Santos and Methanias Rodrigues Júnior and Manoel Neto},
title={Long Term-short Memory Neural Networks and Word2vec for Self-admitted Technical Debt Detection},
booktitle={Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2020},
pages={157-165},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009796001570165},
isbn={978-989-758-423-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Long Term-short Memory Neural Networks and Word2vec for Self-admitted Technical Debt Detection
SN - 978-989-758-423-7
AU - Santos R.
AU - Santos I.
AU - Rodrigues Júnior M.
AU - Neto M.
PY - 2020
SP - 157
EP - 165
DO - 10.5220/0009796001570165