5.2.2 Evaluation Metrics
By analyzing all the results listed in Table 4, we noted
that the MD-DSS gives exactly the same results
(software functional size and status identification) for
business applications, web applications and real time
application. However, for the mobile apps (e.g.,
Restaurant management system) our MD-DSS could
not measure correctly the functional size of the
functional change respectively the structural size of
the structural change as well as the functional change
status respectively the structural change status. In
fact, this deviation can be related to the update or
reading information from the data storage device. It
depends on whether the data are stored in an internal
or external data storage devices. We compared the
manual results to the automatic results generated by
our tool by using the precision (see Eq. 2) and the
recall (see Eq. 3) metrics. Thus, our tool achieved a
precision and a recall equal to 93%.
Precision = T P/ T P + FP
(2)
Recall = T P/ T P + FN (3)
Where: – TP: number of functional changes
respectively the structural changes status correctly
identified by our tool. – FP: number of functional
changes respectively the structural changes status
incorrectly identified by our tool. – FN: False
negatives are the number of functional changes’
status incorrectly not identified.
6 CONCLUSION
This research explores the importance of a decision
support system based on functional and structural
measures for managing change requests in the
SCRUM process. The system evaluates requirement
changes by quantifying them as user stories, aiding in
prioritization and decision-making for product
owners, Scrum masters, development teams, and
managers. It was tested on 15 software development
projects with expert input, comparing automated and
manual methods. Future improvements will include
incorporating factors such as risk, functionality use,
complexity, urgency, change type, requestor, affected
product parts, and dependencies, using AI for
enhanced decision-making.
REFERENCES
Abran, A. (2010). Software Metrics and Software Metro-
logy. IEEE Computer Society.
Abran, A. (2015). Software Project Estimation: The Fun-
damentals for Providing High Quality Information to
Decision Makers. Wiley-IEEE Computer Society Pr,
1st edition.
Abdalhamid, S. and Mishra, A., 2017. Adopting of agile
methods in software development organizations:
systematic mapping. TEM Journal, 6(4), p.817
Al Salemi, A. M. and Yeoh, E. T. (2015). A survey on
product backlog change management and require- ment
traceability in agile (Scrum). In the 9th Malay- sian
Software Engineering Conference (MySEC), pa- ges
189–194.
Ambler, S. W. (2014). User Stories: An Agile Introduction.
Bano, M., Imtiaz, S., Ikram, N., Niazi, M., and Usman,
M. (2012).
Causes of requirement change - a systematic literature
review. In EASE 2012.
Berardi E., Buglione L., S. L. S. C. T. S. (2011). Guideline
for the use of cosmic fsm to manage agile projects, v1.0.
Cohn, M. (2004). User Stories Applied: For Agile Software
Development. Addison-Wesley Professional.
Commeyne, C., Abran, A., and Djouab, R. (2016). Effort
Estimation with Story Points and COSMIC Function
Points: An Industry Case Study.
COSMIC (2017). The COSMIC Functional Size Measure-
ment Method, Version 4.0.2, Measurement Manual.
COSMIC (2020). The COSMIC Functional Size Measure-
ment Method, Version 5.0, Announcement of Version
5.0 of the COSMIC Measurement Manual – March 31,
2020
Drury-Grogan, M., O’Dwyer, O.: An investigation of the
decision-making processin agile teams. Int. J. Inf.
Technol. Decis. Mak. 12(6), 1097–1120 (2013)
Desharnais, J. M., Kocaturk, B., and Abran, A. (2011).
Using the cosmic method to evaluate the quality of the
documentation of agile user stories. In 2011Joint Conf.
of the 21st International Workshop on Software
Measurement and the 6
th
International Conf.
on
Software
Process
and
Product Measurement,
pages269–272.
Dikert, K., Paasivaara, M., and Lassenius, C. (2016).
Challenges and success factors for large-scale agile
transformations. Journal of Systems and Software,
119(C):87–108.
Fairley, R.E.(2009).Managing andLeadingSoftwarePro-
jects. Wiley-IEEE Computer SocietyPr.
Furtado, F., Zisman, A.: Trace++ (2016): a traceability
approach to support transitioning to agile software
engineering. In: The 24th International Requirements
Engineering Conference (RE), pp. 66–75.
Gilb, T. (2018). Why agile product development systemati-
cally fails, and what to do about it!
Haoues, M., Sellami, A., and Ben-Abdallah, H. (2017).
Functional change impact analysis in use cases: An
approach based on COSMIC functional size measu-
rement. Science of Computer Programming, Special
Issueon AdvancesinSoftwareMeasurement,135:88– 104.
Hakim, H,.Sellami, A., and Ben-Abdallah, H. (2020). An
in-Depth Requirements Change Evaluation Process
using Functional and Structural Size Measures in the