Structuring Software Measurement - Metrication in the Context of Feedback Loops

Jos J. M. Trienekens, Rob J. Kusters

2014

Abstract

This paper presents results of a case study in a software engineering department of a large industrial company. This software engineering department struggles with the monitoring and control of the performance of software projects. The current measurement processes doesn’t provide adequate and sufficient information to both project and organisational management. Based on an analysis of the current measurement processes four guidelines for measurement process improvement have been proposed. Following these guidelines a three-level feedback loop has been developed and been implemented. This multi-level feedback loop distinguishes measurement, analysis and improvement on respectively the project, the multi-project and the organisational level. In the context of this feedback loop new ‘process oriented’ metrics have been identified in collaboration with project and organisational management. Preliminary results show that these ‘process oriented’ metrics, i.e. regarding different types of effort deviations, provide useful insights in the performance of software projects for managers on the different levels of the implemented feedback loops.

References

  1. Balla, K., Bemelmans, T., Kusters, R., Trienekens, J. 2001, "Quality through Managed Improvement and Measurement (QMIM)", Software Quality Journal, vol. 9, no. 3, pp. 177-193.
  2. Basili, V. R. 1996, "The Role of Experimentation in Software Engineering: Past, Current, and Future", Proceedings of the 18th International Conference on Software engineering pp. 442-449.
  3. Basili, V. R., McGarry, F. E., Pajerski, R., and Zelkowitz, M. V. 2002, "Lessons learned from 25 years of process improvement: the rise and fall of the NASA software engineering laboratory", Proceedings of the 24th International Conference on Software Engineering pp. 69-79.
  4. Basili, V. R. & Rombach, H. D. 1988, "The TAME project: towards improvement-oriented software environments", Software Engineering, IEEE Transactions on, vol. 14, no. 6, pp. 758-773.
  5. Basili, Victor R., et al. 2010. "Linking software development and business strategy through measurement." Computer 43.4: 57-65.
  6. CMMI Product Team, CMMI for Development Version 1.3, Software Engineering Institute, USA, 2010.
  7. Houdek, F., Schneider, K., & Wieser, E. 1998, "Establishing experience factories at Daimler-Benz an experiencereport", Software Engineering, 1998. Proc. of the 1998 (20th) Intern. Conf. on pp. 443-447.
  8. Jäntti, Marko, Antti Lahtela, and Jukka Kaukola. 2011, Establishing a Measurement System for IT Service Management Processes: A Case Study. International Journal on Advances in Systems and Measurements 3.3 and 4, pp. 125-136.
  9. Oman, P. W. & Pfleeger, S. L. 1997, Applying software metrics IEEE Computer Society Press Los Alamitos, Calif.
  10. Solingen, R. & Berghout, E. 1999, The Goal/Question/Metric Method - A Practical Guide for Quality Improvement of Software Development, McGraw-Hill.
  11. Unterkalmsteiner, Michael, et al. 2012, Evaluation and Measurement of Software Process Improvement-A Systematic Literature Review. Software Engineering, IEEE Transactions on 38.2: 398-424.
Download


Paper Citation


in Harvard Style

J. M. Trienekens J. and J. Kusters R. (2014). Structuring Software Measurement - Metrication in the Context of Feedback Loops . In Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-028-4, pages 129-136. DOI: 10.5220/0004811401290136


in Bibtex Style

@conference{iceis14,
author={Jos J. M. Trienekens and Rob J. Kusters},
title={Structuring Software Measurement - Metrication in the Context of Feedback Loops},
booktitle={Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2014},
pages={129-136},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004811401290136},
isbn={978-989-758-028-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Structuring Software Measurement - Metrication in the Context of Feedback Loops
SN - 978-989-758-028-4
AU - J. M. Trienekens J.
AU - J. Kusters R.
PY - 2014
SP - 129
EP - 136
DO - 10.5220/0004811401290136