A METRICS PROPOSAL TO EVALUATE SOFTWARE INTERNAL QUALITY WITH SCENARIOS

Anna Grimán, María Pérez, Maryoly Ortega, Luis Mendoza

2007

Abstract

Software quality should be evaluated from different perspectives; we highlight the internal and external ones (ISO/IEC, 2002). Specially, internal quality evaluation depends on the software architecture (or design) and programming aspects rather than on the product behavior. On the other hand, architectural evaluation methods tend to apply scenarios for assessing the architecture respect to quality requirements; however, mainly scenarios aren’t effective enough to determine the level of satisfaction of the quality attributes. In practice, each scenario could need more than one measurement. Also, we need a quantitative way of comparing and reporting results. The main objective of this article is presenting a proposal of metrics grouped by quality characteristics and sub-characteristics, according to ISO 9126 standard, which can be applied to assess software quality based on architecture. Once selected the most important quality requirements, these metrics can be used directly, or in combination with quality scenarios, into an architectural evaluation method. Metrics proposed also consider some particular technologies, such as OO, distributed and web systems.

References

  1. Azuma, M. 1996. Software products evaluation system: Quality models, metrics and processes -international standards and Japanese practice. Information and Software Technology, 38 (3 SPEC. ISS.):145-154.
  2. Barbacci, M, Klein, M., Weinstock, C., 1997. Principles for evaluating the quality Attributes of a Software Architecture. Technical Report CMU/SEI-96-TR-036.
  3. Basili, V., 1992. Software modeling and measurement: The Goal/Question/Metric paradigm. Technical Report CS-TR-2956, Department of Computer Science, University of Maryland, College Park, MD 20742.
  4. Bass, L., John, B., Kates, J., 2001. Achieving Usability through Software Architecture. CMU/SEI-TR-2001- 005. Software Engineering Institute.
  5. Bass, L., Clements, P. and Kazman, R., 2003. Software arquitecture in practice. Addison Wesley Longman Inc., USA.
  6. Clements, P., Kazman, R., Klein M., 2002. Evaluating Software Architectures: Methods and Case Studies. The SEI Series in Software Engineering.
  7. Grimán, A., Pérez, M., Mendoza, L, 2003. Estrategia de pruebas para software OO que garanticen requerimientos no funcionales. In III Workshop de Ingeniería del Software, Jornadas Chilenas de Computación.
  8. Grimán, A., Lucena, E., Pérez, M., Mendoza, L., 2003. Quality-oriented Architectural Approaches for Enterprise Systems. In 6th Annual Conference of the Southern Association for Information Systems.
  9. Grimán. A., Pérez, M., Mendoza, L, Hidalgo, I., 2004. Evaluación de la calidad de patrones arquitectónicos a través de experimentos cuantitativos. In Jornadas Iberoamericanas de Ingeniería del Software e Ingeniería del Conocimiento.
  10. Griman, A., Valdosera, L., Mendoza, L., Pérez, M., Méndez, E., 2005. Issues for Evaluating Reliability in Software Architecture. In 8th Americas Conference on Information Systems.
  11. Griman, A.; Chávez, L.; Pérez, M.; Mendoza, L.; Dominguez, K. 2006. Towards a Maintainability Evaluation in Software Architectures. In 8th International Conference on Enterprise Information Systems - ICEIS . Vol. 1: 555 - 558.
  12. ISO/IEC, 2002. Software Engineering - Software quality - General overview, reference models and guide to Software Product Quality Requirements and Evaluation (SQuaRE). Reporte. JTC1/SC7/WG6.
  13. Lee, K. and Lee, S. 2006. A quantitative evaluation model using the ISO/IEC 9126 quality model in the component based development process. Lecture Notes in Computer Science: 917-926.
  14. Losavio, F., Levy, N., 2002. Putting ISO standards into practice for Architecture evaluation with the Unified Process. Journal of Object Technology, Vol. 2, Nº 2.
  15. Mavromoustakos, S. and Andreou, A. 2007. WAQE: A Web Application Quality Evaluation model. In International Journal of Web Engineering and Technology, 3 (1): 96-120.
  16. Ortega, M, Pérez, M., Rojas, T., 2003. Construction of a Systemic Quality Model for evaluating a Software Product. Software Quality Journal. Kluwer Academic Publishers, 11 (3): 219-242.
Download


Paper Citation


in Harvard Style

Grimán A., Pérez M., Ortega M. and Mendoza L. (2007). A METRICS PROPOSAL TO EVALUATE SOFTWARE INTERNAL QUALITY WITH SCENARIOS . In Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-972-8865-88-7, pages 558-563. DOI: 10.5220/0002391905580563


in Bibtex Style

@conference{iceis07,
author={Anna Grimán and María Pérez and Maryoly Ortega and Luis Mendoza},
title={A METRICS PROPOSAL TO EVALUATE SOFTWARE INTERNAL QUALITY WITH SCENARIOS},
booktitle={Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2007},
pages={558-563},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002391905580563},
isbn={978-972-8865-88-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - A METRICS PROPOSAL TO EVALUATE SOFTWARE INTERNAL QUALITY WITH SCENARIOS
SN - 978-972-8865-88-7
AU - Grimán A.
AU - Pérez M.
AU - Ortega M.
AU - Mendoza L.
PY - 2007
SP - 558
EP - 563
DO - 10.5220/0002391905580563