HOW DEVELOPERS TEST THEIR OPEN SOURCE SOFTWARE PRODUCTS - A Survey of Well-known OSS Projects

Davide Tosi, Abbas Tahir

2010

Abstract

Open Source Software (OSS) projects do not usually follow the traditional software engineering developmentparadigms found in textbooks, thus influencing the way OSS developers test their products. In this paper, we explore a set of 33 well-known OSS projects to identify how software quality assurance is performed under the OSS model. The survey investigates the main characteristics of the projects and common testing issues to understand whether a correlation exists between the complexity of the project and the quality of its testing activity. We compare the results obtained in our survey with the data collected in a previous survey by L. Zhao and S. Elbaum. Our results confirm that OSS is usually not validated enough and therefore its quality is not revealed enough. To reverse this negative trend, the paper suggests the use of a testing framework that can support most of the phases of a well-planned testing activity, and describes the use of Aspect Oriented Programming (AOP) to expose dynamic quality attributes of OSS projects.

References

  1. Arisholm, E., Briand, L., and Foyen, A. (2004). Dynamic coupling measurement for object-oriented software. IEEE Transactions on Software Engineering (TSE), 30(8):491-506.
  2. Cavarero, J. and Cuaresma, M. (2004). Metrics for dynamics: How to improve the behaviour of an object information system. In Proceedings of the International Conference on Enterprise Information Systems (ICEIS), pages 344-349.
  3. Cazzola, W. and Marchetto, A. (2008). Aop hiddenmetrics: Separation, extensibility and adaptability in sw measurement. Journal of Object Technology, 7(2):53-68.
  4. Chidamber, S. and Kemerer, C. (2003). A metrics suite for object oriented design. IEEE Transactions on Software Engineering (TSE), 20(6):476-493.
  5. IEEE (1998). IEEE standard for software test documentation: IEEE std. 829-1998.
  6. Lewis, W. (2004). Software Testing and Continuous Quality Improvement. Auerbach, second edition.
  7. Mitchell, A. and Power, J. (2005). Using object-level runtime metrics to study coupling between objects. In Proceedings of the ACM Symposium on Applied Computing (SAC), pages 1456-1462.
  8. Qualipso (2009). Web www.qualipso.eu/node/129. Accessed: ber 2009.
  9. Wiese, D. and Meunier, R. (2008). Large scale application for aop in the healthcare domain: A case study. In Proceedings of the Aspect Oriented Software Conference (AOSD).
  10. Yacoub, S., Ammar, H., and Robinson, T. (1998). Dynamic metrics for object oriented designs. In Proceedings of the IEEE International Symposium on Software Metrics, pages 50-61.
  11. Zhao, L. and Elbaum, S. (2000). A Survey on quality related activities in OS. ACM Software Engineering Notes, 25(2):54-57.
  12. Zhao, L. and Elbaum, S. (2003). Quality assurance under the open source development model. International Journal of Systems and Software, 66(1):65-75.
Download


Paper Citation


in Harvard Style

Tosi D. and Tahir A. (2010). HOW DEVELOPERS TEST THEIR OPEN SOURCE SOFTWARE PRODUCTS - A Survey of Well-known OSS Projects . In Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT, ISBN 978-989-8425-23-2, pages 22-31. DOI: 10.5220/0002919600220031


in Bibtex Style

@conference{icsoft10,
author={Davide Tosi and Abbas Tahir},
title={HOW DEVELOPERS TEST THEIR OPEN SOURCE SOFTWARE PRODUCTS - A Survey of Well-known OSS Projects},
booktitle={Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT,},
year={2010},
pages={22-31},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002919600220031},
isbn={978-989-8425-23-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Software and Data Technologies - Volume 2: ICSOFT,
TI - HOW DEVELOPERS TEST THEIR OPEN SOURCE SOFTWARE PRODUCTS - A Survey of Well-known OSS Projects
SN - 978-989-8425-23-2
AU - Tosi D.
AU - Tahir A.
PY - 2010
SP - 22
EP - 31
DO - 10.5220/0002919600220031