QuESo - A Quality Model for Open Source Software Ecosystems

Oscar Franco-Bedoya, David Ameller, Dolors Costal, Xavier Franch

2014

Abstract

Open source software has witnessed an exponential growth in the last two decades and it is playing an increasingly important role in many companies and organizations leading to the formation of open source software ecosystems. In this paper we present a quality model that will allow the evaluation of those ecosystems in terms of their relevant quality characteristics such as health or activeness. To design this quality model we started by analysing the quality measures found during the execution of a systematic literature review on open source software ecosystems and, then, we classified and reorganized the set of measures in order to build a solid quality model.

References

  1. Agerfalk, P. J. and Fitzgerald, B. (2008). Outsourcing to an Unknown Workforce: Exploring Opensourcing as a Global Sourcing Strategy. Mis Quartely, 32(2):385- 409.
  2. Anderson, J. C., Narus, J. A., and Narayandas, D. (2009). Business Market Management: Understanding, Creating, and Delivering Value (3rd Edition). Prentice Hall.
  3. Barbosa, O. and Alves, C. (2011). A Systematic Mapping Study on Software Ecosystems. In Proceedings of the 3rd IWSECO, pages 15-26.
  4. Behkamal, B., Kahani, M., and Akbari, M. K. (2009). Customizing ISO 9126 quality model for evaluation of B2B applications. Information and Software Technology, 51(3):599-609.
  5. Franch, X. and Carvallo, J. P. (2003). Using quality models in software package selection. IEEE Software, 20:34- 41.
  6. Franco-Bedoya, O., Ameller, D., Costal, D., and Franch, X. (2014). Protocol for a systematic literature review on open source-software ecosystems. Technical report, Universitat Politcnica de Catalunya. Available online: www.essi.upc.edu/ gessi/papers/quesoslrprotocol.pdf.
  7. Gamalielsson, J., Lundell, B., and Lings, B. (2010). The Nagios community: An extended quantitative analysis. In Proceedings of the 6th OSS, pages 85-96. Springer.
  8. Glott, R., Haaland, K., and Bannier, S. (2013). D3.1 Draft Business Model Risk Requirements Report. Deliverable of the RISCOSS FP7 project (grant 318249).
  9. Goeminne, M. and Mens, T. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Analyzing ecosystems for open source software developer communities, pages 247-275. Volume 1 of (Jansen et al., 2013).
  10. Hartigh, E., Visscher, W., Tol, M., and Salas, A. J. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Measuring the health of a business ecosystem, pages 221- 245. Volume 1 of (Jansen et al., 2013).
  11. Iansiti, M. and Levien, R. (2004). Keystones and dominators: framing operating and technology strategy in a business ecosystem. Technical report, Harvard Business School.
  12. ISO/IEC 25000 (2014). Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE) - Guide to SQuaRE.
  13. ISO/IEC 9126 (2001). Product quality - Part 1: Quality model.
  14. Jacobson, I. (2004). Object-Oriented Software Engineering: A Use Case Driven Approach. Addison Wesley.
  15. Jansen, S. (2014). Measuring the health of open source software ecosystems: Beyond the scope of project health. Information and Software Technology, (Available online).
  16. Jansen, S., Brinkkemper, S., and Michael Cusumano (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, volume 1. Edward Elgar Publishing.
  17. Jansen, S. and Cusumano, M. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Defining software ecosystems: a survey of software platforms and business network governance, pages 13-28. Volume 1 of (Jansen et al., 2013).
  18. Jansen, S. and van Capelleveen, G. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Quality review and approval methods for extensions in software ecosystems, pages 187-217. Volume 1 of (Jansen et al., 2013).
  19. Jergensen, C. and Sarma, A. (2011). The onion patch: migration in open source ecosystems. In Proceedings of the 19th SIGSOFT and 13th ESEC/FSE, pages 70-80. ACM.
  20. Kilamo, T., Hammouda, I., Mikkonen, T., and Aaltonen, T. (2012). From proprietary to open source - Growing an open source ecosystem. Journal of Systems and Software, 85(7):1467-1478.
  21. Kitchenham, B. and Charters, S. (2007). Guidelines for performing Systematic Literature reviews in Software Engineering Version 2.3. Technical report, Keele University EBSE.
  22. Lungu, M., Lanza, M., Gˆirba, T., and Robbes, R. (2010). The Small Project Observatory: Visualizing software ecosystems. Science of Computer Programming, 75(4):264-275.
  23. Lungu, M., Malnati, J., and Lanza, M. (2009). Visualizing gnome with the small project observatory. In Proceedings of the 6th MSR, pages 103-106. IEEE.
  24. Manikas, K. and Hansen, K. M. (2013). Software ecosystems A systematic literature review. Journal of Systems and Software, 86(5):1294-1306.
  25. Mens, T. and Goeminne, M. (2011). Analysing the Evolution of Social Aspects of Open Source Software Ecosystems. In Proceedings of the 3rd IWSECO, pages 1-14.
  26. Neu, S., Lanza, M., Hattori, L., and D'Ambros, M. (2011). Telling stories about GNOME with Complicity. In Proceedings of the 6th VISSOFT, pages 1-8.
  27. Radulovic, F. and Garcia-Castro, R. (2011). Extending Software Quality Models - A Sample In The Domain of Semantic Technologies. In Proceedings of the 23rd SEKE, pages 25-30.
  28. Scacchi, W. (2007). Free/Open Source Software Development: Recent Research Results and Emerging Opportunities. In Proceedings of the 6th ESEC-FSE, pages 459-468.
  29. Soto, M. and Ciolkowski, M. (2009). The QualOSS open source assessment model measuring the performance of open source communities. In Proceedings of the 3rd ESEM, pages 498-501.
  30. van der Linden, F., Lundell, B., and Marttiin, P. (2009). Commodification of Industrial Software: A Case for Open Source. IEEE Software, 26(4):77-83.
  31. [R1] Gamalielsson, J., Lundell, B., and Lings, B. (2010). The Nagios community: An extended quantitative analysis. In Proceedings of the 6th OSS, pages 85-96. Springer.
  32. [R2] Goeminne, M. and Mens, T. (2010). A framework for analysing and visualising open source software ecosystems. In Proceedings of IWPSE-EVOL, pages 42-47. ACM.
  33. [R3] Goeminne, M. and Mens, T. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Analyzing ecosystems for open source software developer communities, pages 247-275. In (Jansen et al., 2013).
  34. [R4] Hartigh, E., Visscher, W., Tol, M., and Salas, A. J. (2013). Software Ecosystems: Analyzing and Managing Business Networks in the Software Industry, chapter Measuring the health of a business ecosystem, pages 221-245. In (Jansen et al., 2013).
  35. [R5] Jansen, S., Souer, J., Luinenburg, L., and Brinkkemper, S. (2012). Shades of gray: Opening up a software producing organization with the open software enterprise model. Journal of Systems and Software, 85(7):1495-1510.
  36. [R6] Jergensen, C. and Sarma, A. (2011). The onion patch: migration in open source ecosystems. In Proceedings of the 19th SIGSOFT and 13th ESEC/FSE, pages 70- 80. ACM.
  37. [R7] Kabbedijk, J. and Jansen, S. (2011). Steering insight: An exploration of the ruby software ecosystem. In Proceedings of the 2nd ICSOB, pages 44-55. Springer.
  38. [R8] Kilamo, T., Hammouda, I., Mikkonen, T., and Aaltonen, T. (2012). From proprietary to open source - Growing an open source ecosystem. Journal of Systems and Software, 85(7):1467-1478.
  39. [R9] Lungu, M., Lanza, M., Gˆirba, T., and Robbes, R. (2010). The Small Project Observatory: Visualizing software ecosystems. Science of Computer Programming, 75(4):264-275.
  40. [R10] Lungu, M., Malnati, J., and Lanza, M. (2009). Visualizing gnome with the small project observatory. In Proceedings of the 6th MSR, pages 103-106. IEEE.
  41. [R11] Mens, T. and Goeminne, M. (2011). Analysing the Evolution of Social Aspects of Open Source Software Ecosystems. In Proceedings of the 3rd IWSECO, pages 1-14.
  42. [R12] Neu, S., Lanza, M., Hattori, L., and D'Ambros, M. (2011). Telling stories about GNOME with Complicity. In Proceedings of the 6th VISSOFT, pages 1-8.
  43. [R13] Scacchi, W. and Alspaugh, T. A. (2012). Understanding the role of licenses and evolution in open architecture software ecosystems. Journal of Systems and Software, 85(7):1479-1494.
  44. [R14] Shao, J., Kuk, G., Anand, S., Morley, J. G., Jackson, M. J., and Mitchell, T. (2012). Mapping Collaboration in Open Source Geospatial Ecosystem. Transactions in GIS, 16(4):581-597.
  45. [R15] Ververs, E., van Bommel, R., and Jansen, S. (2011). Influences on developer participation in the Debian software ecosystem. In Proceedings of the MEDES, pages 89-93. ACM.
  46. [R16] Weiss, M. (2011). Economics of collectives. In Proceedings of the 15th SPLC, pages 39:1-39:8. ACM.
  47. [R17] Yu, L., Cawley, J., and Ramaswamy, S. (2012). Entropy-Based Study of Components in Open-Source Software Ecosystems. INFOCOMP Journal of Computer Science, 11(1):22-31.
Download


Paper Citation


in Harvard Style

Franco-Bedoya O., Ameller D., Costal D. and Franch X. (2014). QuESo - A Quality Model for Open Source Software Ecosystems . In Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014) ISBN 978-989-758-036-9, pages 209-221. DOI: 10.5220/0004993702090221


in Bibtex Style

@conference{icsoft-ea14,
author={Oscar Franco-Bedoya and David Ameller and Dolors Costal and Xavier Franch},
title={QuESo - A Quality Model for Open Source Software Ecosystems},
booktitle={Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014)},
year={2014},
pages={209-221},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004993702090221},
isbn={978-989-758-036-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014)
TI - QuESo - A Quality Model for Open Source Software Ecosystems
SN - 978-989-758-036-9
AU - Franco-Bedoya O.
AU - Ameller D.
AU - Costal D.
AU - Franch X.
PY - 2014
SP - 209
EP - 221
DO - 10.5220/0004993702090221