Towards Gamification in Software Traceability: Between Test and Code Artifacts

Reza Meimandi Parizi, Asem Kasem, Azween Abdullah

2015

Abstract

With the ever-increasing dependence of our civil and social infrastructures to the correct functioning of software systems, the need for approaches to engineer reliable and validated software systems grows rapidly. Traceability is the ability to trace the influence of one software artifact on another by linking dependencies. Test-to-code traceability (relationships between test and system code) plays a vital role in the production, verification, reliability and certification of highly software-intensive dependable systems. Prior work on test-to-code traceability in contemporary software engineering environments and tools is not satisfactory and is limited with respect to the need regarding results accuracy, lack of motivation, and high required effort by developers/testers. This paper argues that a new research is necessary to tackle the above weaknesses. Thus, it advocates for the induction of gamification concepts in software traceability, and takes a position that the use of gamificaiton metrics can contribute to software traceability tasks in validating software and critical systems. We propose a research agenda to execute this position by providing a unifying foundation for gamified software traceability that combines self-adaptive, visualization, and predictive features for trace links.

References

  1. A.Qusef, Bavota, G., Oliveto, R., Lucia, A. D. & Binkley, D. 2012. Evaluating Test-To-Code Traceability Recovery Methods Through Controlled Experiments. Journal Of Software: Evolution And Process, 25, 1167-1191.
  2. Antoniol, G., Canfora, G., Casazza, G., Lucia, A. D. & Merlo, E. 2002. Recovering Traceability Links Between Code And Documentations. IEEE Transactions On Software Engineering, 28, 970-983.
  3. Bacchelli, A., Lanza, M. & Robbes, R. Linking E-Mails And Source Code Artifacts. Proceedings Of The 32nd Acm/Ieee International Conference On Software Engineering, 2010 Cape Town, South Africa. 1806855: Acm, 375-384.
  4. Bista, S. K., Nepal, S., Paris, C. & Colineau, N. 2014. Gamification For Online Communities: A Case Study For Delivering Government Services. International Journal Of Cooperative Information Systems 23.
  5. Browne, K., Anand, C. & Gosse, E. 2014. Gamification and Serious Game Approaches For Adult Literacy Tablet Software. Entertainment Computing, 5, 135- 146.
  6. Chen, N. Gate: Game-Based Testing Environment. Proceedings Of The 33rd International Conference On Software Engineering, 2011. 1078-1081.
  7. Chen, X. & Grundy, J. Improving Automated Documentation To Code Traceability By Combining Retrieval Techniques. Proceedings Of The 26th Ieee/Acm International Conference On Automated Software Engineering, 2011. 2190177: Ieee Computer Society, 223-232.
  8. Cleland-Huang, J., Gotel, O. C. Z., Hayes, J. H., Mader, P. & Zisman, A. Software Traceability: Trends And Future Directions. Proceedings Of The 36th International Conference On Software Engineering, 2014. Acm, 55-69.
  9. De-Marcos, L., Domínguez, A., Saenz-De-Navarrete, J. & Pagés, C. 2014. An Empirical Study Comparing Gamification And Social Networking On E-Learning. Computers & Education, 75, 82-91.
  10. Deterding, S., Dixon, D., Khaled, R. & Nacke, L. from Game Design Elements To Gamefulness: Defining "Gamification". Proceedings Of The 15th International Academic Mindtrek Conference: Envisioning Future Media Environments, 2011 Tampere, Finland. Acm, 9-15.
  11. Deursen, A. V. & Moonen, L. The Video Store RevisitedThoughts On Refactoring And Testing. Proceedings Of 3rd International Conferance, Extreme Programming And Flexible Processes In Software Engineering, 2002. 71-76.
  12. Dömges, R. & Pohl, K. 1998. Adapting Traceability Environments To Project-Specific Needs. Communications Of The Acm, 41, 54-62.
  13. Domínguez, A., Saenz-De-Navarrete, J., De-Marcos, L., Fernández-Sanz, L., Pagés, C. & Martínez-Herráiz, J.- J. 2013. Gamifying Learning Experiences: Practical Implications And Outcomes. Computers & Education, 63, 380-392.
  14. Dubois, D. J. & Tamburrelli, G. Understanding Gamification Mechanisms For Software Development. Proceedings Of The 9th Joint Meeting On Foundations Of Software Engineering, 2013 Saint Petersburg, Russia. 2494589: Acm, 659-662.
  15. Egyed, A. 2003. A Scenario-Driven Approach To Trace Dependency Analysis. Ieee Transactions On Software Engineering, 29, 116-132.
  16. Espinoza, A. & Garbajosa, J. 2011. A Study To Support Agile Methods More Effectively Through Traceability. Innovations In Systems And Software Engineering, 7, 53-69.
  17. Fernandes, J. A., Duarte, D., Ribeiro, C., Farinha, C., Pereira, J. A. M. & Silva, M. M. D. 2012. Ithink : A Game-Based Approach Towards Improving Collaboration And Participation In Requirement Elicitation. Procedia Computer Science 15 66 -77.
  18. Ghazarian, A. 2010. A Research Agenda For Software Reliability. Ieee Transactions On Reliability, Ieee Reliability Society Technical Operations Annual Technical Report For 2010, 59, 449-482.
  19. Herzig, P., Ameling, M. & Schill, A. A Generic Platform For Enterprise Gamification. Proceedings Of The Joint Working Ieee/Ifip Conference On Software Architecture And 6th European Conference On Software Architecture, 2012. 219-223.
  20. Huang, C.-Y. & Kuo, S.-Y. 2002. Analysis Of Incorporating Logistic Testing-Effort Function Into Software Reliability Modeling. Ieee Transactions On Reliability, 51, 261-270.
  21. Huang, C.-Y. & Lyu, M. R. 2005. Optimal Testing Resource Allocation, And Sensitivity Analysis In Software Development. Ieee Transactions On Reliability, 54, 592-603.
  22. Insley, V. & Nunan, D. 2014. Gamification And The Online Retail Experience. International Journal Of Retail & Distribution Management, 42, 340-351.
  23. Jirapanthong, W. & Zisman, A. 2009. Xtraque: Traceability For Product Line Systems. Software And System Modeling, 8, 1619-1366.
  24. Kifer, M. & Lausen, G. F-Logic: A Higher-Order Language For Reasoning About Objects, Inheritance, And Scheme. Proceedings Of The Acm Sigmod International Conference On Management Of Data, 1989. 134-146.
  25. Koivisto, J. & Hamari, J. 2014. Demographic Differences In Perceived Benefits From Gamification. Computers In Human Behavior, 35, 179-188.
  26. Kubat, P. & Koch, H. S. 1983. Managing Test-Procedures To Achieve Reliable Software. Ieee Transactions On Reliability, R-32, 299-303.
  27. Kuo, S.-Y., Huang, C.-Y. & Lyu, M. R. 2001. Framework For Modeling Software Reliability, Using Various Testing-Efforts And Fault-Detection Rates. Ieee Transactions On Reliability, 50, 310-320.
  28. Lago, P., Muccini, H. & Vliet, H. V. 2009. A Scoped Approach To Traceability Management. Journal Of Systems And Software, 82, 168-182.
  29. Lucia, A. D., Fasano, F., Oliveto, R. & Tortora, G. 2007. Recovering Traceability Links In Software Artifact Management Systems Using Information Retrieval Methods. Acm Transactions On Software Engineering And Methodology, 16, 13:1-13:50.
  30. Mader, P., Jones, P. L., Zhang, Y. & Cleland-Huang, J. 2013. Strategic Traceability For Safety-Critical Projects. Ieee Software, 30, 58-66.
  31. Marcus, A. & Maletic, J. I. Recovering DocumentationTo-Source-Code Traceability Links Using Latent Semantic Indexing. Proceedings Of The 25th International Conference On Software Engineering, 2003 Portland, Oregon. Ieee Computer Society, 125- 135.
  32. Ohtera, H. & Yamada, S. 1990. Optimal Allocation & Control Problems For Software-Testing Resources. Ieee Transactions On Reliability, 39, 171-176.
  33. Parizi, R. M., Lee, S. P. & Dabbagh, M. 2014. Achievements And Challenges In State-Of-The-Art Software Traceability Between Test And Code Artifacts. Ieee Transactions On Reliability, 63, 913- 926.
  34. Pedreira, O., García, F., Brisaboa, N. & Piattini, M. 2015. Gamification In Software Engineering - A Systematic Mapping. Information And Software Technology, 57, 157-168.
  35. Qusef, A., Bavota, G., Oliveto, R., De Lucia, A. & Binkley, D. Scotch: Test-To-Code Traceability Using Slicing And Conceptual Coupling. Proceedings Of The 27th Ieee International Conference On Software Maintenance 25-30 Sept. 2011 2011. 63-72.
  36. Qusef, A., Bavota, G., Oliveto, R., Lucia, A. D. & Binkley, D. 2014. Recovering Test-To-Code Traceability Using Slicing And Textual Analysis. Journal Of Systems And Software, 88, 147-168.
  37. Qusef, A., Oliveto, R. & De Lucia, A. Recovering Traceability Links Between Unit Tests And Classes Under Test: An Improved Method. Ieee International Conference On Software Maintenance (Icsm), 2010. 1- 10.
  38. Rodríguez Corral, J. M., Civit Balcells, A., Morgado Estévez, A., Jiménez Moreno, G. & Ferreiro Ramos, M. J. 2014. A Game-Based Approach To The Teaching Of Object-Oriented Programming Languages. Computers & Education, 73, 83-92.
  39. Rompaey, B. V. & Demeyer, S. Establishing Traceability Links Between Unit Test Cases And Units Under Test. Proceedings Of The 2009 European Conference On Software Maintenance And Reengineering, 2009. 1545440: Ieee Computer Society, 209-218.
  40. Simões, J., Redondo, R. D. & Vilas, A. F. 2013. A Social Gamification Framework For A K-6 Learning Platform. Computers In Human Behavior, 29, 345- 353.
  41. Sneed, H. M. Reverse Engineering Of Test Cases For Selective Regression Testing. Proceedings Of The 8th European Conference On Software Maintenance And Reengineering, 2004. 69-74.
  42. Sundaram, S. K., Hayes, J. H., Dekhtyar, A. & Holbrook, E. A. 2010. Assessing Traceability Of Software Engineering Artifacts. Requirements Engineering, 15, 313-335.
  43. Vasilescu, B. Human Aspects, Gamification, And Social Media In Collaborative Software Engineering. Proceedings Of The 36th International Conference On Software Engineering, 2014 Hyderabad, India. 2591091: Acm, 646-649.
  44. Wang, X., Lai, G. & Liu, C. 2009. Recovering Relationships Between Documentation And Source Code Based On The Characteristics Of Software Engineering. Electronic Notes In Theoretical Computer Science, 243, 121-137.
  45. Wang, Z., Tang, K. & Yao, X. 2010. Multi-Objective Approaches To Optimal Testing Resource Allocation In Modular Software Systems. Ieee Transactions On Reliability, 59, 563-575.
  46. Watkins, R. & Neal, M. 1994. Why And How Of Requirements Tracing. Ieee Software, 11, 104-106.
  47. Winkler, S. & Pilgrim, J. V. 2010. A Survey Of Traceability In Requirements Engineering And ModelDriven Development. Software And Systems Modeling, 9, 529-565.
  48. Witte, R., Li, Q., Informatic, F. F., Zhang, Y. & Rilling, J. 2008. Text Mining And Software Engineering: An Integrated Source Code And Document Analysis Approach. Iet Software 2, 1-19.
Download


Paper Citation


in Harvard Style

Meimandi Parizi R., Kasem A. and Abdullah A. (2015). Towards Gamification in Software Traceability: Between Test and Code Artifacts . In Proceedings of the 10th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2015) ISBN 978-989-758-114-4, pages 393-400. DOI: 10.5220/0005555503930400


in Bibtex Style

@conference{icsoft-ea15,
author={Reza Meimandi Parizi and Asem Kasem and Azween Abdullah},
title={Towards Gamification in Software Traceability: Between Test and Code Artifacts},
booktitle={Proceedings of the 10th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2015)},
year={2015},
pages={393-400},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005555503930400},
isbn={978-989-758-114-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2015)
TI - Towards Gamification in Software Traceability: Between Test and Code Artifacts
SN - 978-989-758-114-4
AU - Meimandi Parizi R.
AU - Kasem A.
AU - Abdullah A.
PY - 2015
SP - 393
EP - 400
DO - 10.5220/0005555503930400