Evaluating Artificial Neural Networks and Traditional Approaches for Risk Analysis in Software Project Management - A Case Study with PERIL Dataset

Carlos Timoteo, Meuser Valença, Sérgio Fernandes

2014

Abstract

Many software project management end in failure. Risk analysis is an essential process to support project success. There is a growing need for systematic methods to supplement expert judgment in order to increase the accuracy in the prediction of risk likelihood and impact. In this paper, we evaluated support vector machine (SVM), multilayer perceptron (MLP), a linear regression model and monte carlo simulation to perform risk analysis based on PERIL data. We have conducted a statistical experiment to determine which is a more accurate method in risk impact estimation. Our experimental results showed that artificial neural network methods proposed in this study outperformed both linear regression and monte carlo simulation.

References

  1. Amari, S., Murata, N., Müller, K.-R., Finke, M., and Yang, H. (1996a). Statistical theory of overtraining-is crossvalidation asymptotically effective? Advances in neural information processing systems, pages 176-182.
  2. Amari, S.-i., Cichocki, A., Yang, H. H., et al. (1996b). A new learning algorithm for blind signal separation. Advances in neural information processing systems, pages 757-763.
  3. Attarzadeh, I. and Ow, S. H. (2010). A novel soft computing model to increase the accuracy of software development cost estimation. In Computer and Automation Engineering (ICCAE), 2010 The 2nd International Conference on, volume 3, pages 603-607. IEEE.
  4. Bannerman, P. L. (2008). Risk and risk management in software projects: A reassessment. Journal of Systems and Software, 81(12):2118-2133.
  5. Boehm, B. W. (1991). Software risk management: principle and practices. IEEE Software, 8:32-41.
  6. Budzier, A. and Flyvbjerg, B. (2013). Double whammy-how ict projects are fooled by randomness and screwed by political intent. arXiv preprint arXiv:1304.4590.
  7. Dan, Z. (2013). Improving the accuracy in software effort estimation: Using artificial neural network model based on particle swarm optimization. In Service Operations and Logistics, and Informatics (SOLI), 2013 IEEE International Conference on, pages 180-185. IEEE.
  8. Dzega, D. and Pietruszkiewicz, W. (2010). Classification and metaclassification in large scale data mining application for estimation of software projects. In Cybernetic Intelligent Systems (CIS), 2010 IEEE 9th International Conference on, pages 1-6. IEEE.
  9. Haimes, Y. Y. (2011). Risk modeling, assessment, and management. John Wiley & Sons.
  10. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. (2009). The WEKA data mining software: An update. ACM SIGKDD Explorations Newsletter, 11(1):10-18.
  11. Han, J., Kamber, M., and Pei, J. (2006). Data mining: concepts and techniques. Morgan kaufmann.
  12. Haykin, S. (1994). Neural networks: a comprehensive foundation. Prentice Hall PTR.
  13. Higuera, R. P. and Haimes, Y. Y. (1996). Software risk management. Technical report, DTIC Document.
  14. Hu, Y., Huang, J., Chen, J., Liu, M., and Xie, K. (2007). Software project risk management modeling with neural network and support vector machine approaches. In Natural Computation, 2007. ICNC 2007. Third International Conference on, volume 3, pages 358-362. IEEE.
  15. Huang, X., Ho, D., Ren, J., and Capretz, L. F. (2004). A neuro-fuzzy tool for software estimation. In Software Maintenance, 2004. Proceedings. 20th IEEE International Conference on, page 520. IEEE.
  16. Institute, P. M. (2008). A Guide to the Project Management Body of Knowledge.
  17. Kendrick, T. (2003). Identifying and managing project risk: essential tools for failure-proofing your project. Amacom: New York.
  18. Kwak, Y. H. and Ingall, L. (2007). Exploring monte carlo simulation applications for project management. Risk Management, 9(1):44-57.
  19. Priddy, K. L. and Keller, P. E. (2005). Artificial Neural Networks: An introduction, volume 68. SPIE Press.
  20. Rumelhart, D. E., Hinton, G. E., and Williams, R. J. (1985). Learning internal representations by error propagation. Technical report, DTIC Document.
  21. Saxena, U. R. and Singh, S. (2012). Software effort estimation using neuro-fuzzy approach. In Software Engineering (CONSEG), 2012 CSI Sixth International Conference on, pages 1-6. IEEE.
  22. Schmidt, R., Lyytinen, K., Keil, M., and Cule, P. (2001). Identifying software project risks: an international delphi study. Journal of management information systems, 17(4):5-36.
  23. Shevade, S., Keerthi, S., Bhattacharyya, C., and Murthy, K. (1999). Improvements to the smo algorithm for svm regression. In IEEE Transactions on Neural Networks.
  24. Siegel, S. (1956). Nonparametric statistics for the behavioral sciences.
  25. Smola, A. and Schoelkopf, B. (1998). A tutorial on support vector regression. Technical report. NeuroCOLT2 Technical Report NC2-TR-1998-030.
  26. Support, I. P. (2005). Monte Carlo Simulation. IbbotsonAssociates, 225 North Michigan Avenue Suite 700 Chicago, IL 60601-7676.
  27. Taleb, N. (2001). Fooled by randomness. Nwe York: Random House.
  28. Torgo, L. (2003). Data mining with r. Learning by case studies. University of Porto, LIACC-FEP. URL: http://www. liacc. up. pt/ltorgo/DataMiningWithR/. Accessed on, 7(09).
  29. Valenca, M. J. S. (2005). Aplicando redes neurais: um guia completo. Livro Rapido, Olinda-PE.
  30. Venables, W. N., Smith, D. M., and Team, R. D. C. (2002). An introduction to r.
  31. Yu, P. (2011). Software project risk assessment model based on fuzzy theory. Computer Knowledge and Technology, 16:049.
Download


Paper Citation


in Harvard Style

Timoteo C., Valença M. and Fernandes S. (2014). Evaluating Artificial Neural Networks and Traditional Approaches for Risk Analysis in Software Project Management - A Case Study with PERIL Dataset . In Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-027-7, pages 472-479. DOI: 10.5220/0004885704720479


in Bibtex Style

@conference{iceis14,
author={Carlos Timoteo and Meuser Valença and Sérgio Fernandes},
title={Evaluating Artificial Neural Networks and Traditional Approaches for Risk Analysis in Software Project Management - A Case Study with PERIL Dataset},
booktitle={Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2014},
pages={472-479},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004885704720479},
isbn={978-989-758-027-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Evaluating Artificial Neural Networks and Traditional Approaches for Risk Analysis in Software Project Management - A Case Study with PERIL Dataset
SN - 978-989-758-027-7
AU - Timoteo C.
AU - Valença M.
AU - Fernandes S.
PY - 2014
SP - 472
EP - 479
DO - 10.5220/0004885704720479