Towards Systemic Evaluation of the Business Value of IT

Harri Töhönen, Timo Itälä, Marjo Kauppinen, Tomi Männistö


Evaluating the IT business value is a challenging combination of managing the complexity of value phenomenon and the complexity of broad IT impacts. This study analyses the focal characteristics of IT business value evaluation and proposes a research agenda towards systemic evaluation approach. The systemic approach combines concepts of goal driven perspective for benefits, value as a combination of benefits and costs, and the lifecycle view of potential and realised value. These concepts are integrated through system dynamics modelling to understand the IT impact structures and dynamic value creating behaviour emerging from the structures. Finally, systemic approach should be supported by evaluation workflow practices that facilitate seamless data retrieval for the evaluation process, and the integration of evaluation outputs within the organisation.


  1. Bajaj, A., Bradley, W., Cravens, K. 2008. SAAS: Integrating Systems Analysis with Accounting and Strategy for Ex Ante Evaluation of IS Investments. Journal of Information Systems, 22(1), 97-124.
  2. Barua, A., Kriebel, C. H., Mukhopadhyay, T. 1995. Information technologies and business value: An analytic and empirical investigation. Information Systems Research, 6(1), 3-23.
  3. Brynjolfsson, E., Hitt, L. M. 1998. Beyond the productivity paradox. Communications of the ACM, 41(8), 49-55.
  4. Chan, Y. E. 2000. IT Value: The Great Divide Between Qualitative and Quantitative and Individual and Organizational Measures. J. Manage. Inf. Syst., 16(4), 225-261.
  5. Corbin, J., Strauss, A. 2008. Basics of qualitative research: Techniques and procedures for developing grounded theory. (3rd ed.). Thousand Oaks: SAGE Publications.
  6. Davern, M., Wilkin, C. 2010. Towards an integrated view of IT value measurement. International Journal of Accounting Information Systems, 11(1), 42-60.
  7. Davern, M., Kauffman, R. 2000. Discovering Potential and Realizing Value from Information Technology Investments. Journal of Management Information Systems, 16(4), 121-143.
  8. Davis, F. D. 1989. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340.
  9. Dedrick, J., Gurbaxani, V., Kraemer, K. 2003. Information Technology and Economic Performance. ACM Computing Surveys, 35(1), 1-28.
  10. DeLone, W. H., McLean, E. R. 2003. The DeLone and McLean Model of Information Systems Success: A Ten-Year Update. Journal of Management Information Systems, 19(4), 9-30.
  11. Gable, G., Sedera, D., Chan, T. 2008. Re-conceptualizing information system success: the IS-Impact Measurement Model. Journal of the Association for Information Systems, 9(7), 377-408.
  12. Giaglis, G., Mylonopoulos, N., Doukidis, G. 1999. The ISSUE methodology for quantifying benefits from information systems. Logistics Information Management, 12(1/2), 50-62.
  13. Gregor, S., Martin, M., Fernandez, W., Stern, S., Vitale, M. 2006. The transformational dimension in the realization of business value from information technology. The Journal of Strategic Information Systems, 15(3), 249-270.
  14. Grover, V., Jeong, S. R., Segars, A. H. 1996. Information systems effectiveness: The construct space and patterns of application. Information & Management, 31(4), 177-191.
  15. Gunasekaran, A., Ngai, E. W., McGaughey, R. E. 2006. Information technology and systems justification: A review for research and applications. European Journal of Operational Research, 173(3), 957-983.
  16. Gutman, & Jonathan 1982. A Means-End Chain Model Based on Consumer Categorization Processes. Journal of Marketing, 46(2), 60-72.
  17. Hamilton, S., Chervany, N. L. 1981. Evaluating information system effectiveness-Part I: Comparing evaluation approaches. MIS Quarterly, 5(3), 55-69.
  18. Irani, Z., Ghoneim, A., Love, P. E. 2006. Evaluating cost taxonomies for information systems management. European Journal of Operational Research, 173(3), 1103-1122.
  19. Kanungo, S., Duda, S., Srinivas, Y. 1999. A structured model for evaluating information systems effectiveness. Systems Research and Behavioral Science, 16(6), 495-518.
  20. Larsen, K. R. 2003. A taxonomy of antecedents of information systems success: variable analysis studies. Journal of Management Information Systems, 20(2), 169-246.
  21. Lee, S. 2001. Modeling the business value of information technology. Information & Management, 39(3), 191- 210.
  22. Marthandan, G., Tang, C. M. 2010. Information technology evaluation: issues and challenges. Journal of Systems and Information Technology, 12(1), 37-55.
  23. Martinsons, M., Davison, R., Tse, D. 1999. The balanced scorecard: a foundation for the strategic management of information systems. Decision Support Systems, 25(1), 71-88.
  24. Meadows, D. H. 2008. Thinking in Systems. London: Earthscan.
  25. Melville, N., Kraemer, K., Gurbaxani, V. 2004. Information Technology and Organizational Performance: An Integrative Model of It Business Value. MIS Quarterly, 28(2), 283-322.
  26. Mirani, R., Lederer, A. L. 1998. An Instrument for Assessing the Organizational Benefits of IS Projects. Decision Sciences, 29(4), 803-838.
  27. Mutschler, B., Reichert, M. 2008. On modeling and analyzing cost factors in information systems engineering. In Proceedings of the Advanced Information Systems Engineering (pp. 510-524). Springer Berlin Heidelberg.
  28. Ng, I. C., Smith, L. A. 2012. An integrative framework of value. Review of Marketing Research, 9, 207-243.
  29. Palvia, S. C., Sharma, R. S., Conrath, D. W. 2001. A socio-technical framework for quality assessment of computer information systems. Industrial Management & Data Systems, 101(5), 237-251.
  30. Peppard, J., Ward, J., Daniel, E. 2007. Managing the realization of business benefits from IT investments. MIS Quarterly Executive, 6(1), 1-11.
  31. Petter, S., DeLone, W., McLean, E. 2008. Measuring information systems success: models, dimensions, measures, and interrelationships. European journal of information systems, 17(3), 236-263.
  32. Pfahl, D., Lebsanft, K. 1999. Integration of system dynamics modelling with descriptive process modelling and goal-oriented measurement. Journal of Systems and Software, 46(2), 135-150.
  33. Ragowsky, A., Ahituv, N., Neumann, S. 1996. Identifying the value and importance of an information system application. Information & Management, 31(2), 89- 102.
  34. Ryan, S. D., Harrison, D. A. 2000. Considering social subsystem costs and benefits in information technology investment decisions: A view from the field on anticipated payoffs. Journal of Management Information Systems, 16(4), 11-40.
  35. Santos, S., Belton, V., Howick, S. 2008. Enhanced performance measurement using OR: a case study. Journal of the Operational Research Society, 59(6), 762-775.
  36. Simmons, P. 1996. Quality outcomes: determining business value. IEEE Software, 13(1), 25-32.
  37. Sterman, J. D. 2000. Business Dynamics: Systems Thinking and Modeling for a Complex World. Boston McGraw-Hill.
  38. Stockdale, R., Standing, C. 2006. An interpretive approach to evaluating information systems: A content, context, process framework. European Journal of Operational Research, 173(3), 1090-1102.
  39. Tallon, P., Kraemer, K., Gurbaxani, V. 2000. Executives' Perceptions of the Business Value of Information technology. Journal of Management Information Systems, 16(4), 145-173.
  40. Tiernan, C., Peppard, J. 2004. Information Technology: Of Value or a Vulture?. European Management Journal, 22(6), 609-623.
  41. Wegen, B. V., Hoog, R. D. 1996. Measuring the economic value of information systems. Journal of Information Technology, 11(3), 247-260.
  42. Venkatesh, V., Davis, F. D. 2000. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science, 46(2), 186-204.

Paper Citation

in Harvard Style

Töhönen H., Itälä T., Kauppinen M. and Männistö T. (2015). Towards Systemic Evaluation of the Business Value of IT . In Proceedings of the Fifth International Symposium on Business Modeling and Software Design - Volume 1: BMSD, ISBN 978-989-758-111-3, pages 163-170. DOI: 10.5220/0005886601630170

in Bibtex Style

author={Harri Töhönen and Timo Itälä and Marjo Kauppinen and Tomi Männistö},
title={Towards Systemic Evaluation of the Business Value of IT},
booktitle={Proceedings of the Fifth International Symposium on Business Modeling and Software Design - Volume 1: BMSD,},

in EndNote Style

JO - Proceedings of the Fifth International Symposium on Business Modeling and Software Design - Volume 1: BMSD,
TI - Towards Systemic Evaluation of the Business Value of IT
SN - 978-989-758-111-3
AU - Töhönen H.
AU - Itälä T.
AU - Kauppinen M.
AU - Männistö T.
PY - 2015
SP - 163
EP - 170
DO - 10.5220/0005886601630170