VERIFYING THE VALUE OF OBJECTIVE MEASURES - A Proposal for a Systematic Evaluation of Measures

Harald Kjellin

2006

Abstract

The results of work in any section of an enterprise should preferably be described in a way that makes the results suited for benchmarking with other sections of the enterprise. The same goes for individual work results. Results are easily compared if they are measured according to some numerical standard. Numerical measures can be generalized and standardized until they can be considered as having a high degree of “reusability”. There are several types of enterprise models that include the use of reusable “soft” numerical values. With “soft” numerical values I refer to the type of values that cannot be directly measured in relation to objective facts but are artificially constructed measures that includes some kind of subjective estimation for calculating the value. Another requirement on such measures is that it should be possible to use them for comparing performance between individuals or between units of an organization or between organizations. These measures can, for instance, be used for customer appreciation of their relationships with the organization, as is often recommended in the method called “Balanced Scorecards” or they can be used when giving students numerical values as credits (points) for passing university courses. A summary of informal evaluations is presented. The evaluations concern how “soft” measures have been implemented in organizations. The results of the evaluations show that objective values based on facts can be combined with subjective estimations in a way that makes them less vulnerable to people manipulating the measures and less vulnerable to the subjectivity of superiors when estimating the quality of the results.

References

  1. Argyris C., 1991. Teaching Smart People How to Learn. Harvard Business Review 69(3) 99-109.
  2. Armstrong M., 1999. Employee Reward London: CIPD Chandler, A. D., 1992. "Organizational Capabilities and the Economic History of the Industrial Enterprise." Journal of Economic Perspectives, vol. 6, no. 3, pp. 79-100.
  3. Kaplan R., 2005. "Add a Customer Profitability Metric to Your Balanced Scorecard," Balanced Scorecard Report, Vol. 7, No. 4, July-August 2005.
  4. Kjellin, H., 2002. How Active Learning Motivates Employees to Share Knowledge, The European Conference on Knowledge Management, Trinity College, Dublin, Ireland.
  5. Lorge, I., 1967. The Fundamental Nature of Measurement. In D.N.Jackson, & S. Messick (Eds.), Problems in Human Assessment. New York: McGraw Hill.
  6. McGonagle J.J. & Vella C.M., 1990. Outsmarting the Competition: Practical Approaches to Finding and Using Competitive Information. Naperville, IL: Sourcebooks.
  7. Miller, D.C., 1991. Selected Sociometric Scales and Indexes. In Handbook of Research Design and Social Measurement. 5th ed. Newbury Park, CA: Sage.
  8. Nielsen, J., 1992. Finding usability problems through heuristic evaluation, Proc. ACM CHI'92, Monterey, CA, 3-7 May. 373-380.
  9. Nonaka, I., 1994. “A Dynamic Theory of Organizational Knowledge Creation”. Organization Science. Vol.5, No.1. pp. 14-37.
  10. Stevens, S.S., 1946. On the Theory of Scales of Measurement. Science, 103, 677-680.
  11. Uschold, M., Grüninger, M., 1996 Ontologies: Principles, Methods and Applications, Knowledge Engineering Review.
Download


Paper Citation


in Harvard Style

Kjellin H. (2006). VERIFYING THE VALUE OF OBJECTIVE MEASURES - A Proposal for a Systematic Evaluation of Measures . In Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 978-972-8865-43-6, pages 497-500. DOI: 10.5220/0002491904970500


in Bibtex Style

@conference{iceis06,
author={Harald Kjellin},
title={VERIFYING THE VALUE OF OBJECTIVE MEASURES - A Proposal for a Systematic Evaluation of Measures},
booktitle={Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2006},
pages={497-500},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002491904970500},
isbn={978-972-8865-43-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Eighth International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - VERIFYING THE VALUE OF OBJECTIVE MEASURES - A Proposal for a Systematic Evaluation of Measures
SN - 978-972-8865-43-6
AU - Kjellin H.
PY - 2006
SP - 497
EP - 500
DO - 10.5220/0002491904970500