EXPLORATION OF QUANTITATIVE ASSESSMENT IN SYSTEMS ARCHITECTURE USING EVIDENTIAL REASONING

Yixing Shan, Lili Yang, Roy Kalawsky

2010

Abstract

A key issue in successful developing complex systems is how to assess the performance of architecture model during the development process. Traditional assessment techniques are subjective and usually highlight weaknesses rather than provide quantitative and objective results. In addition, the increasing complexity of systems nowadays; has led to a move from federated systems which were closed and target unique to embedded open systems, which extends new criteria to be considered in the assessment. This paper provides an insight into how Evidential Reasoning (ER) approach as the specific Multi-Attribute Decision Making (MADM) method can be used as a type of system assessment technique. The theory and implementation details of ER with an initial case study are presented.

References

  1. Barbacci, M. R., 2002. SEI architecture analysis techniques and when to use them. Carnegie-mellon University Software Engineering Institute Technical Note, CMU/SEI-2002-TN-005.
  2. Belton, V., Stewart, T. J., 2002. Multiple criteria decision analysis - an integrated approach. Kluwer Academic Publishers.
  3. Borky, J. M., Lachenmaier, R. N., Messing, J. P., Fandk, A., 1998. Architectures for next generation military avionics systems. In Proceedings of the IEEE Aerospace Conference, Vol.1, pp. 265-281.
  4. Clements, P., Bergey, J., 2005. The U.S. Army's Common Avionics Architecture System (CAAS) product line: a case study. Carnegie-Mellon University Software Engineering Institute Technical Report CMU/SEI2005-TR-019.
  5. Conmy, P., McDermid, J., 2001. High level failure analysis for integrated modular avionics. In 6th Australian Workshop in Industrial Experience with Safety Critical Systems and Software, Brisbane.
  6. Dempster, A. P., 1967. Upper and lower probabilities induced by a multi-valued mapping. Annals of Mathematical Statistics 38: 325-339.
  7. Guo, M., Yang, J. B., Chin, K. S., Wang, H. W., Liu, X. B., 2009. Evidential reasoning approach for multiattribute decision analysis under both fuzzy and interval uncertainty. IEEE Transactions on Fuzzy Systems, Vol.17, No.3.
  8. Henderson, P., 2006. The architecture of open systems - presentation. Dependable Systems and Software Engineering and Open Middleware Infrastructure Institute, University of Southampton.
  9. Industrial Avionics Working Group (IAWG). Parallel certification study: design architecture and safety case architecture trade-off and mutual optimisation. Industrial Paper for IAWG Parallel Certification Study, IAWG-AJT-703.
  10. Jacquet-lagreze, E., Siskos, J., 1982. Assessing a set of additive utility functions for multicriteria decision making, the UTA method. European Journal of Operational Research 10(2), 151-164.
  11. Keeney, R. L., Raiffa, H., 1993. Decisions with multiple objectives, second ed. Cambridge University Press.
  12. McConnell, S., 2001. An ounce of prevention. IEEE Software Vol.18.
  13. Murdoch, J., Hardy, D., 2000. Open systems architecting U.S. DoD open systems - joint task force. 3rd Annual Systems Engineering & Supportability Conference.
  14. Purewal, K., Yang, L., Grigg, A., 2009. Quantitative assessment of systems architecture using evidential reasoning. 7th Annual Conference on Systems Engineering Research.
  15. Saaty, T.L., 1977. A scaling method for priorities in hierarch structures. Journal of Mathematical Psychology 15(3):234-281.
  16. Saaty, T. L., 1988. The analytic hierarchy process. University of Pittsburgh.
  17. Saaty, T. L., 1994. Fundamentals of decision making with the analytic hierarchy process. USA:RWS Publications.
  18. Shafer, G., 1976. A Mathematical Theory of Evidence. Princeton: Princeton University Press.
  19. SEI-CMU 2008. Carnegie Mellon University. CMU architecture-based languages and environments project. Available online at http://www.cs.cmu.edu/acme/
  20. Wang, Y. M., Yang, J. B., Xu, D. L., Chin, K. S., 2006. The evidential reasoning approach for multiple attribute decision analysis using interval belief degrees. European Journal of Operational Research 175(1): 35-66.
  21. Xu, L., Yang, J. B., 2001. Introduction to multi-criteria decision making and the evidential reasoning approach. Working Paper No. 0105, Manchester School of Management, ISBN 1 86115111 X.
  22. Xu, D. L., Yang, J. B., Wang, Y. M., 2006. The ER approach for multi-attribute decision analysis under interval uncertainties. European Journal of Operational Research 174(3): 1914-1943.
  23. Yang, J. B., 2001. Rule and utility based evidential reasoning approach for multiple attribute decision analysis under uncertainty. European Journal of Operational Research 131 (1), 31-61.
  24. Yang, J. B., Deng, M., Xu, D. L., 2001. Nonlinear regression to estimate both weights and utilities via evidential reasoning for MADM. In:Processings of the 5th International Conference on Optimisation: Techniques and Applications, Hong Kong.
  25. Yang, J. B., Wang, Y. M., Xu, D. L., Chin, K. S., 2006. The evidential reasoning approach for MADA under both probabilistic and fuzzy uncertainties. European Journal of Operational Research, 171, 309-343.
  26. Yang, J. B., Sen, P., 1994. A general multi-level evaluation process for hybrid MADM with uncertainty. IEEE Transactions on Systems, Man, and Cybernetics 24 (10), 1458-1473.
  27. Yang, J. B., Singh, M. G., 1994. An evidential reasoning approach for multiple attribute decision making with uncertainty. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 32(3), 289- 304.
  28. Yang, J. B., Xu, D. L., 2002a. On the evidential reasoning algorithm for multiattribute decision analysis under uncertainty. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 32(3): 289- 304.
  29. Yang, J. B., Xu, D. L., 2002b. Nonlinear information aggregation via evidential reasoning in multiattribute decision analysis under uncertainty. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 32(3): 376-393.
Download


Paper Citation


in Harvard Style

Shan Y., Yang L. and Kalawsky R. (2010). EXPLORATION OF QUANTITATIVE ASSESSMENT IN SYSTEMS ARCHITECTURE USING EVIDENTIAL REASONING . In Proceedings of the International Conference on Evolutionary Computation - Volume 1: ICEC, (IJCCI 2010) ISBN 978-989-8425-31-7, pages 146-152. DOI: 10.5220/0003062901460152


in Bibtex Style

@conference{icec10,
author={Yixing Shan and Lili Yang and Roy Kalawsky},
title={EXPLORATION OF QUANTITATIVE ASSESSMENT IN SYSTEMS ARCHITECTURE USING EVIDENTIAL REASONING},
booktitle={Proceedings of the International Conference on Evolutionary Computation - Volume 1: ICEC, (IJCCI 2010)},
year={2010},
pages={146-152},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003062901460152},
isbn={978-989-8425-31-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Evolutionary Computation - Volume 1: ICEC, (IJCCI 2010)
TI - EXPLORATION OF QUANTITATIVE ASSESSMENT IN SYSTEMS ARCHITECTURE USING EVIDENTIAL REASONING
SN - 978-989-8425-31-7
AU - Shan Y.
AU - Yang L.
AU - Kalawsky R.
PY - 2010
SP - 146
EP - 152
DO - 10.5220/0003062901460152