Usability Evaluation of a Collaborative Health Information System - Lessons from a User-centred Design Process

Berglind Smaradottir, Santiago Martinez, Elisabeth Holen-Rabbersvik, Torunn Vatnøy, Rune Fensli

2016

Abstract

In Norway, a recent health reform urged municipalities to implement new primary health care services for their citizens. Small and medium size municipalities have since then, established inter-municipal services to collaborate across organisational borders and optimise their resources. Information systems become a necessary tool to support collaboration and shared access to information between health professionals and other employees from different municipalities that belong to the same inter-municipal team. In this context, the research project eHealth-extended Care Coordination identified a specific need for a collaborative information system for the process of evaluation and assessment of dementia in inter-municipal teams. This paper presents the usability evaluation of a collaborative information system for dementia assessment built using a user-centred design approach. Mixed methods such as observations, semi-structured interviews and a questionnaire were used for data collection. The results showed that the new information system supported the collaborative work of the inter-municipal dementia team, with a sufficient level of satisfaction among the end-users. The prototyped solution established the foundations for the system implemented in the Norwegian trials of the FP7 EU project United4Health, dedicated to Poinf-of-Care Services.

References

  1. Bangor, A., Kortum, P., Miller, J., 2009. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of Usability Studies, Vol. 4, Issue 3, 114-123.
  2. Brooke, J., 1996. SUS: a quick and dirty usability scale. Usability Evaluation in Industry. London: Taylor & Francis, p.189-194.
  3. Chan, J., Shojania, K. G., Easty, A. C., Etchells, E. E., 2011. Does user-centred design affect the efficiency, usability and safety of CPOE order sets? Journal of the American Medical Informatics Association, 18, 276e281. doi:10.1136/amiajnl-2010-000026.
  4. Directorate of Health and National Expertise Service for Ageing and Health, 2011. Etablering og drift av.
  5. Demensteam, Demensutredning i primaerhelsetjenesten. [cited 2015 Dec 10]. Available from: http:// www.aldringoghelse.no/ViewFile.aspx?ItemID=2824.
  6. Ericsson, K. A., Simon, H. A., 1980. Verbal reports as data. Psychological Review, 87(3), 215-251.
  7. Folstein, M. F., Folstein, S. E., McHugh, P. R., 1975. “Mini-mental state”: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, Vol 12, Issue 3, 189-198. doi:10.1016/0022-3956(75)90026-6.
  8. Gerdes, M., Smaradottir, B., Fensli, R., 2014. End-to-end infrastructure for usability evaluation of ehealth applications and services. Proceedings of Scandinavian Conference on Health Informatics, Grimstad, Norway, August 21-22, 53-59. ISSN(print): 1650-3686, ISSN(online): 1650-3740, ISBN: 978-91- 7519-241-3.
  9. Goldberg, L., Lide, B., Lowry, S., Massett, H. A., O'Connell, T., Preece, J., Quesenbery, W., Shneiderman, B., 2011. Usability and accessibility in consumer health informatics current trends and future challenges. American Journal of Preventive Medicine Vol 40, Issue 5, Supplement 2, S187-S197. doi:10.1016/j.amepre.2011.01.009.
  10. Gulliksen, J., Göransson, B., Boivie, I., Blomkvist, S., Persson J., Cajander, Å., 2003. Key principles for user-centred systems design. Behaviour & Information Technology, 22:6, 397-409. doi:10.1080/01449290310001624329.
  11. Gustafson, L., 1996. What is dementia? Acta Neurologica Scandinavica, Volume 94, Issue Supplement s168, 22-24. doi: 10.1111/j.1600-0404.1996.tb00367.x.
  12. Holen-Rabbersvik, E., Eikebrokk, T. R., Fensli, R. W., Thygesen, E., Slettebø, Å., 2013. Important challenges for coordination and inter-municipal cooperation in health care services: a Delphi study. BMC health services research, 13(1), 451. doi: 10.1186/1472- 6963-13-451.
  13. Jaspers, M. W., 2009. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. International Journal of Medical Informatics, 78(5), 340-353.
  14. Kushniruk, A. W., Patel, V. L., 2004. Cognitive and usability engineering methods for the evaluation of clinical information systems. Journal of Biomedical Informatics, 37(1), 56-76.
  15. Lazar, J. 2006. Web Usability- a user-centered design approach. Pearson Education. ISBN-10: 0321321359 ISBN-13: 9780321321350.
  16. Lazar, J., Feng, J. H., Hochheiser, H., 2010. Research methods in human-computer interaction, Chichester, United Kingdom, John Wiley & Sons, ISBN 978-0- 470-72337-1.
  17. MacLellan, S., Muddimer, A., Peres S., C. 2012. The Effect of Experience on System Usability Scale Ratings. Journal of Usability Studies, Vol. 7, Issue 2, 56-67.
  18. NHN, 2015: Norwegian Health Network. [cited 2015 Dec 10]. Available from: https://www.nhn.no/english/ Pages/default.aspx.
  19. Nielsen, J., 1994. Estimating the number of subjects needed for a thinking aloud test. International Journal of Human-Computer Studies, 41(3), 385-397. doi:10.1006/ijhc.1994.1065.
  20. Nielsen, J. 1993. Usability engineering, Elsevier. ISBN13: 978-0125184069, ISBN-10: 0125184069.
  21. Nielsen, J., and Landauer, T. K., 1993. A mathematical model of the finding of usability problems. Proceedings of ACM INTERCHI'93 Conference, Amsterdam, The Netherlands, April 24-29, pp. 206- 213.
  22. Norwegian Ministry of Health and Care Services, 2007. Dementiaplan 2015 (Demensplan 2015 “Den gode dagen” Delplan til omsorgsplan 2015). [cited 2015 Dec 10]. Available from: http://www.regjeringen.no/ upload/HOD/Vedlegg/Omsorgsplan_2015/Demenspla n2015.pdf.
  23. Norwegian Ministry of Health and Care Services, 2008- 2009. Report No. 47. The Coordination Reform, Proper treatment - at the right place and right time. [cited 2015 Dec 10]. Available from: https://www.regjeringen.no/contentassets/d4f0e16ad3 2e4bbd8d8ab5c21445a5dc/no/pdfs/stm200820090047 000dddpdfs.pdf.
  24. NSD, 2015: Norwegian Social Science Data Services. [cited 2015 Dec 10]. Available from: http://www.nsd.uib.no/personvern/en/index.html.
  25. Smaradottir, B., Gerdes, M., Martinez, S., Fensli, R., 2015a. The EU-project United4Health: user-centred design of an information system for a Norwegian telemedicine service. Journal of Telemedicine and Telecare Nov 2015. doi:10.1177/1357633X15615048.
  26. Smaradottir B., Holen-Rabbersvik, E., Thygesen, E., Fensli, R., Martinez, S., 2015b. User-centred design and usability evaluation of the user interface of a collaborative information system for inter-municipal dementia team. Proceedings of International Conference on Health Informatics, Lisbon, Portugal January 12-15, 446-453. doi: 10.5220/0005222704460453.
  27. Smaradottir B., Holen-Rabbersvik, E., Thygesen, E., Fensli, R., Martinez, S., 2014. Usability evaluation of electronic forms and collaborative assessment report in an inter-municipality health care team for dementia diagnose. Proceedings of Scandinavian Conference on Health Informatics, Grimstad, Norway, August 21-22, 45-54. ISSN(print): 1650-3686, ISSN(online): 1650- 3740, ISBN: 978-91-7519-241-3.
  28. United4Health 2015, European Commission Competitiveness Innovation Programme, ICT Programme to Support Policy. [cited 2015 Dec 10]. Available from: http://www.united4health.eu.
Download


Paper Citation


in Harvard Style

Smaradottir B., Martinez S., Holen-Rabbersvik E., Vatnøy T. and Fensli R. (2016). Usability Evaluation of a Collaborative Health Information System - Lessons from a User-centred Design Process . In Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 5: HEALTHINF, (BIOSTEC 2016) ISBN 978-989-758-170-0, pages 306-313. DOI: 10.5220/0005703603060313


in Bibtex Style

@conference{healthinf16,
author={Berglind Smaradottir and Santiago Martinez and Elisabeth Holen-Rabbersvik and Torunn Vatnøy and Rune Fensli},
title={Usability Evaluation of a Collaborative Health Information System - Lessons from a User-centred Design Process},
booktitle={Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 5: HEALTHINF, (BIOSTEC 2016)},
year={2016},
pages={306-313},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005703603060313},
isbn={978-989-758-170-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 5: HEALTHINF, (BIOSTEC 2016)
TI - Usability Evaluation of a Collaborative Health Information System - Lessons from a User-centred Design Process
SN - 978-989-758-170-0
AU - Smaradottir B.
AU - Martinez S.
AU - Holen-Rabbersvik E.
AU - Vatnøy T.
AU - Fensli R.
PY - 2016
SP - 306
EP - 313
DO - 10.5220/0005703603060313