Memorability Experiment Vs. Expert Method in Websites Usability Evaluation

Marek Miłosz, Magdalena Borys, Maciej Laskowski

2013

Abstract

The quantitation of website usability is possible by using experimental method with a group of users and experts. In this paper an experiment of determining the short memorability is presented, along with using its results for the comparative assessment of usability of Polish public administration websites. The expert review was conducted on the same websites using the authors’ list of control questions and method for determining the complex assessment of website usability. The degree of correlation of both methods is presented and discussed.

References

  1. Bateman S., Mandryk R. L., Gutwin C., Genest A., McDine D., Brooks Ch., 2010. Useful Junk? The Effects of Visual Embellishment on Comprehension and Memorability of Charts. In CHI 7810 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, NY, pp. 2573-2582.
  2. Cakir C. B.; Oztaysi B., 2009. A model proposal for usability scoring of websites. In International Conference on Computers & Industrial Engineering, CIE 2009, 6-9 July 2009, pp.1418-1422.
  3. Fernandez A., Insfrán E., Abrahão S., 2011. Usability evaluation methods for the web: A systematic mapping study. In Information & Software Technology 53(8), pp. 789-817.
  4. Garzonis S., Jones S., Jay T. and O'neill E., 2009. Auditory icon and earcon mobile service notifications: intuitiveness, learnability, memorability and preference. In CHI 7809 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, NY, pp. 1513-1522.
  5. Ghani S., Elmqvist N., 2011. Improving revisitation in graphs through static spatial features. In GI 7811 Proceedings of Graphics Interface 2011. Waterloo, Canada, pp. 175-182.
  6. Göransson, B., Gulliksen, J., Boivie, I., 2003. The usability design process - integrating user-centered systems design in the software development process. In Software Process: Improvement and Practice, Vol. 8, Issue 2, pp. 111-131.
  7. Hollingsed T., Novick D. G., 2007. Usability Inspection Methods after 15 Years of Research and Practice. In SIGDOC 7807 Proceedings of the 25th annual ACM international conference on Design of communication, NY, pp. 249-255.
  8. Hornbaek K., 2006. Current Practice in Measuring Usability: Challenges to Usability Studies and Research, In International Journal of HumanComputer Studies, Volume 64, Issue 2 , February 2006, pp. 79-102.
  9. Landauer Th. K., 1996. The Trouble with Computers: Usefulness, Usability, and Productivity. MIT Press.
  10. Laskowski M., Szymczyk T., 2010. Economic and legal aspects of adjusting online advertisements for visually impaired, In: Actual Problems of Economics, No. 6 (108), pp. 301-308
  11. Lee K. I., Jin B. S., Ji Y. G., 2011. The scenario-based usability checklist development for home appliance design: A case study. In Human Factors and Ergonomics in Manufacturing & Service Industries, January/February 2011, Vol. 21, Issue 1, pp. 67-81.
  12. Lee S., Koubek R. J., 2012. The effects of usability and web design attributes on user preference for ecommerce web sites. In Computers in Industry, Vol. 61, Issue 4, May 2010, pp. 329-341.
  13. Lujan-Mora, S., Masri, F., 2012. Integration of Web Accessibility into Agile Methods. In Proceedings of ICEIS 2012 Conference, pp. 123-127.
  14. Milosz M., Lujan-Mora S., 2013. Economical Aspect of Website Memorability. In Actual Problems of Economics, Issue 4 (142) (in press)
  15. Montero F., Lozano M. D., Gonzales P., 2008. UsabilityOriented Quality Model Based on Ergonomic Criteria. In: Muñoz C. C., Moraga A., Piattini M. (2008) Handbook of Research on Web Information Systems Quality, IGI Global, NY, pp. 220-233.
  16. Nielsen J., 1993. Usability Engineering. Morgan Kaufmann, San Francisco.
  17. Palmer J. W., 2002. Web site usability, design, and performance metrics. In Information Systems Research, 13(2), pp. 151-167.
  18. Petrie H., Bevan N., 2009. The evaluation of accessibility, usability and user experience. In The Universal Access Handbook. CRC Press.
  19. Pressman R. S., Lowe D., 2009. Web Engineering: a Practitioner's Approach. McGraw-Hill, NY.
  20. Rajanen M., Jokela T., 2004. Analysis of Usability CostBenefit Models. In Proceedings of the Twelfth European Conference on Information Systems (Leino T, Saarinen T, Klein S. eds.), Turku School of Economics and Business Administration, Turku, pp. 1535-1545.
  21. Seffah A., Donyaee M., Kline R. B., Padda H. K., 2006. Usability measurement and metrics: A consolidated model. In Software Quality Control, Vol. 14, Issue 2, pp. 159-178.
  22. Topaloglu, H., Gumussoy, C. A., Bayraktaroglu, A. E. and Calisir, F., 2012. The relative importance of usability and functionality factors for e-health web sites. In Human Factors and Ergonomics in Manufacturing & Service Industries.
  23. Tullis T., Albert W., 2008. Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann, 1st edition.
  24. Woolrych, A., Cockton, G., 2001. Why and When Five Test Users aren't Enough. In Proceedings IHM-HCI Conference, Volume 2, pp. 105-108.
Download


Paper Citation


in Harvard Style

Miłosz M., Borys M. and Laskowski M. (2013). Memorability Experiment Vs. Expert Method in Websites Usability Evaluation . In Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 978-989-8565-61-7, pages 151-157. DOI: 10.5220/0004453801510157


in Bibtex Style

@conference{iceis13,
author={Marek Miłosz and Magdalena Borys and Maciej Laskowski},
title={Memorability Experiment Vs. Expert Method in Websites Usability Evaluation},
booktitle={Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2013},
pages={151-157},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004453801510157},
isbn={978-989-8565-61-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 15th International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - Memorability Experiment Vs. Expert Method in Websites Usability Evaluation
SN - 978-989-8565-61-7
AU - Miłosz M.
AU - Borys M.
AU - Laskowski M.
PY - 2013
SP - 151
EP - 157
DO - 10.5220/0004453801510157