Finding Evidence for Updates in Medical Guidelines

Roelof Reinders, Annette Ten Teije, Zhisheng Huang


Medical guidelines are documents that describe optimal treatment for patients by medical practitioners based on current medical research (evidence), in the form of step-by-step recommendations. Because the field of medical research is very large and always evolving, keeping these guidelines up-to-date with the current state of the art is a difficult task. In this paper, we propose a method for finding relevant evidence for supporting the medical guideline updating process. Our method that takes from the evidence-based medical guideline the recommendations and their corresponding evidence as its input, and that queries PubMed, the world’s largest search engine for medical citations, for potential new or improved evidence. We built a prototype and performed a feasibility study on a set of old recommendations, and compared the output to evidence for the newer version. The system succeeded in finding goal articles for 11 out of 16 recommendations, but in total, only 20 out of 71 articles were retrieved. Our ranking method for most relevant articles worked well for small result sets, but for large result sets it failed to rank the goal articles in the top 25 results.


  1. Entrez Programming Utilities Help [Internet]. Bethesda (MD): National Center for Biotechnology Information (US); 2010-. Available from:
  2. PubMed Help [Internet]. Bethesda (MD): National Center for Biotechnology Information (US); 2005-. PubMed Help. [Updated 2014 Jul 9]. Available from:
  3. Cohen, A. M., Ambert, K., & McDonagh, M. (2012). Studying the potential impact of automated document classification on scheduling a systematic review update. BMC medical informatics and decision making, 12(1), 33.
  4. Field, M. J., & Lohr, K. N. (1990). Clinical practice guidelines: Directions for a new Program. Washington (DC): Institute of Medicine.
  5. Iruetaguena, A., Garcia Adeva, J.J., Pikatza, J. M., Segundo, U., Buenestado, D., & Barrena, R. (2013). Automatic retrieval of current evidence to support update of bibliography in clinical guidelines. Expert Syst. Appl., 40, 6 (May 2013), 2081-2091.
  6. Lipscomb, C. E. (2000). Medical subject headings (MeSH). Bulletin of the Medical Library Association, 88(3), 265.
  7. Peleg, M., Tu, S., Bury, J., Ciccarese, P., Fox, J., Greenes, R. A., ... & Stefanelli, M. (2003). Comparing computer-interpretable guideline models: a casestudy approach. Journal of the American Medical Informatics Association, 10(1), 52-68.
  8. Rogers, F. B. (1964). The Development of MEDLARS. Bull Med Libr Assoc., 52(1): 150C151.
  9. Rosenfeld, R. M., & Shiffman, R. N. (2009). Clinical practice guideline development manual: a qualitydriven approach for translating evidence into action. Otolaryngology-head and neck surgery: official journal of American Academy of Otolaryngology-Head and Neck Surgery, 140(6 Suppl 1), S1.
  10. Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: what it is and what it isn't. BMJ: British Medical Journal, 312(7023), 71.
  11. Salton, G., & Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information processing & management, 24(5), 513-523.
  12. Seyfang, A., Martnez-Salvador, B., Serban, R., Wittenberg, J., Miksch, S., Marcos, M., ten Teije, A. & Rosenbrand, K. (2007). Maintaining formal models of living guidelines efficiently. In Artificial Intelligence in Medicine (pp. 441-445). Springer Berlin Heidelberg.
  13. Shekelle, P., Eccles, M. P., Grimshaw, J. M., & Woolf, S. H. (2001). When should clinical guidelines be updated?. BMJ: British Medical Journal, 323(7305), 155.

Paper Citation

in Harvard Style

Reinders R., Ten Teije A. and Huang Z. (2015). Finding Evidence for Updates in Medical Guidelines . In Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2015) ISBN 978-989-758-068-0, pages 91-102. DOI: 10.5220/0005219900910102

in Bibtex Style

author={Roelof Reinders and Annette Ten Teije and Zhisheng Huang},
title={Finding Evidence for Updates in Medical Guidelines},
booktitle={Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2015)},

in EndNote Style

JO - Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2015)
TI - Finding Evidence for Updates in Medical Guidelines
SN - 978-989-758-068-0
AU - Reinders R.
AU - Ten Teije A.
AU - Huang Z.
PY - 2015
SP - 91
EP - 102
DO - 10.5220/0005219900910102