Multimodal Ranked Search over Integrated Repository of Radiology Data Sources

Priya Deshpande, Alexander Rasin, Fang Cao, Sriram Yarlagadda, Eli Brown, Jacob Furst, Daniela S. Raicu

2019

Abstract

Radiology teaching files serve as a reference in the diagnosis process and as a learning resource for radiology residents. Many public teaching file data sources are available online and private in-house repositories are maintained in most hospitals. However, the native interfaces for querying public repositories have limited capabilities. The Integrated Radiology Image Search (IRIS) Engine was designed to combine public data sources and in-house teaching files into a single resource. In this paper, we present and evaluate ranking strategies that prioritize the most relevant teaching files for a query. We quantify query context through a weighted text-based search and with ontology integration. We also incorporate an image-based search that allows finding visually similar teaching files. Finally, we augment text-based search results with image-based search – a hybrid approach that further improves search result relevance. We demonstrate that this novel approach to searching radiology data produces promising results by evaluating it with an expert panel of reviewers and by comparing our search performance against other publicly available search engines.

Paper Citation

in Harvard Style

Deshpande P., Rasin A., Cao F., Yarlagadda S., Brown E., Furst J. and Raicu D. (2019). Multimodal Ranked Search over Integrated Repository of Radiology Data Sources. In Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 1: KDIR; ISBN 978-989-758-382-7, SciTePress, pages 372-383. DOI: 10.5220/0008166603720383

in Bibtex Style

@conference{kdir19,
author={Priya Deshpande and Alexander Rasin and Fang Cao and Sriram Yarlagadda and Eli Brown and Jacob Furst and Daniela S. Raicu},
title={Multimodal Ranked Search over Integrated Repository of Radiology Data Sources},
booktitle={Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 1: KDIR},
year={2019},
pages={372-383},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008166603720383},
isbn={978-989-758-382-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 1: KDIR
TI - Multimodal Ranked Search over Integrated Repository of Radiology Data Sources
SN - 978-989-758-382-7
AU - Deshpande P.
AU - Rasin A.
AU - Cao F.
AU - Yarlagadda S.
AU - Brown E.
AU - Furst J.
AU - Raicu D.
PY - 2019
SP - 372
EP - 383
DO - 10.5220/0008166603720383
PB - SciTePress