Text-based Medical Image Retrieval using Convolutional Neural Network and Specific Medical Features

Nada Souissi, Hajer Ayadi, Mouna Torjmen-Khemakhem

2019

Abstract

With the proliferation of digital imaging data in hospitals, the amount of medical images is increasing rapidly. Thus, the need for efficient retrieval systems, to find relevant information from large medical datasets, becomes high. The Convolutional Neural Network (CNN)-based models have been proved to be effective in several areas including, for example, medical image retrieval. Moreover, the Text-Based Image Retrieval (TBIR) was successful in retrieving images with textual description. However, in TBIR, all queries and documents are processed without taking into account the influence of certain medical terminologies (Specific Medical Features (SMF)) on the retrieval performance. In this paper, we propose a re-ranking method using the CNN and the SMF for text-medical image retrieval. First, images (documents) and queries are indexed to specific medical image features. Second, the Word2vec tool is used to construct feature vectors for both documents and queries. These vectors are then integrated into a neural network process and a matching function is used to re-rank documents obtained initially by a classical retrieval model. To evaluate our approach, several experiments are carried out with Medical ImageCLEF datasets from 2009 to 2012. Results show that our proposed approach significantly enhances image retrieval performance compared to several state of the art models.

Paper Citation

in Harvard Style

Souissi N., Ayadi H. and Torjmen-Khemakhem M. (2019). Text-based Medical Image Retrieval using Convolutional Neural Network and Specific Medical Features. In Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2019) - Volume 5: HEALTHINF; ISBN 978-989-758-353-7, SciTePress, pages 78-87. DOI: 10.5220/0007355400780087

in Bibtex Style

@conference{healthinf19,
author={Nada Souissi and Hajer Ayadi and Mouna Torjmen-Khemakhem},
title={Text-based Medical Image Retrieval using Convolutional Neural Network and Specific Medical Features},
booktitle={Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2019) - Volume 5: HEALTHINF},
year={2019},
pages={78-87},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007355400780087},
isbn={978-989-758-353-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2019) - Volume 5: HEALTHINF
TI - Text-based Medical Image Retrieval using Convolutional Neural Network and Specific Medical Features
SN - 978-989-758-353-7
AU - Souissi N.
AU - Ayadi H.
AU - Torjmen-Khemakhem M.
PY - 2019
SP - 78
EP - 87
DO - 10.5220/0007355400780087
PB - SciTePress