Historical Report Assist Medical Report Generation

Shan Ye, Mei Wang, Yijie Dong

2021

Abstract

How to automatically generate diagnostic reports with accurate content, standardized structure and clear semantics, brings great challenges due to the complexity of medical images and the detailed paragraph descriptions for medical images. The structure and the semantic contents of the historical report are very helpful for the current report generation. This paper proposes a text report generation method assisted by historical reports. In the proposed method, both the previous report and the keywords generated from the current images are modeled by using two encoders respectively. The co-attention mechanism is introduced to jointly learn the historical reports and the keywords. The decoder based on the co-attention is used to generate a long description of the image. The progress that learns from the historical report and the current report in the training set helps to generate an accurate report for the new image. Furthermore, the structure in the historical report helps to generate a more natural text report. We conducted experiments on the practical ultrasound data, which is provided by a prestigious hospital in China. The experimental results show that the reports generated by the proposed method are closer to the reports generated by radiologists.

Paper Citation

in Harvard Style

Ye S., Wang M. and Dong Y. (2021). Historical Report Assist Medical Report Generation. In Proceedings of the 14th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2021) - Volume 5: HEALTHINF; ISBN 978-989-758-490-9, SciTePress, pages 166-174. DOI: 10.5220/0010245601660174

in Bibtex Style

@conference{healthinf21,
author={Shan Ye and Mei Wang and Yijie Dong},
title={Historical Report Assist Medical Report Generation},
booktitle={Proceedings of the 14th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2021) - Volume 5: HEALTHINF},
year={2021},
pages={166-174},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010245601660174},
isbn={978-989-758-490-9},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2021) - Volume 5: HEALTHINF
TI - Historical Report Assist Medical Report Generation
SN - 978-989-758-490-9
AU - Ye S.
AU - Wang M.
AU - Dong Y.
PY - 2021
SP - 166
EP - 174
DO - 10.5220/0010245601660174
PB - SciTePress