Authors:
Klaudia Szabó Ledenyi
1
;
András Kicsi
1
and
László Vidács
1
;
2
Affiliations:
1
Department of Software Engineering, University of Szeged, Szeged, Hungary
;
2
HUN-REN-SZTE Research Group on Artificial Intelligence, Szeged, Hungary
Keyword(s):
Radiology, Clinical Reports, NLP, LLM, GPT, Prompt Engineering.
Abstract:
The significant growth of large language models revolutionized the field of natural language processing. Recent advancements in large language models, particularly generative pretrained transformer (GPT) models, have shown advanced capabilities in natural language understanding and reasoning. These models typically interact with users through prompts rather than providing training data or fine-tuning, which can save a significant amount of time and resources. This paper presents a study evaluating GPT-4’s performance in data mining from free-text spine radiology reports using a single prompt. The evaluation includes sentence classification, sentence-level sentiment analysis and two representative biomedical information extraction tasks: named entity recognition and relation extraction. Our research findings indicate that GPT-4 performs effectively in few-shot information extraction from radiology text, even without specific training for the clinical domain. This approach shows potent
ial for more effective information extraction from free-text radiology reports compared to manual annotation.
(More)