AI-Assisted Debrief: Automated Flight Debriefing Summarization and Competency Assessment

Mathijs Henquet, Thomas Bellucci

2024

Abstract

This paper seeks to explore the use of speech recognition and large language models (LLMs) to support the reporting process of flight debriefings in aviation training. We develop a system called AI-Assisted Debrief (AAD), which automatically transcribes and summarizes flight debriefings, thereby improving reporting and, in turn, improving knowledge transfer and pilot competency development. In addition, AAD assesses pilot competencies by identifying associated Performance Indicators (PIs) from the debriefs, yielding an automatic assessment of desired competencies to guide future training. We qualitatively evaluate the performance of our system using a dataset of five representative debrief recordings from flight training sessions, which are analysed by AAD and evaluated by experienced flight instructors. Our evaluation shows AAD to be capable of automatically extracting feedback and crucial information, recognizing desired pilot competencies. Future versions of AAD could enable tracking of competency development over time, offering a new method to guide aviation training. We envision AAD evolving into an interactive system which learns from human oversight to improve its accuracy and effectiveness. Propelling aviation training into the AI era, AAD paves the way for a more accurate, efficient, and comprehensive approach to pilot training, setting a new standard for excellence in the skies.

Paper Citation

in Harvard Style

Henquet M. and Bellucci T. (2024). AI-Assisted Debrief: Automated Flight Debriefing Summarization and Competency Assessment. In Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS; ISBN 978-989-758-724-5, SciTePress, pages 72-79. DOI: 10.5220/0012970200004562

in Bibtex Style

@conference{iccas24,
author={Mathijs Henquet and Thomas Bellucci},
title={AI-Assisted Debrief: Automated Flight Debriefing Summarization and Competency Assessment},
booktitle={Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS},
year={2024},
pages={72-79},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012970200004562},
isbn={978-989-758-724-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS
TI - AI-Assisted Debrief: Automated Flight Debriefing Summarization and Competency Assessment
SN - 978-989-758-724-5
AU - Henquet M.
AU - Bellucci T.
PY - 2024
SP - 72
EP - 79
DO - 10.5220/0012970200004562
PB - SciTePress