PUMP: An Underspecification Analysis Tool

Jonathan Tang, McClain Kressman, Harsha Lakshmankumar, Belle Aduaka, Ava Jakusovszky, Paul Anderson, Jean Davidson

2023

Abstract

In fields such as biomedicine, neural networks may encounter a problem known as underspecification, in which models learn a solution that performs poorly and inconsistently when deployed in more generalized real-world scenarios. A current barrier to studying this problem in biomedical research is a lack of tools engineered to uncover and measure the degree of underspecification. For this reason, we have developed Predicting Underspecification Monitoring Pipeline or PUMP. We demonstrate the utility of PUMP in predictive modeling of breast cancer subtypes. In addition to providing methods to measure, monitor, and predict underspecification, we explore methods to minimize the production of underspecified models by incorporating biological insight that aims to rank potential models.

Paper Citation

in Harvard Style

Tang J., Kressman M., Lakshmankumar H., Aduaka B., Jakusovszky A., Anderson P. and Davidson J. (2023). PUMP: An Underspecification Analysis Tool. In Proceedings of the 16th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2023) - Volume 3: BIOINFORMATICS; ISBN 978-989-758-631-6, SciTePress, pages 101-108. DOI: 10.5220/0011697600003414

in Bibtex Style

@conference{bioinformatics23,
author={Jonathan Tang and McClain Kressman and Harsha Lakshmankumar and Belle Aduaka and Ava Jakusovszky and Paul Anderson and Jean Davidson},
title={PUMP: An Underspecification Analysis Tool},
booktitle={Proceedings of the 16th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2023) - Volume 3: BIOINFORMATICS},
year={2023},
pages={101-108},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011697600003414},
isbn={978-989-758-631-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2023) - Volume 3: BIOINFORMATICS
TI - PUMP: An Underspecification Analysis Tool
SN - 978-989-758-631-6
AU - Tang J.
AU - Kressman M.
AU - Lakshmankumar H.
AU - Aduaka B.
AU - Jakusovszky A.
AU - Anderson P.
AU - Davidson J.
PY - 2023
SP - 101
EP - 108
DO - 10.5220/0011697600003414
PB - SciTePress