Regarding the results obtained and the results of
the systematic review by (Larburu et al., 2023) which
summarizes the articles dealing with predictive
models of ward admissions, it can be seen that even
without the clinicians triage variable, the arrival
model exceeds a quarter of the articles in the
systematic review, which make use of variables at
triage. Therefore, this initial model, achieves results
comparable with the literature but without the need of
clinician’s involvement.
In the case of the triage model, we observe that
three studies demonstrate superior results in terms of
AUC: 0.92 (Hong et al., 2018), 0.89 (Cusidó et al.,
2022), and 0.877 (Cameron et al., 2015). It is worth
noting that these three articles have been trained on
much larger databases, consisting of 560 thousand, 3
million, and 255 thousand instances, respectively. We
have identified six articles that achieve similar AUC
value (confidence intervals overlap), generally
characterized by a comparable database size (Sun et
al., 2011; Martinez et al., 2012; Zlotnik et al., 2016;
Graham et al., 2018; Lucke et al., 2018; De Hond et
al., 2021). Lastly, our model outperforms five
articles, all of which, except for one (more than a
million instances), make use of much smaller
databases (Noel et al., 2019; Parker et al., 2019; Brink
et al., 2020; Feretzakis, Karlis, et al., 2022;
Feretzakis, Sakagianni, et al., 2022).
Finally, it is important to note that the laboratory
model cannot be directly compared with the models
in the systematic review. This is because the
laboratory model is trained on a small population
consisting specifically of patients undergoing
laboratory tests in the ED, patient in worse condition.
These machine learning models offer an
opportunity to improve the management and
efficiency of emergency departments from a clinical
perspective. These models can help prioritize and
allocate resources more effectively, streamlining
floor admission processes and optimizing patient
care, as well as achieving more efficient management
of available resources, ensuring timely and
appropriate care for each patient, and thus improving
clinical outcomes in the ED setting. Additionally,
these models can play a relevant role in reducing
hospital admission inadequacy, which directly
translates into improvements in patient safety (Puig et
al., 2004).
However, it is important to mention some
limitations of the study. One important limitation to
consider is the applicability of the model to different
clinical contexts or settings. Since machine learning
models are trained with data specific to a particular
institution or context, it is possible that their
performance and predictive ability may be affected
when applied in other settings with different
characteristics. The variables used in the model may
be related to clinical practice and procedures specific
to the home institution, which could limit its
usefulness elsewhere where the relevant variables
may vary.
ACKNOWLEDGEMENTS
The authors would like to thank INVIZA-Asunción
Klinica and STT Systems for their support in the
INURGE project. This work has been funded by the
research project INURGE (ZL-2022/00571) of the
Basque Government’s HAZITEK programme from
the public agency SPRI.
ETHICAL COMMITEE
The study was conducted in accordance with the
Declaration of Helsinki and approved by the Research
Ethics Committee of the Gipuzkoa Health Area
(protocol code SAMURG-2022-01, 6 February
2023).
REFERENCES
Brink, A., Alsma, J., Brink, H. S. et al. (2020). Prediction
admission in the older population in the Emergency
Department: the CLEARED tool. Neth J Med 78, 357–
367
Browne, M. W. (2000). Cross-Validation Methods. J Math
Psychol 44, 108–132. https://doi.org/10.1006/jmps.19
99.1279.
Cameron, A., Rodgers, K., Ireland, A. et al. (2015). A
simple tool to predict admission at the time of triage.
Emerg Med J 32, 174–179
Cusidó, J., Comalrena, J., Alavi, H. et al. (2022). Predicting
Hospital Admissions to Reduce Crowding in the
Emergency Departments. Appl Sci 12, 10764
De Hond, A., Raven, W., et al. (2021). Machine learning
for developing a prediction model of hospital admission
of emergency department patients: Hype or hope? Int J
Med Inf 152, 104496
Feretzakis, G., Karlis, G., et al. (2022). Using machine
learning techniques to predict hospital admission at the
emergency department. J Crit Care Med 8, 107–116
Feretzakis, G., Sakagianni, A., Loupelis, E. et al. (2022).
Predicting Hospital Admission for Emergency
Department Patients: A Machine Learning Approach.
Stud Health Technol Inf, 297–300