
ric system depend on its input data and that the choice
of thresholds depends on the costs of false accepts and
false rejects. To set operational thresholds, the exper-
iment should be run with commercial face compari-
son algorithms and more, operational face image data.
Real-world probe images differ not only in terms of
face occlusion but may exhibit other irregularities at
the same time.
6 CONCLUSIONS
Drawing on state-of-the-art face landmark estimation
and face segmentation methods, a C++ implementa-
tion to determine the percentage of face occlusion was
developed. When forming the landmarked region, a
concave polygon along the face contour landmarks is
used instead of the convex hull proposed in (ISO/IEC
FDIS 29794-5, 2024). For faces showing other than
frontal or near-frontal poses, a convex hull of the land-
marks incorrectly includes parts of the background.
The proposed method is applicable to any image on
which a face can be detected, not only to frontal or
near-frontal face images. The experiments in Sec-
tion 5 show that the presented method and OFIQ
achieve very similar results. This suggests that OFIQ
does not use the convex hull in mathematical terms
either but the possibly concave polygon bounded by
the face contour.
Both, the presented method and OFIQ, use the
same face segmentation model, which counts the
frame of transparent eyeglasses as occlusion. To
avoid bias against the demographic group of wearers
of glasses, a discard threshold of almost 20 % mea-
sured face occlusion should be chosen. As this allows
unwanted face occlusions to be ignored, it may be bet-
ter to retrain the occlusion segmentation model not to
count transparent eyeglasses as occlusions.
Some issues in the underlying face landmark es-
timation and face segmentation software have been
identified in Section 3.5. Because of the observable
continuous improvement of such algorithms (Merkle
et al., 2022), it can be expected that these issues will
be alleviated over time.
The proposed approach can be extended to other
face image quality components defined in the emerg-
ing standard (ISO/IEC FDIS 29794-5, 2024): The
measurement of overexposure and underexposure can
be restricted to the unoccluded landmarked region,
and the face segmentation map can be used to check
for the visibility of the eyes and the presence of sun-
glasses and to determine the percentage of mouth oc-
clusion. Satisfactory results were also achieved in
NIST’s evaluation for these quality components.
ACKNOWLEDGEMENTS
This research work has been funded by the German
Federal Ministry of Education and Research and the
Hessian Ministry of Higher Education, Research, Sci-
ence and the Arts within their joint support of the
National Research Center for Applied Cybersecurity
ATHENE.
REFERENCES
Burgos-Artizzu, X., Perona, P., and Dollar, P. (2022). Cal-
tech occluded faces in the wild (COFW). https://doi.
org/10.22002/D1.20099.
Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019). Ar-
cFace: Additive angular margin loss for deep face
recognition. In IEEE Conf. on Computer Vision and
Pattern Recognition (CVPR).
Di Domenico, N., Borghi, G., Franco, A., Maltoni, D., et al.
(2024). ONOT: a high-quality ICAO-compliant syn-
thetic mugshot dataset. In 18
th
IEEE International
Conference on Automatic Face and Gesture Recogni-
tion (FG).
European Commission (2019). Commission Implementing
Decision (EU) 2019/329 of 25 February 2019 laying
down the specifications for the quality, resolution and
use of fingerprints and facial image for biometric ver-
ification and identification in the Entry/Exit System
(EES).
Frontex (2015). Best practice technical guidelines for auto-
mated border control (ABC) systems. Frontex Tech-
nical Report.
Ghiasi, G. and Fowlkes, C. (2015). Occlusion coherence:
Detecting and localizing occluded faces. https://doi.
org/10.48550/arXiv.1506.08347.
hpc203 (2024). hpc203/yolov8-face-landmarks-
opencv-dnn. https://github.com/hpc203/
yolov8-face-landmarks-opencv-dnn.
ICAO (2018). Portrait quality (reference facial im-
ages for MRTD). ICAO Technical Report.
https://www.icao.int/Security/FAL/TRIP/Documents/
TR-PortraitQualityv1.0.pdf.
ISO/IEC 19794-5 (2011). Information technology – Bio-
metric data interchange formats – Part 5: Face image
data. International Standard ISO/IEC 19794-5.
ISO/IEC 29794-1 (2024). Information technology – Bio-
metric sample quality – Part 1: Framework. Interna-
tional Standard ISO/IEC 29794-1.
ISO/IEC 29794-4 (2024). Information technology – Bio-
metric sample quality – Part 4: Finger image data. In-
ternational Standard ISO/IEC 29794-4.
ISO/IEC FDIS 29794-5 (2024). Information technology
– Biometric sample quality – Part 5: Face image
data. Final Draft International Standard ISO/IEC
FDIS 29794-5.
Lz (2023). 610265158/peppa pig face landmark: new base
line. https://doi.org/10.5281/zenodo.7894492.
Occlusion Detection for Face Image Quality Assessment
663