Reliability Estimation for Multimodal Error Prediction and Fusion

Krzysztof Kryszczuk, Jonas Richiardi, Andrzej Drygajlo

Abstract

This paper focuses on the estimation of reliability of unimodal and multimodal verification decisions produced by biometric systems. Reliability estimates have been demonstrated to be an elegant tool for incorporating quality measures into the process of estimating the probability of correctness of the decisions. In this paper we compare decision- and score-level schemes of multimodal fusion using reliability estimates obtained with two alternative methods. Further, we propose a method of estimating the reliability of multimodal decisions based on the unimodal reliability estimates. Using a standard benchmarking multimodal database we demonstrate that the score-level reliability-based fusion outperforms alternative approaches, and that the proposed estimates of multimodal decision reliability allow for an accurate prediction of errors committed by the fusion module.

References

  1. Richiardi, J., Drygajlo, A., Prodanov, P.: Confidence and reliability measures in speaker verification. Journal of the Franklin Institute 343 (2006) 574-595
  2. Kryszczuk, K., Drygajlo, A.: On combining evidence for reliability estimation in face verification. In: Proc. of the EUSIPCO 2006, Florence (2006)
  3. Russel, S., Norvig, P.: Artificial Intelligence. A Modern Approach. Prentice Hall (1995)
  4. Duda, R., Hart, P., Stork, D.: Pattern Classification. 2nd edn. Wiley Interscience, New York (2001)
  5. Bengio, S., Marcel, C., Marcel, S., Mariethoz, J.: Confidence measures for multimodal identity verification. Information Fusion 3 (2002) 267-276
  6. Toh, K.A., Yau, W.Y., Lim, E., Chen, L., Ng, C.H.: Fusion of auxiliary information for multimodal biometrics authentication. In: Proceedings of International Conference on Biometrics. Lecture Notes in Computer Science, Hong Kong, Springer (2004) 678-685
  7. Fierrez-Aguilar, J.: Adapted Fusion Schemes for Multimodal Biometric Authentication. PhD thesis, Universidad Politecnica de Madrid (2006)
  8. Campbell, W., Reynolds, D., Campbell, J., Brady, K.: Estimating and evaluating confidence for forensic speaker recognition. In: Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP). Volume 1. (2005) 717-720
  9. Poh, N., Bengio, S.: Improving fusion with margin-derived confidence in biometric authentication tasks. In: Proceedings of the AVBPA, Rye Brook NY, USA (2005)
  10. Kryszczuk, K., Richiardi, J., Prodanov, P., Drygajlo, A.: Error handling in multimodal biometric systems using reliability measures. In: 13th European Signal Processing Conference (EUSIPCO 2005), Antalya, Turkey (2005)
  11. Bailly-Baillire, E., Bengio, S., Bimbot, F., Hamouz, M., Kittler, J., Marithoz, J., Matas, J., Messer, K., Popovici, V., Pore, F., Ruiz, B., Thiran, J.P.: The BANCA database and evaluation protocol. In Kittler, J., Nixon, M., eds.: Proceedings of 4th Int. Conf. on Audioand Video-Based Biometric Person Authentication (AVBPA). Volume LNCS 2688. (2003) 625-638
  12. Poh, N., Bengio, S.: Can chimeric persons be used in multimodal biometric authentication experiments? In: Proc. 2nd Joint AMI/PASCAL/IM2/M4 Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI). Volume LNCS 3869. (2005) 87-100
  13. Sanderson, C.: Automatic Person Verification Using Speech and Face Information. PhD thesis, Griffith University, Queensland, Australia (2003)
  14. Bonastre, J.F., Wils, F., Meignier, S.: ALIZE, a free toolkit for speaker recognition. In: Proc. IEEE International Conf. on Acoustics, Speech and Signal Processing ICASP 2005, Philadelphia, USA (2005) 737-740
  15. Richiardi, J., Prodanov, P., Drygajlo, A.: A probabilistic measure of modality reliability in speaker verification. In: Proc. IEEE International Conf. on Acoustics, Speech and Signal Processing ICASP 2005, Philadelphia, USA (2005) 709-712
Download


Paper Citation


in Harvard Style

Kryszczuk K., Richiardi J. and Drygajlo A. (2007). Reliability Estimation for Multimodal Error Prediction and Fusion . In Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007) ISBN 978-972-8865-93-1, pages 15-24. DOI: 10.5220/0002431100150024


in Bibtex Style

@conference{pris07,
author={Krzysztof Kryszczuk and Jonas Richiardi and Andrzej Drygajlo},
title={Reliability Estimation for Multimodal Error Prediction and Fusion},
booktitle={Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007)},
year={2007},
pages={15-24},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002431100150024},
isbn={978-972-8865-93-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007)
TI - Reliability Estimation for Multimodal Error Prediction and Fusion
SN - 978-972-8865-93-1
AU - Kryszczuk K.
AU - Richiardi J.
AU - Drygajlo A.
PY - 2007
SP - 15
EP - 24
DO - 10.5220/0002431100150024