Stability Evaluation of Combined Neural Networks

Ibtissem Ben Othman, Faouzi Ghorbel

2014

Abstract

In the industrial field, the artificial neural network classifiers are currently used and they are generally integrated of technologic systems which need efficient classifier. However, the lack of control over its mathematical formulation explains the instability of its classification results. In order to improve the prediction accuracy, most of researchers refer to the classifiers combination approach. This paper tries to illustrate the capability of an example of combined neural networks to improve the stability criterion of the single neural classifier. The stability comparison is performed by the error rate probability densities function estimated by a new variant of the kernel-diffeomorphism semi-bounded Plug-in algorithm.

References

  1. Breiman, L., 1996. Bagging predictors, Machine learning, vol. 24, no. 2, pp. 123-140.
  2. Fukunaga, K., 1990. Introduction to Statistical Pattern Recognition, Academic Press, second edition.
  3. Geman, S. Bienenstock, E., Doursat, T., 1992. Neural networks and the bias/variance dilemma, Neural Comput., vol. 5, pp. 1-58.
  4. Ghorbel, F., 1998. Towards a unitary formulation for invariant image description: application to image coding. Annals of telecommunication, vol. 53, France.
  5. Ghorbel, F., and al., 2012. Récentes avancées en Reconnaissance de Formes Statistique, Art-pi edition, Tunis, www.arts-pi.org.tn.
  6. Hansen, L.K., Salamon, P., 1990. Neural network ensembles, IEEE Trans. Pattern Anal. Machine Intell., vol. 12, no. 10, pp. 993-1001.
  7. Kumar, U.A., 2005. Comparison of neural networks and regression analysis: A new insight. Expert Systems with Applications, vol. 29, no. 2, pp. 424-430.
  8. Lepage, R., Solaiman, B., 2003. Les réseaux de neurones artificiels et leurs applications en imagerie et en vision par ordinateur. Montréal.
  9. MacKay, D.J.C., 1992. A practical Bayesian framework for back-propagation networks. Neural Comput, 4(3), 448-72.
  10. Mackay, D.J.C., 1995. Bayesian methods for neural networks: theory and applications.
  11. Miller, D.W., 1998. Fitting frequency distributions, Book Resource. Second edition.
  12. Morgan, N., and Bourlard, H., 1990. Generalization and parameter estimation in feedforward nets: Some experiments, Adv. Neural Inform. Process. Syst., vol. 2, pp. 630-637.
  13. Othman, I.B., Ghorbel, F., 2013, A New criterion for Comparing Neural Networks and Bayesian Classifier, ICCAT' 2013, Tunisia.
  14. Othman, I. B., Ghorbel, F., 2014. The Use of the Modified Semi-bounded Plug-in Algorithm to Compare Neural and Bayesian Classifiers Stability, Neural Networks and Fuzzy Systems, Venice, Italy.
  15. Paliwal, M., Kumar, U.A., 2009. Neural networks and statistical techniques: A review of applications, Expert Syst. Appl., vol. 36, no. 1, pp. 2-17.
  16. Saoudi, S., Ghorbel, F., Hillion, A., 1994. Nonparametric probability density function estimation on a bounded support: applications to shape classification and speech coding, Applied Stochastic Models and Data Analysis Journal, vol. 10, no. 3, pp. 215-231.
  17. Saoudi, S., Ghorbel, F., Hillion, A., 1997. Some statistical properties of the kernel-diffeomorphism estimator, Applied Stochastic Models and Data Analysis Journal, Vol. 13, no. 1, pp. 39-58.
  18. Steven, K., Rogers, Kabrisky, M., 1991. An Introduction to Biological and Artificial Neural Networks for Pattern Recognition, SPIE Optical Engineering Press, vol. 4.
  19. Troudi, M., Ghorbel, F., 2013. The generalised Plug-in algorithm for the diffeomorphism kernel estimate. International Conference on Systems, Control, Signal Processing and Informatics.
  20. Weiss, S.M., Kulilowski, C.A., 1991. Computer Systems that Learn. San Mateo, CA: Morgan Kaufmann.
  21. Zhang, G.P., 2000. Neural networks for classification: a survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions, vol. 30, no 4, p. 451-462.
Download


Paper Citation


in Harvard Style

Ben Othman I. and Ghorbel F. (2014). Stability Evaluation of Combined Neural Networks . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014) ISBN 978-989-758-054-3, pages 203-209. DOI: 10.5220/0005077402030209


in Bibtex Style

@conference{ncta14,
author={Ibtissem Ben Othman and Faouzi Ghorbel},
title={Stability Evaluation of Combined Neural Networks},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)},
year={2014},
pages={203-209},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005077402030209},
isbn={978-989-758-054-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2014)
TI - Stability Evaluation of Combined Neural Networks
SN - 978-989-758-054-3
AU - Ben Othman I.
AU - Ghorbel F.
PY - 2014
SP - 203
EP - 209
DO - 10.5220/0005077402030209