Optimization Strategies for Tuning the Parameters of Radial Basis Functions Network Models

Gancho Vachkov, Nikolinka Christova, Magdalena Valova

2014

Abstract

In this paper the problem of tuning the parameters of the RBF networks by using optimization methods is investigated. Two modifications of the classical RBFN, called Reduced and Simplified RBFN are introduced and analysed in the paper. They have a smaller number of parameters. Three optimization strategies that perform one or two steps for tuning the parameters of the RBFN models are explained and investigated in the paper. They use the particle swarm optimization algorithm with constraints. The one-step Strategy 3 is a simultaneous optimization of all three groups of parameters, namely the Centers, Widths and the Weights of the RBFN. This strategy is used in the paper for performance evaluation of the Reduced and Simplified RBFN models. A test 2-dimensional example with high nonlinearity is used to create different RBFN models with different number of RBFs. It is shown that the Simplified RBFN models can achieve almost the same modelling accuracy as the Reduced RBFN models. This makes the Simplified RBFN models a preferable choice as a structure of the RBFN model.

References

  1. Poggio, T., Girosi, F., 1990. Networks for approximation and learning. Proceedings of the IEEE, 78, 1481-1497.
  2. Musavi, M., Ahmed, W., Chan, K., Faris, K., Hummels, D., 1992. On the training of radial basis function classifiers. Neural Networks, 5, 595-603.
  3. Park, J., Sandberg, I.W., 1993. Approximation and radialbasis-function networks. Neural Computation, 5, 305- 316.
  4. Eberhart, R.C., Kennedy, J., 1995. Particle swarm optimization. In: Proc. of IEEE Int. Conf. on Neural Network, Perth, Australia (1995) 1942-1948.
  5. Yousef, R., 2005. Training radial basis function networks using reduced sets as center points. International Journal of Information Technology, Vol. 2, pp. 21.
  6. Zhang, J.-R., Zhang, J., Lok, T., Lyu, M., 2007. A hybrid particle swarm optimization, back-propagation algorithm for feed forward neural network training. Applied Mathematics and Computation 185, 1026- 1037.
  7. Poli, R., Kennedy, J., Blackwell, T., 2007. Particle swarm optimization. An overview. Swarm Intelligence 1, 33- 57.
  8. Pedrycz, W., Park, H.S., Oh, S.K., 2008. A GranularOriented Development of Functional Radial Basis Function Neural Networks. Neurocomputing, 72, 420-435.
Download


Paper Citation


in Harvard Style

Vachkov G., Christova N. and Valova M. (2014). Optimization Strategies for Tuning the Parameters of Radial Basis Functions Network Models . In Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH, ISBN 978-989-758-038-3, pages 443-450. DOI: 10.5220/0005051104430450


in Bibtex Style

@conference{simultech14,
author={Gancho Vachkov and Nikolinka Christova and Magdalena Valova},
title={Optimization Strategies for Tuning the Parameters of Radial Basis Functions Network Models},
booktitle={Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,},
year={2014},
pages={443-450},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005051104430450},
isbn={978-989-758-038-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,
TI - Optimization Strategies for Tuning the Parameters of Radial Basis Functions Network Models
SN - 978-989-758-038-3
AU - Vachkov G.
AU - Christova N.
AU - Valova M.
PY - 2014
SP - 443
EP - 450
DO - 10.5220/0005051104430450