Authors:
Diego Santiago de Meneses Carvalho
1
and
Areolino de Almeida Neto
2
Affiliations:
1
Department of Computing, IFMA, Sao Luis and Brazil
;
2
Department of Informatics, UFMA, Sao Luis and Brazil
Keyword(s):
Artificial Neural Networks, Momentum Term, Correlation Coefficient, BP with Selective Momentum.
Related
Ontology
Subjects/Areas/Topics:
Artificial Intelligence
;
Biomedical Engineering
;
Biomedical Signal Processing
;
Computational Intelligence
;
Health Engineering and Technology Applications
;
Human-Computer Interaction
;
Methodologies and Methods
;
Neural Networks
;
Neurocomputing
;
Neurotechnology, Electronics and Informatics
;
Pattern Recognition
;
Physiological Computing Systems
;
Sensor Networks
;
Signal Processing
;
Soft Computing
;
Theory and Methods
Abstract:
In many cases it is very hard to get an Artificial Neural Network (ANN) suitable for learning the solution, i.e., it cannot acquire the desired knowledge or needs an enormous number of training iterations. In order to improve the learning of ANN type Multi-Layer Perceptron (MLP), this work describes a new methodology for selecting weights, which will have the momentum term added to variation calculus of their values during each training iteration via Backpropagation (BP) algorithm. For that, the Pearson or Spearman correlation coefficients are used. Even very popular, the usage of BP algorithm has some drawbacks, among them the high convergence time is highlighted. A well-known technique used to reduce this disadvantage is the momentum term, which tries to accelerate the ANN learning keeping its stability, but when it is applied in all weights, as commonly used, with inadequate parameters, the result can be easily a failure in the training or at least an insignificant reduction of th
e ANN training time. The use of the Selective Momentum Term (SMT) can reduce the training time and, therefore, be also used for improving the training of deep neural networks.
(More)