Authors:
Jean-François Connolly
;
Eric Granger
and
Robert Sabourin
Affiliation:
Université du Québec, Canada
Keyword(s):
Multi-classifier Systems, Incremental Learning, Dynamic and Multi-objective Optimization, ARTMAP Neural Networks, Video Face Recognition, Adaptive Biometrics.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Classification
;
Computer Vision, Visualization and Computer Graphics
;
Ensemble Methods
;
Evolutionary Computation
;
Image and Video Analysis
;
Incremental Learning
;
Pattern Recognition
;
Software Engineering
;
Theory and Methods
;
Video Analysis
Abstract:
Classification systems are often designed using a limited amount of data from complex and changing pattern recognition environments. In applications where new reference samples become available over time, adaptive multi-classifier systems (AMCSs) are desirable for updating class models. In this paper, an incremental learning strategy based on an aggregated dynamical niching particle swarm optimization (ADNPSO) algorithm
is proposed to efficiently evolve heterogeneous classifier ensembles in response to new reference data. This strategy is applied to an AMCS where all parameters of a pool of fuzzy ARTMAP (FAM) neural network classifiers, each one corresponding to a PSO particle, are co-optimized such that both error rate and network size are minimized. To sustain a high level of accuracy while minimizing the computational complexity, the AMCS integrates information from multiple diverse classifiers, where learning is guided by the ADNPSO algorithm that optimizes networks according bot
h these objectives. Moreover, FAM networks are evolved to maintain (1) genotype diversity of solutions around local optima in the optimization search space, and (2) phenotype diversity in the objective space. Using local Pareto optimality, networks are then stored in an archive to create
a pool of base classifiers among which cost-effective ensembles are selected on the basis of accuracy, and both genotype and phenotype diversity. Performance of the ADNPSO strategy is compared against AMCSs where learning of FAM networks is guided through mono- and multi-objective optimization, and assessed under different incremental learning scenarios, where new data is extracted from real-world video streams for
face recognition. Simulation results indicate that the proposed strategy provides a level of accuracy that is comparable to that of using mono-objective optimization, yet requires only a fraction of its resources.
(More)