THE ROLE OF SEQUENCES FOR INCREMENTAL LEARNING

Susanne Wenzel, Lothar Hotz

Abstract

In this paper, we point out the role of sequences of samples for training an incremental learning method. We define characteristics of incremental learning methods to describe the influence of sample ordering on the performance of a learned model. We show the influence of sequence for two different types of incremental learning. One is aimed on learning structural models, the other on learning models to discriminate object classes. In both cases, we show the possibility to find good sequences before starting the training.

References

  1. Bengio, Y., Louradour, J., Collobert, R., and Weston, J. (2009). Curriculum learning. In Bottou, L. and Littman, M., editors, ICML'09, pages 41-48, Montreal. Omnipress.
  2. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. In CVPR'05, volume 1, pages 886-893. IEEE Computer Society.
  3. Fisher, D. H. (1987). Knowledge acquisition via incremental conceptual clustering. Machine Learning, 2(2):139-172.
  4. Foerstner, W. (2007). Annotated image database. eTRIMS EU-Project, Deliverable D1.1.
  5. Fukunaga, K. (1972). Introduction to Statistical Pattern Recognition. Academic Press, first edition.
  6. Giraud-Carrier, C. (2000). A note on the utility of incremental learning. AI Communications, 13(4):215-223.
  7. Langley, P. (1995). Order effects in incremental learning. Learning in humans and machines: Towards an interdisciplinary learning science.
  8. McKusick, K. B. and Langley, P. (1991). Constraints on tree structure in concept formation. In IJCAI'91, pages 810-816.
  9. Mitchell, T. (1977). Version spaces: A candidate elimination approach for rule learning. In IJCAI'77, pages 305-310.
  10. Seewald, A. K. (2005). Digits - a dataset for handwritten digit recognition. Technical Report TR-2005-27, Austrian Research Institut for Artificial Intelligence.
  11. Talavera, L. and Roure, J. (1998). A buffering strategy to avoid ordering effects in clustering. In ECML'98, pages 316-321.
  12. Uray, M., Skocaj, D., Roth, P. M., Bischof, H., and Leonardis, A. (2007). Incremental LDA Learning by Combining Reconstructive and Discriminative Approaches. In BMVC'07, University of Warwick, UK.
  13. Wenzel, S. and Förstner, W. (2009). The role of sequences for incremental learning. Technical Report TR-IGGP-2009-04, Department of Photogrammetry, University of Bonn.
Download


Paper Citation


in Harvard Style

Wenzel S. and Hotz L. (2010). THE ROLE OF SEQUENCES FOR INCREMENTAL LEARNING . In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-674-021-4, pages 434-439. DOI: 10.5220/0002762604340439


in Bibtex Style

@conference{icaart10,
author={Susanne Wenzel and Lothar Hotz},
title={THE ROLE OF SEQUENCES FOR INCREMENTAL LEARNING},
booktitle={Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2010},
pages={434-439},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002762604340439},
isbn={978-989-674-021-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - THE ROLE OF SEQUENCES FOR INCREMENTAL LEARNING
SN - 978-989-674-021-4
AU - Wenzel S.
AU - Hotz L.
PY - 2010
SP - 434
EP - 439
DO - 10.5220/0002762604340439