AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization

Gerasimos Spanakis, Gerhard Weiss

2016

Abstract

Self-Organizing Map (SOM) is a neural network model which is used to obtain a topology-preserving mapping from the (usually high dimensional) input/feature space to an output/map space of fewer dimensions (usually two or three in order to facilitate visualization). Neurons in the output space are connected with each other but this structure remains fixed throughout training and learning is achieved through the updating of neuron reference vectors in feature space. Despite the fact that growing variants of SOM overcome the fixed structure limitation they increase computational cost and also do not allow the removal of a neuron after its introduction. In this paper, a variant of SOM is proposed called AMSOM (Adaptive Moving Self-Organizing Map) that on the one hand creates a more flexible structure where neuron positions are dynamically altered during training and on the other hand tackles the drawback of having a predefined grid by allowing neuron addition and/or removal during training. Experiments using multiple literature datasets show that the proposed method improves training performance of SOM, leads to a better visualization of the input dataset and provides a framework for determining the optimal number and structure of neurons.

References

  1. Alahakoon, D., Halgamuge, S. K., and Srinivasan, B. (2000). Dynamic self-organizing maps with controlled growth for knowledge discovery. Neural Networks, IEEE Transactions on, 11(3):601-614.
  2. Ayadi, T., Hamdani, T. M., and Alimi, A. M. (2012). MIGSOM: multilevel interior growing self-organizing maps for high dimensional data clustering. Neural processing letters, 36(3):235-256.
  3. Bauer, H.-U., Herrmann, M., and Villmann, T. (1999). Neural maps and topographic vector quantization. Neural networks, 12(4):659-676.
  4. Blackmore, J. and Miikkulainen, R. (1993). Incremental grid growing: encoding high-dimensional structure into a two-dimensional feature map. In Neural Networks, 1993., IEEE International Conference on, pages 450-455.
  5. Bortman, M. and Aladjem, M. (2009). A growing and pruning method for radial basis function networks. Neural Networks, IEEE Transactions on, 20(6):1039-1045.
  6. Ceccarelli, M., Petrosino, A., and Vaccaro, R. (1993). Competitive neural networks on message-passing parallel computers. Concurrency: Practice and Experience, 5(6):449-470.
  7. Changeux, J.-P. and Danchin, A. (1976). Selective stabilisation of developing synapses as a mechanism for the specification of neuronal networks. Nature, 264(5588):705-712.
  8. Deboeck, G. and Kohonen, T. (2013). Visual explorations in finance: with self-organizing maps . Springer Science & Business Media.
  9. Dowling, J. E. (2007). The Great Brain Debate: Nature Or Nurture? Princeton University Press.
  10. Estévez, P. A., Príncipe, J. C., and Zegers, P. (2012). Advances in Self-Organizing Maps: 9th International Workshop, WSOM 2012 Santiago, Chile, December 12-14, 2012 Proceedings. Springer Science & Business Media.
  11. Fort, J.-C. (2006). Soms mathematics. Neural Networks, 19(6):812-816.
  12. Fritzke, B. (1994). Growing cell structuresa self-organizing network for unsupervised and supervised learning. Neural networks, 7(9):1441-1460.
  13. Fritzke, B. (1995). Growing grida self-organizing network with constant neighborhood range and adaptation strength. Neural Processing Letters, 2(5):9-13.
  14. Fritzke, B. et al. (1995). A growing neural gas network learns topologies. Advances in neural information processing systems, 7:625-632.
  15. Han, H.-G. and Qiao, J.-F. (2013). A structure optimisation algorithm for feedforward neural network construction. Neurocomputing, 99:347-357.
  16. Hodge, V. J. and Austin, J. (2001). Hierarchical growing cell structures: TreeGCS. Knowledge and Data Engineering, IEEE Transactions on, 13(2):207-218.
  17. Islam, M., Sattar, A., Amin, F., Yao, X., and Murase, K. (2009). A new adaptive merging and growing algorithm for designing artificial neural networks. Systems, Man, and Cybernetics, Part B: Cybernetics, IEEE Transactions on, 39(3):705-722.
  18. Kohonen, T. (1981). Automatic formation of topological maps of patterns in a self-organizing system.
  19. Kohonen, T. (1988). The'neural'phonetic typewriter. Computer, 21(3):11-22.
  20. Kohonen, T. (1993). Things you haven't heard about the Self-Organizing Map. In Neural Networks, 1993., IEEE International Conference on, pages 1147-1156. IEEE.
  21. Kohonen, T. (2001). Self-organizing Maps, vol. 30 of Springer Series in Information Sciences. Springer Berlin.
  22. Kohonen, T. (2012). Self-organization and associative memory, volume 8. Springer.
  23. Lagus, K., Honkela, T., Kaski, S., and Kohonen, T. (1999). WEBSOM for textual data mining. Artificial Intelligence Review, 13(5-6):345-364.
  24. Lu, S.-y. (1990). Pattern classification using self-organizing feature maps. In 1990 IJCNN International Joint Conference on, pages 471-480.
  25. Marsland, S., Shapiro, J., and Nehmzow, U. (2002). A selforganising network that grows when required. Neural Networks, 15(8):1041-1058.
  26. Mulier, F. and Cherkassky, V. (1994). Learning rate schedules for self-organizing maps. In Pattern Recognition, 1994. Vol. 2-Conference B: Computer Vision & Image Processing., Proceedings of the 12th IAPR International. Conference on, volume 2, pages 224-228. IEEE.
  27. Odri, S. V., Petrovacki, D. P., and Krstonosic, G. A. (1993). Evolutional development of a multilevel neural network. Neural Networks, 6(4):583-595.
  28. Park, Y.-S., Tison, J., Lek, S., Giraudel, J.-L., Coste, M., and Delmas, F. (2006). Application of a selforganizing map to select representative species in multivariate analysis: A case study determining diatom distribution patterns across France. Ecological Informatics, 1(3):247 - 257. 4th International Conference on Ecological Informatics.
  29. Rauber, A., Merkl, D., and Dittenbach, M. (2002). The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data. Neural Networks, IEEE Transactions on, 13(6):1331-1341.
  30. Spanakis, G., Siolas, G., and Stafylopatis, A. (2012). DoSO: a document self-organizer. Journal of Intelligent Information Systems, 39(3):577-610.
  31. Vesanto, J., Himberg, J., Alhoniemi, E., and Parhankangas, J. (2000). SOM toolbox for Matlab 5. Citeseer.
  32. Wedeen, V. J., Rosene, D. L., Wang, R., Dai, G., Mortazavi, F., Hagmann, P., Kaas, J. H., and Tseng, W.- Y. I. (2012). The geometric structure of the brain fiber pathways. Science, 335(6076):1628-1634.
  33. Yang, S.-H. and Chen, Y.-P. (2012). An evolutionary constructive and pruning algorithm for artificial neural networks and its prediction applications. Neurocomputing, 86:140-149.
Download


Paper Citation


in Harvard Style

Spanakis G. and Weiss G. (2016). AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization . In Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-172-4, pages 129-140. DOI: 10.5220/0005704801290140


in Bibtex Style

@conference{icaart16,
author={Gerasimos Spanakis and Gerhard Weiss},
title={AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization},
booktitle={Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2016},
pages={129-140},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005704801290140},
isbn={978-989-758-172-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - AMSOM: Adaptive Moving Self-organizing Map for Clustering and Visualization
SN - 978-989-758-172-4
AU - Spanakis G.
AU - Weiss G.
PY - 2016
SP - 129
EP - 140
DO - 10.5220/0005704801290140