INDIVIDUALLY AND COLLECTIVELY TREATED NEURONS AND ITS APPLICATION TO SOM

Ryotaro Kamimura

2011

Abstract

In this paper, we propose a new type of information-theoretic method to interact individually treated neurons with collectively treated neurons. The interaction is determined by the interaction parameter a. As the parameter a is increased, the effect of collectiveness is larger. On the other hand, when the parameter a is smaller, the effect of individuality becomes dominant. We applied this method to the self-organizing maps in which much attention has been paid to the collectiveness of neurons. This biased attention has, in our view, shown difficulty in interpreting final SOM knowledge. We conducted an preliminary experiment in which the Ionosphere data from the machine learning database was analyzed. Experimental results confirmed that improved performance could be obtained by controlling the interaction of individuality with collectiveness. In particular, the trustworthiness and continuity are gradually increased by making the parameter a larger. In addition, the class boundaries become sharper by using the interaction.

References

  1. Bauer, H.-U. and Pawelzik, K. (1992). Quantifying the neighborhood preservation of self-organizing maps. IEEE Transactions on Neural Networks, 3(4):570- 578.
  2. Bishop, C. M. (1995). Neural Networks for Pattern Recognition. Oxford University Press.
  3. Costa, J. A. F. Clustering and visualizing som results. In Fyfe et al., C., editor, Proceedings of IDEAL2010, volume LNCS6283, pages 334-343. Springer.
  4. Demartines, P. and Herault, J. (1997). Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets. IEEE Transactions on Neural Networks, 8(1).
  5. Georg Polzlbauer, M. D. and Rauber, A. (2006). Advanced visualization of self-organizing maps with vector fields. Neural Networks, 19:911-922.
  6. Joshua B. Tenenbaum, V. d. S. and Langford, J. C. (2000). A global framework for nonlinear dimensionality reduction. SCIENCE, 290:2319-2323.
  7. Kamimura, R. (2003). Information-theoretic competitive learning with inverse Euclidean distance output units. Neural Processing Letters, 18:163-184.
  8. Kamimura, R., Kamimura, T., and Shultz, T. R. (2001a). Information theoretic competitive learning and linguistic rule acquisition. Transactions of the Japanese Society for Artificial Intelligence, 16(2):287-298.
  9. Kamimura, R., Kamimura, T., and Uchida, O. (2001b). Flexible feature discovery and structural information control. Connection Science, 13(4):323-347.
  10. Kaski, S., Nikkila, J., Oja, M., Venna, J., Toronen, P., and Castren, E. (2003). Trustworthiness and metrics in visualizing similarity of gene expression. BMC Bioinformatics, 4(48).
  11. Kiviluoto, K. (1996). Topology preservation in selforganizing maps. In In Proceedings of the IEEE International Conference on Neural Networks, pages 294- 299.
  12. Kohonen, T. (1988). Self-Organization and Associative Memory. Springer-Verlag, New York.
  13. Kohonen, T. (1995). Self-Organizing Maps. SpringerVerlag.
  14. Lee, J. A. and Verleysen, M. (2008). Quality assessment of nonlinear dimensionality reduction based on K-ary neighborhoods. In JMLR: Workshop and conference proceedings, volume 4, pages 21-35.
  15. Polzlbauer, G. (2004). Survey and comparison of quality measures for self-organizing maps. In Proceedings of the fifth workshop on Data Analysis (WDA04), pages 67-82.
  16. Rose, K., Gurewitz, E., and Fox, G. C. (1990). Statistical mechanics and phase transition in clustering. Physical review letters, 65(8):945-948.
  17. Roweis, S. T. and Saul, L. K. (2000). Nonlinear dimensionality reduction by locally linear embedding. SCIENCE, 290:2323-2326.
  18. Sammon, J. W. (1969). A nonlinear mapping for data structure analysis. IEEE Transactions on Computers, C18(5):401-409.
  19. Tasdemir, K. and Merenyi, E. (2009). Exploiting data topology in visualization and clustering of self-organizing maps. IEEE Transactions on Neural Networks, 20(4):549-562.
  20. Ultsch, A. (2003a). Maps for the visualization of highdimensional data spaces. In Proceedings of the 4th Workshop on Self-organizing maps, pages 225-230.
  21. Ultsch, A. (2003b). U*-matrix: a tool to visualize clusters in high dimensional data. Technical Report 36, Department of Computer Science, University of Marburg.
  22. Venna, J. (2007). Dimensionality reduction for visual exploration of similarity structures. Dissertation, Helsinki University of Technology.
  23. Venna, J. and Kaski, S. (2001). Neighborhood preservation in nonlinear projection methods: an experimental study. In Lecture Notes in Computer Science, volume 2130, pages 485-491.
  24. Vesanto, J. (1999). SOM-based data visualization methods. Intelligent-Data-Analysis, 3:111-26.
  25. Vesanto, J., Himberg, J., Alhoniemi, E., and Parhankangas, J. (2000). SOM toolbox for Matlab. Technical report, Laboratory of Computer and Information Science, Helsinki University of Technology.
  26. Villmann, T., Herrmann, R. D. M., and Martinez, T. (1997). Topology preservation in self-organizing feature maps: exact definition and measurment. IEEE Transactions on Neural Networks, 8(2):256-266.
Download


Paper Citation


in Harvard Style

Kamimura R. (2011). INDIVIDUALLY AND COLLECTIVELY TREATED NEURONS AND ITS APPLICATION TO SOM . In Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011) ISBN 978-989-8425-84-3, pages 24-30. DOI: 10.5220/0003677300240030


in Bibtex Style

@conference{ncta11,
author={Ryotaro Kamimura},
title={INDIVIDUALLY AND COLLECTIVELY TREATED NEURONS AND ITS APPLICATION TO SOM},
booktitle={Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)},
year={2011},
pages={24-30},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003677300240030},
isbn={978-989-8425-84-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Neural Computation Theory and Applications - Volume 1: NCTA, (IJCCI 2011)
TI - INDIVIDUALLY AND COLLECTIVELY TREATED NEURONS AND ITS APPLICATION TO SOM
SN - 978-989-8425-84-3
AU - Kamimura R.
PY - 2011
SP - 24
EP - 30
DO - 10.5220/0003677300240030