Multi-labelled Image Segmentation in Irregular, Weighted Networks: A Spatial Autocorrelation Approach

Raphaël Ceré, François Bavaud

2017

Abstract

Image segmentation and spatial clustering both face the same primary problem, namely to gather together spatial entities which are both spatially close and similar regarding their features. The parallelism is particularly obvious in the case of irregular, weighted networks, where methods borrowed from spatial analysis and general data analysis (soft K-means) may serve at segmenting images, as illustrated on four examples. Our approach considers soft memberships (fuzzy clustering) and attempts to minimize a free energy functional made of three ingredients : a within-cluster features dispersion (hard K-means), a network partitioning objective (such as the Ncut or the modularity) and a regularizing entropic term, enabling an iterative computation of the locally optimal soft clusters. In particular, the second functional enjoys many possible formulations, arguably helpful in unifying various conceptualizations of space through the probabilistic selection of pairs of neighbours, as well as their relation to spatial autocorrelation (Moran's I).

References

  1. Anselin, L. (1995). Local indicators of spatial associationlisa. Geographical analysis, 27(2):93-115.
  2. Bar, L., Chan, T. F., Chung, G., Jung, M., Kiryati, N., Mohieddine, R., Sochen, N., and Vese, L. A. (2011). Mumford and shah model and its applications to image segmentation and image restoration. In Handbook of mathematical methods in imaging, pages 1095- 1157. Springer.
  3. Bavaud, F. (2009). Aggregation invariance in general clustering approaches. Advances in Data Analysis and Classification , 3(3):205-225.
  4. Bavaud, F. and Guex, G. (2012). Interpolating between random walks and shortest paths: a path functional approach. In International Conference on Social Informatics, pages 68-81. Springer.
  5. Besag, J. (1986). On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society. Series B (Methodological), pages 259-302.
  6. Bougleux, S., Elmoataz, A., and Melkemi, M. (2009). Local and nonlocal discrete regularization on weighted graphs for image and mesh processing. International journal of computer vision, 84(2):220-236.
  7. Chambolle, A., Cremers, D., and Pock, T. (2012). A convex approach to minimal partitions. SIAM Journal on Imaging Sciences, 5(4):1113-1158.
  8. Couprie, C., Grady, L., Najman, L., and Talbot, H. (2011). Power watershed: A unifying graph-based optimization framework. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(7):1384-1399.
  9. Doyle, P. G. and Snell, J. L. (1984). Random walks and electric networks. Mathematical Association of America,.
  10. Grady, L. (2006). Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(11):1768-1783.
  11. Grady, L. and Schwartz, E. L. (2006). Isoperimetric graph partitioning for image segmentation. IEEE transactions on pattern analysis and machine intelligence, 28(3):469-475.
  12. Greig, D. M., Porteous, B. T., and Seheult, A. H. (1989). Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society. Series B (Methodological), pages 271-279.
  13. Guex, G. (2016). Interpolating between random walks and optimal transportation routes: Flow with multiple sources and targets. Physica A: Statistical Mechanics and its Applications, 450:264-277.
  14. Newman, M. E. J. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences, 103(23):8577-8582.
  15. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12:2825-2830.
  16. Rousseeuw, P. J. (1987). Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Journal of computational and applied mathematics, 20:53-65.
  17. Schneider, M. H. and Zenios, S. A. (1990). A comparative study of algorithms for matrix balancing. Operations research, 38(3):439-455.
  18. Shi, J. and Malik, J. (2000). Normalized Cuts and Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):888-905.
  19. van Rossum, G. (1995). Python tutorial. Technical Report CS-R9526, Centrum voor Wiskunde en Informatica (CWI), Amsterdam.
Download


Paper Citation


in Harvard Style

Ceré R. and Bavaud F. (2017). Multi-labelled Image Segmentation in Irregular, Weighted Networks: A Spatial Autocorrelation Approach . In Proceedings of the 3rd International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM, ISBN 978-989-758-252-3, pages 62-69. DOI: 10.5220/0006322800620069


in Bibtex Style

@conference{gistam17,
author={Raphaël Ceré and François Bavaud},
title={Multi-labelled Image Segmentation in Irregular, Weighted Networks: A Spatial Autocorrelation Approach},
booktitle={Proceedings of the 3rd International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM,},
year={2017},
pages={62-69},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006322800620069},
isbn={978-989-758-252-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM,
TI - Multi-labelled Image Segmentation in Irregular, Weighted Networks: A Spatial Autocorrelation Approach
SN - 978-989-758-252-3
AU - Ceré R.
AU - Bavaud F.
PY - 2017
SP - 62
EP - 69
DO - 10.5220/0006322800620069