Information Efficient Automatic Object Detection and Segmentation using Cosegmentation, Similarity based Clustering, and Graph Label Transfer

Johannes Steffen, Marko Rak, Tim König, Klaus-Dietz Tönnies

2016

Abstract

We tackle the problem of unsupervised object cosegmentation combining automatic image selection, cosegmentation, and knowledge transfer to yet unlabelled images. Furthermore, we overcome the limitations often present in state-of-the-art methods in object cosegmentation, namely, high complexity and poor scalability w.r.t. image set size. Our proposed approach is robust, reasonably fast, and scales linearly w.r.t. the image set size. We tested our approach on two commonly used cosegmentation data sets and outperformed some of the state-of-the-art methods using significantly less information than possible. Additionally, results indicate the applicability of our approach on larger image sets.

References

  1. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and S üsstrunk, S. (2012). Slic superpixels compared to state-of-the-art superpixel methods. IEEE transactions on pattern analysis and machine intelligence, 34(11):2274-2282.
  2. Arbelaez, P. (2006). Boundary extraction in natural images using ultrametric contour maps. In 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06), page 182.
  3. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. (2009). Patchmatch: A randomized correspondence algorithm for structural image editing. In Funkhouser, T. and Hoppe, H., editors, ACM SIGGRAPH 2009 papers, page 1.
  4. Barnes, C., Shechtman, E., Goldman, D. B., and Finkelstein, A. (2010). The generalized patchmatch correspondence algorithm. In Daniilidis, K., Maragos, P., and Paragios, N., editors, Computer Vision - ECCV 2010, volume 6313 of Lecture Notes in Computer Science, pages 29-43. Springer Berlin Heidelberg, Berlin, Heidelberg.
  5. Batra, D., Kowdle, A., Parikh, D., Luo, J., and Chen, T. (2010). icoseg: Interactive co-segmentation with intelligent scribble guidance. In 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3169-3176.
  6. Boykov, Y. Y. and Jolly, M.-P. (2001). Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. In Eighth IEEE International Conference on Computer Vision, pages 105-112.
  7. Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., and Hu, S.-M. (2011). Global contrast based salient region detection. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 409-416.
  8. Faktor, A. and Irani, M. (2012). “clustering by composition” - unsupervised discovery of image categories. In Daniilidis, K., Maragos, P., and Paragios, N., editors, Computer Vision - ECCV 2012 , volume 7578 of Lecture Notes in Computer Science, pages 474-487. Springer Berlin Heidelberg, Berlin, Heidelberg.
  9. Faktor, A. and Irani, M. (2013). Co-segmentation by composition. In 2013 IEEE International Conference on Computer Vision (ICCV), pages 1297-1304.
  10. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and Ramanan, D. (2010). Object detection with discriminatively trained part-based models. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(9):1627-1645.
  11. Gould, S. (2012). Darwin: A framework for machine learning and computer vision research and development. Journal of Machine Learning Research, 13(1):3533- 3537.
  12. Gould, S. and Zhang, Y. (2012). Patchmatchgraph: Building a graph of dense patch correspondences for label transfer. In Daniilidis, K., Maragos, P., and Paragios, N., editors, Computer Vision - ECCV 2012 , volume 7576 of Lecture Notes in Computer Science, pages 439-452. Springer Berlin Heidelberg, Berlin, Heidelberg.
  13. Gould, S., Zhao, J., He, X., and Zhang, Y. (2014). Superpixel graph label transfer with learned distance metric. In Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T., editors, Computer Vision - ECCV 2014 , volume 8689 of Lecture Notes in Computer Science, pages 632- 647. Springer International Publishing, Cham.
  14. Hochbaum, D. S. and Singh, V. (2009). An efficient algorithm for co-segmentation. In 2009 IEEE 12th International Conference on Computer Vision (ICCV), pages 269-276.
  15. Joulin, A., Bach, F., and Ponce, J. (2010). Discriminative clustering for image co-segmentation. In 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1943-1950.
  16. Joulin, A., Bach, F., and Ponce, J. (2012). Multi-class cosegmentation. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 542-549.
  17. Mukherjee, L., Singh, V., and Dyer, C. R. (2009). Halfintegrality based algorithms for cosegmentation of images. In 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), pages 2028-2035.
  18. Ojala, T., Pietikäinen, M., and Harwood, D. (1996). A comparative study of texture measures with classification based on featured distributions. Pattern Recognition, 29(1):51-59.
  19. Ojala, T., Pietikainen, M., and Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7):971-987.
  20. Oliva, A. and Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42(3):145-175.
  21. Rother, C., Kolmogorov, V., and Blake, A. (2004). Grabcut -interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics (SIGGRAPH).
  22. Rother, C., Minka, T., Blake, A., and Kolmogorov, V. (2006). Cosegmentation of image pairs by histogram matching - incorporating a global constraint into mrfs. In Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, volume 1, pages 993-1000.
  23. Rubinstein, M., Joulin, A., Kopf, J., and Liu, C. (2013). Unsupervised joint object discovery and segmentation in internet images. In 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1939-1946.
  24. Shechtman, E. and Irani, M. (2007). Matching local selfsimilarities across images and videos. In 2007 IEEE Conference on Computer Vision and Pattern Recognition, pages 1-8.
  25. Vicente, S., Kolmogorov, V., and Rother, C. (2010). Cosegmentation revisited: Models and optimization. In Daniilidis, K., Maragos, P., and Paragios, N., editors, Computer Vision - ECCV 2010 , volume 6312 of Lecture Notes in Computer Science, pages 465-479. Springer Berlin Heidelberg, Berlin, Heidelberg.
  26. Vicente, S., Rother, C., and Kolmogorov, V. (2011). Object cosegmentation. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2217-2224.
  27. Zhang, H., Fang, T., Chen, X., Zhao, Q., and Quan, L. (2011). Partial similarity based nonparametric scene parsing in certain environment. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2241-2248.
Download


Paper Citation


in Harvard Style

Steffen J., Rak M., König T. and Tönnies K. (2016). Information Efficient Automatic Object Detection and Segmentation using Cosegmentation, Similarity based Clustering, and Graph Label Transfer . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 397-406. DOI: 10.5220/0005625103970406


in Bibtex Style

@conference{icpram16,
author={Johannes Steffen and Marko Rak and Tim König and Klaus-Dietz Tönnies},
title={Information Efficient Automatic Object Detection and Segmentation using Cosegmentation, Similarity based Clustering, and Graph Label Transfer},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={397-406},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005625103970406},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Information Efficient Automatic Object Detection and Segmentation using Cosegmentation, Similarity based Clustering, and Graph Label Transfer
SN - 978-989-758-173-1
AU - Steffen J.
AU - Rak M.
AU - König T.
AU - Tönnies K.
PY - 2016
SP - 397
EP - 406
DO - 10.5220/0005625103970406