iRep3D: Efficient Semantic 3D Scene Retrieval

Xiaoqi Cao, Matthias Klusch

2013

Abstract

In this paper, we present a new repository, called iRep3D, for efficient retrieval of semantically annotated 3D scenes in XML3D, X3D or COLLADA. The semantics of a 3D scene can be described by means of its annotations with concepts and services which are defined in appropriate OWL2 ontologies. The iRep3D repository indexes annotated scenes with respect to these annotations and geometric features in three different scene indices. For concept and service-based scene indexing iRep3D utilizes a new approximated logical subsumption-based measure while the geometric feature-based indexing adheres to the standard specifications of XML-based 3D scene graph models. Each query for 3D scenes is processed by iRep3D in these indices in parallel and answered with the top-k relevant scenes of the final aggregation of the resulting rank lists. Results of experimental performance evaluation over a preliminary test collection of more than 600 X3D and XML3D scenes shows that iRep3D can significantly outperform both semantic-driven multimedia retrieval systems FB3D and RIR, as well as the non-semantic-based 3D model repository ADL in terms of precision and with reasonable response time in average.

References

  1. Akguel, C., Sankur, B., Yemez, Y., and Schmitt, F. (2010). Similarity learning for 3d object retrieval using relevance feedback and risk minimization. International Journal of Computer Vision, 89(2):392-407.
  2. Alvez, C. and Vecchietti, A. (2011). Efficiency analysis in content based image retrieval using rdf annotations. Advances in Soft Computing, pages 285-296.
  3. Bustos, B., Keim, D., Saupe, D., and Schreck, T. (2007). Content-based 3d object retrieval. Computer Graphics and Applications, IEEE, 27(4):22-27.
  4. Camossi, E., Giannini, F., and Monti, M. (2007). Deriving functionality from 3d shapes: Ontology driven annotation and retrieval. Computer-Aided Design & Applications, 4(6):773-782.
  5. Di Noia, T., Di Sciascio, E., and Donini, F. (2009). A tableaux-based calculus for abduction in expressive description logics: Preliminary results. In Proc. of DL09 Workshop.
  6. Fagin, R. (2002). Combining fuzzy information: an overview. ACM SIGMOD Record, 31(2):109-118.
  7. Gao, B., Zhang, S., and Pan, X. (2011). Semantic-oriented 3d model classification and retrieval using gaussian processes. Journal of Computational Information Systems, 7(4):1029-1037.
  8. Gong, B., Liu, J., Wang, X., and Tang, X. (2011). 3d object retrieval with semantic attributes. In Proc. of the 19th ACM international conference on Multimedia, pages 757-758. ACM.
  9. Hois, J., Schill, K., and Bateman, J. (2007a). Integrating uncertain knowledge in a domain ontology for room concept classifications. Research and Development in Intelligent Systems XXIII, pages 245-258.
  10. Hois, J., Wünstel, M., Bateman, J., and Röfer, T. (2007b). Dialog-based 3d-image recognition using a domain ontology. Spatial Cognition V Reasoning, Action, Interaction, pages 107-126.
  11. Hou, S., Lou, K., and Ramani, K. Svm-based semantic clustering and retrieval of a 3d model database. Computer Aided Design and Application, 2(2).
  12. Kalogerakis, E., Moumoutzis, N., and Christodoulakis, S. (2006). Coupling ontologies with graphics content for knowledge driven visualization. In Proc. of the IEEE Virtual Reality Conference 2006.
  13. Kapahnke, P., Liedtke, P., Nesbigall, S., Warwas, S., and Klusch, M. (2010). Isreal: an open platform for semantic-based 3d simulations in the 3d internet. The Semantic Web-ISWC 2010, pages 161-176.
  14. Klusch, M. (2012). The s3 contest: Performance evaluation of semantic service matchmakers. In Semantic Web Services Advancement through Evaluation. Springer.
  15. Klusch, M. and Kapahnke, P. (2012). The isem matchmaker: A flexible approach for adaptive hybrid semantic service selection. Web Semantics: Science, Services and Agents on the World Wide Web.
  16. Koutsoudis, A., Stavroglou, K., Pavlidis, G., and Chamzas, C. (2011). 3dsse-a 3d scene search engine: Exploring 3d scenes using keywords. Cultural Heritage.
  17. Laborie, S., Manzat, A., and Sedes, F. (2009). Managing and querying efficiently distributed semantic multimedia metadata collections. Multimedia, IEEE, (99):1-1.
  18. Leifman, G., Meir, R., and Tal, A. (2005). Semanticoriented 3d shape retrieval using relevance feedback. The Visual Computer, 21(8):865-875.
  19. Paquet, E., Rioux, M., Murching, A., Naveen, T., and Tabatabai, A. (2000). Description of shape information for 2-d and 3-d objects. Signal Processing: Image Communication, 16(1):103-122.
  20. Peraldi, S., Kaya, A., and Möller, R. (2009). Formalizing multimedia interpretation based on abduction over description logic aboxes. In Proc. of DL09 Workshop, Oxford, UK.
  21. Pittarello, F. and De Faveri, A. (2006). Semantic description of 3d environments: a proposal based on web standards. In Proc. of the 11th international conference on 3D web technology, pages 85-95. ACM.
  22. Qi, G., Aggarwal, C., Tian, Q., Ji, H., and Huang, T. (2011). Exploring context and content links in social media: A latent space method. Pattern Analysis and Machine Intelligence, IEEE Transactions on, (99):1-1.
  23. Tangelder, J. and Veltkamp, R. (2004). A survey of content based 3d shape retrieval methods. In Shape Modeling Applications, 2004, pages 145-156. IEEE.
  24. Yang, B. (2010). Dsi: A model for distributed multimedia semantic indexing and content integration. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), 6(1):3.
Download


Paper Citation


in Harvard Style

Cao X. and Klusch M. (2013). iRep3D: Efficient Semantic 3D Scene Retrieval . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-48-8, pages 19-28. DOI: 10.5220/0004295600190028


in Bibtex Style

@conference{visapp13,
author={Xiaoqi Cao and Matthias Klusch},
title={iRep3D: Efficient Semantic 3D Scene Retrieval},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={19-28},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004295600190028},
isbn={978-989-8565-48-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)
TI - iRep3D: Efficient Semantic 3D Scene Retrieval
SN - 978-989-8565-48-8
AU - Cao X.
AU - Klusch M.
PY - 2013
SP - 19
EP - 28
DO - 10.5220/0004295600190028