Natural Language Query Processing in Multimedia Ontologies

Filiz Alaca Aygul, Nihan Kesim Cicekli, Ilyas Cicekli

2012

Abstract

In this paper a natural language query interface is developed for semantic and spatio-temporal querying of MPEG-7 based domain ontologies. The underlying ontology is created by attaching domain ontologies to the core Rhizomik MPEG-7 ontology. The user can pose concept, complex concept, spatial, temporal, object trajectory and directional trajectory queries. Furthermore, the system handles the negative meaning in the user query. When the user enters a natural language query, it is parsed with the link parser. According to query type, the objects, attributes, spatial relation, temporal relation, trajectory relation, time filter and time information are extracted from the parser output by using predefined information extraction rules. After the information extraction, SPARQL queries are generated, and executed against the ontology by using an RDF API. The results are used to calculate spatial, temporal, and trajectory relations between objects. The results satisfying the required relations are displayed in a tabular format and the user can navigate through the multimedia content.

References

  1. Allen, J. F., (1983). Maintaining knowledge about temporal intervals. Communications of the ACM. 21(11): 832-843.
  2. Athanasis, N., V. Christophides, and D., Kotzinos, (2004). Generating on the fly queries for the semantic web: The ICS-FORTH graphical RQL interface (GRQL), The Semantic Web - ISWC 2004, Lecture Notes in Computer Science, Volume 3298/2004, pp. 486-501.
  3. Bhatia, N., Gaharwar, P., Patnaik, P., and Sanyal, S., (2006). GuNQ-A Semantic web engine with a keyword based query approach. In Proceedings of AAAI, Fall Symposium on Semantic Web for Collaborative Knowledge Acquisition, Arlington, VA, USA.
  4. Borsje J., and Embregts, H., (2006). Graphical query composition and natural language processing in an RDF visualization interface, Erasmus School of Economics and Business Economics, Vol. Bachelor. Erasmus University, Rotterdam, 2006.
  5. Broeskstra, J., and Kampman, A., (2003). SeRQL: A second generation RDF query language. In Proceedings of SWAD-Europe Workshop on Semantic Web Storage and Retrieval, pp. 13-14.
  6. Catarci, T., Dongilli, P., Di Mascio, T., Franconi, E., Santucci, G., and Tessaris, S., (2004) An ontology based visual tool for query formulation support. In Proceedings of 16th European Conference on Artificial Intelligence (ECAI), Valencia, Spain, pp. 308.
  7. Donderler, M. E., Saykol, E., Ulusoy, O., and Gudukbay, U., (2003). BilVideo: A video database management system. IEEE MultiMedia, 10(1), 66-70.
  8. Erozel, G., Cicekli, N. K., and Cicekli, I., (2008). Natural language querying for video databases. Information Sciences, 178(12):2534-2552.
  9. García, R. and Celma, O., (2005). Semantic Integration and Retrieval of Multimedia Metadata. In Proceedings of the Knowledge Markup and Semantic Annotation Workshop, Semannot'05.
  10. Jarrar, M., and Dikaiakos, M. D., (2008). MashQL: a query-by-diagram topping SPARQL. In Proceedings of ONISW, Napa Valley, California, USA.
  11. Kara, S., Sabuncu, O., Akpinar, S., Alan, O., Cicekli, N. K., and Alpaslan, F. N., (2010). An ontology-based retrieval system using semantic indexing. In Proceedings of the 1st Intl. Workshop on Data Engineering meets the Semantic Web, in conjunction with ICDE 2010, Long Beach CA, USA.
  12. Kaufmann, E., Bernstein, A., and Fischer, L., (2007). NLP-Reduce: A “naive” but domain independent natural language interface for querying ontologies. In Proceedings of the 4th European conference on The Semantic Web (ESWC).
  13. Koprulu, M., Cicekli, N. K., and Yazici, A., (2004). Spatio-temporal querying in video databases, Information Sciences, 160(1-4):131-152.
  14. Lei, Y., Uren, V. and Motta, E., (2006). Semsearch: A search engine for the semantic web. In Proceedings of the 5th International Conference on Knowledge Engineering and Managing Knowledge in a World of Networks, Lecture Notes in Computer Science, 4248:238.
  15. Prud'hommeaux, E., and Seaborne, A., (2008). SPARQL query language for RDF. W3C recommendation, http://www.w3.org/TR/rdf-sparql-query/.
  16. Ren, W., Singh, S., Singh, M., and Zhu, Y. S., (2009). State-of-the-art on spatio-temporal information-based video retrieval. Pattern Recognition, 42(2):267-282.
  17. Russell, A., Smart, P. R., Braines, D., and Shadbolt, N. R., (2008). NITELIGHT: A graphical tool for semantic query construction. In Proceedings of Semantic Web User Interaction Workshop (SWUI 2008), Florence, Italy, 2008.
  18. Sleator, D., and Temperly, D., (1993). Parsing English with a Link Grammar. In Proceedings of the Third International Workshop on Parsing Technologies.
  19. Tablan, V., Damljanovic, D., and Bontcheva, K., (2008). A natural language query interface to structured information. In Proceedings of the 5th European Semantic Web Conference (ESWC 2008).
  20. Tauberer, J., (2010). Semantic Web/RDF Library for C#/.NET. Retrieved February 18, 2011, from http://razor.occams.info/code/semweb/
  21. Troncy, R., Celma O., Little S., Garcia R., and Tsinaraki C., (2007). MPEG-7 based multimedia ontologies: Interoperability support or interoperability issue. In Proceedings of the 1st International Workshop on Multimedia Annotation and Retrieval (MAReSO).
  22. Wang, H., Zhang, K., Liu, Q., Tran, T., and Yu, Y., (2008). Q2semantic: A lightweight keyword interface to semantic search. In Proceedings of the 5th International Semantic Web Conference (ESWC'08), Lecture Notes in Computer Science, 5021:584.
  23. Zhou, Q., Wang, C., Xiong, M., Wang, H., and Yu, Y., (2007). Spark, Adapting keyword query to semantic search. In Proceedings of the 6th International and 2nd Asian Semantic Web Conference (ISWC2007 + ASWC2007), Lecture Notes in Computer Science, 4825:694.
Download


Paper Citation


in Harvard Style

Alaca Aygul F., Kesim Cicekli N. and Cicekli I. (2012). Natural Language Query Processing in Multimedia Ontologies . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012) ISBN 978-989-8565-30-3, pages 66-75. DOI: 10.5220/0004134900660075


in Bibtex Style

@conference{keod12,
author={Filiz Alaca Aygul and Nihan Kesim Cicekli and Ilyas Cicekli},
title={Natural Language Query Processing in Multimedia Ontologies},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012)},
year={2012},
pages={66-75},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004134900660075},
isbn={978-989-8565-30-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2012)
TI - Natural Language Query Processing in Multimedia Ontologies
SN - 978-989-8565-30-3
AU - Alaca Aygul F.
AU - Kesim Cicekli N.
AU - Cicekli I.
PY - 2012
SP - 66
EP - 75
DO - 10.5220/0004134900660075