An Ontology-based Web Crawling Approach for the Retrieval of Materials in the Educational Domain

Mohammed Ibrahim, Yanyan Yang

2019

Abstract

As the web continues to be a huge source of information for various domains, the information available is rapidly increasing. Most of this information is stored in unstructured databases and therefore searching for relevant information becomes a complex task and the search for pertinent information within a specific domain is time-consuming and, in all probability, results in irrelevant information being retrieved. Crawling and downloading pages that are related to the user’s enquiries alone is a tedious activity. In particular, crawlers focus on converting unstructured data and sorting this into a structured database. In this paper, among others kind of crawling, we focus on those techniques that extract the content of a web page based on the relations of ontology concepts. Ontology is a promising technique by which to access and crawl only related data within specific web pages or a domain. The methodology proposed is a Web Crawler approach based on Ontology (WCO) which defines several relevance computation strategies with increased efficiency thereby reducing the number of extracted items in addition to the crawling time. It seeks to select and search out web pages in the education domain that matches the user’s requirements. In WCO, data is structured based on the hierarchical relationship, the concepts which are adapted in the ontology domain. The approach is flexible for application to crawler items for different domains by adapting user requirements in defining several relevance computation strategies with promising results.

Paper Citation

in Harvard Style

Ibrahim M. and Yang Y. (2019). An Ontology-based Web Crawling Approach for the Retrieval of Materials in the Educational Domain.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-350-6, pages 900-906. DOI: 10.5220/0007692009000906

in Bibtex Style

@conference{icaart19,
author={Mohammed Ibrahim and Yanyan Yang},
title={An Ontology-based Web Crawling Approach for the Retrieval of Materials in the Educational Domain},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2019},
pages={900-906},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007692009000906},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - An Ontology-based Web Crawling Approach for the Retrieval of Materials in the Educational Domain
SN - 978-989-758-350-6
AU - Ibrahim M.
AU - Yang Y.
PY - 2019
SP - 900
EP - 906
DO - 10.5220/0007692009000906