loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Hadi Mohammadzadeh 1 ; Thomas Gottron 2 ; Franz Schweiggert 1 and Gholamreza Nakhaeizadeh 3

Affiliations: 1 University of Ulm, Germany ; 2 Universität Koblenz-Landau, Germany ; 3 University of Karlsruhe, Germany

ISBN: 978-989-8425-79-9

ISSN: 2184-3228

Keyword(s): Main content extraction, Information extraction, Web mining, HTML web pages.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Information Extraction ; Knowledge Discovery and Information Retrieval ; Knowledge-Based Systems ; Soft Computing ; Symbolic Systems ; Web Mining

Abstract: Extracting the main content of web documents, with high accuracy, is an important challenge for researchers working on the web. In this paper, we present a novel language-independent method for extracting the main content of web pages. Our method, called DANAg, in comparison with other main content extraction approaches has high performance in terms of effectiveness and efficiency. The extraction process of data DANAg is divided into four phases. In the first phase, we calculate the length of content and code of fixed segments in an HTML file. The second phase applies a naive smoothing method to highlight the segments forming the main content. After that, we use a simple algorithm to recognize the boundary of the main content in an HTML file. Finally, we feed the selected main content area to our parser in order to extract the main content of the targeted web page.

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.228.11.9

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mohammadzadeh, H.; Gottron, T.; Schweiggert, F. and Nakhaeizadeh, G. (2011). EXTRACTING THE MAIN CONTENT OF WEB DOCUMENTS BASED ON A NAIVE SMOOTHING METHOD.In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011) ISBN 978-989-8425-79-9, ISSN 2184-3228, pages 462-467. DOI: 10.5220/0003665304700475

@conference{kdir11,
author={Hadi Mohammadzadeh. and Thomas Gottron. and Franz Schweiggert. and Gholamreza Nakhaeizadeh.},
title={EXTRACTING THE MAIN CONTENT OF WEB DOCUMENTS BASED ON A NAIVE SMOOTHING METHOD},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011)},
year={2011},
pages={462-467},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003665304700475},
isbn={978-989-8425-79-9},
}

TY - CONF

JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2011)
TI - EXTRACTING THE MAIN CONTENT OF WEB DOCUMENTS BASED ON A NAIVE SMOOTHING METHOD
SN - 978-989-8425-79-9
AU - Mohammadzadeh, H.
AU - Gottron, T.
AU - Schweiggert, F.
AU - Nakhaeizadeh, G.
PY - 2011
SP - 462
EP - 467
DO - 10.5220/0003665304700475

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.