Authors:
Yaakov Hacohen-Kerner
1
;
Nadav Schweitzer
2
and
Yaakov Shoham
1
Affiliations:
1
Jerusalem College of Technology, Israel
;
2
Bar-Ilan University, Israel
Keyword(s):
Hebrew-Aramaic Texts, Information Retrieval, Quotation Identification.
Related
Ontology
Subjects/Areas/Topics:
Artificial Intelligence
;
Clustering and Classification Methods
;
Information Extraction
;
Knowledge Discovery and Information Retrieval
;
Knowledge-Based Systems
;
Symbolic Systems
Abstract:
Quotations in a text document contain important information about the content, the context, the sources that the author uses, their importance and impact. Therefore, automatic identification of quotations from documents is an important task. Quotations included in rabbinic literature are difficult to identify and to extract for various reasons. The aim of this research is to automatically identify Biblical quotations included in rabbinic documents written in Hebrew-Aramaic. We deal with various kinds of quotations: partial, missing and incorrect. We formulate nineteen features to identify these quotations. These features were divided into seven different feature sets: matches, best matches, sums of weights, weighted averages, weighted medians, common words, and quotation indicators. Several features are novel. Experiments on various combinations of these features were performed using four common machine learning methods. A combination of 17 features using J48 (an improved version of
C4.5) achieves an accuracy of 91.2%, which is an improvement of about 8% compared to a baseline result.
(More)