THE CHALLENGE OF AUTOMATICALLY ANNOTATING SOLUTION DOCUMENTS - Comparing Manual and Automatic Annotation of Solution Documents in the Field of Mechanical Engineering

Andreas Kohn, Udo Lindemann, Gerhard Peter

2010

Abstract

This paper contains part of the actual research in the use case PROCESSUS of the German research program THESEUS. A case study about comparing manual and automatic annotation of solution documents in the field of mechanical engineering is described. A set of six solution documents was annotated manually by four users. Then, the same set of documents was annotated automatically by an ontology-based system. The two annotations are compared considering proposed ranking numbers. These ranking numbers give the weighting of annotations according to the overall and merged manual annotations. Therewith, they serve as a reference for the expected result of the automatic annotation. Comparing the automated and the manual annotation can not only reveal limitations of the automatic annotation process but also raise interesting questions to what extent domain specific knowledge has to be represented in the ontology.

References

  1. Blumberg, R., and Atre, S. (2003). The Problem with Unstructured Data. In DM Review, 13(2).
  2. Corcho, O. (2006). Ontology based document annotation: trends and open research problems. Int. J. of Metadata, Semantics and Ontologies, 1(1), 47-57.
  3. Dylla, N. (1990). Denk- und Handlungsabläufe beim Konstruieren, PhD thesis, Technische Universität München.
  4. Gaag, A., Kohn, A., and Lindemann, U., (2009). Functionbased Solution Retrieval and Semantic Search in Mechanical Engineering. In ICED'09, 17th International Conference on Engineering Design, Stanford, California, USA.
  5. Hepp, M. (2003). Güterklassifikation als semantisches Standardisierungsproblem. Wiesbaden: Deutscher Universitäts-Verlag.
  6. Hepp, M. (2006). Products and Services Ontologies: A Methodology for Deriving OWL Ontologies from Industrial Categorization Standards. Int. J. on Semantic Web & Information Systems, 2 (1), 72-99.
  7. Ponn, J., and Lindemann, U. (2008). Konzeptentwicklung und Gestaltung technischer Produkte. Berlin: Springer.
  8. Pocsai, Z. (2000). Ontologiebasiertes Wissensmanagement für die Produktentwicklung. PhD thesis, Technische Universität Karlsruhe.
  9. Ponn, J., Deubzer, F., and Lindemann, U., (2006). Intelligent Search for Product Development Information - an Ontology-based Approach. In: DESIGN'06, 9th International Design Conference, Dubrovnik, Croatia.
  10. Salton, G. and McGill, M. J. (1986). Introduction to Modern Information Retrieval. New York: McGrawHill.
  11. Uren, V., Cimiano, P., Iria, J. e., Handschuh, S., VargasVera, M., Motta, E., and Ciravegna, F. (2006). Semantic annotation for knowledge management: Requirements and a survey of the state of the art. Journal of Web Semantics, 4(1), 14-28.
  12. Vallet, D., Fernández, M., and Castells, P., (2005). An Ontology-Based Information Retrieval Model. In ESWC'05, The Semantic Web: Research and Applications, Second European Semantic Web Conference. Heraklion, Crete, Greece.
Download


Paper Citation


in Harvard Style

Kohn A., Lindemann U. and Peter G. (2010). THE CHALLENGE OF AUTOMATICALLY ANNOTATING SOLUTION DOCUMENTS - Comparing Manual and Automatic Annotation of Solution Documents in the Field of Mechanical Engineering . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2010) ISBN 978-989-8425-29-4, pages 153-158. DOI: 10.5220/0003055201530158


in Bibtex Style

@conference{keod10,
author={Andreas Kohn and Udo Lindemann and Gerhard Peter},
title={THE CHALLENGE OF AUTOMATICALLY ANNOTATING SOLUTION DOCUMENTS - Comparing Manual and Automatic Annotation of Solution Documents in the Field of Mechanical Engineering },
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2010)},
year={2010},
pages={153-158},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003055201530158},
isbn={978-989-8425-29-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2010)
TI - THE CHALLENGE OF AUTOMATICALLY ANNOTATING SOLUTION DOCUMENTS - Comparing Manual and Automatic Annotation of Solution Documents in the Field of Mechanical Engineering
SN - 978-989-8425-29-4
AU - Kohn A.
AU - Lindemann U.
AU - Peter G.
PY - 2010
SP - 153
EP - 158
DO - 10.5220/0003055201530158