Towards Software Experts for Knowledge Discovery - A Process Model for Knowledge Consolidation

Lauri Tuovinen

2017

Abstract

The process of knowledge discovery in databases (KDD) is traditionally driven by human experts with in-depth knowledge of the technology used and the domain in which it is being applied. The role of technology in this process is to passively execute the computations specified by the experts, and the role of non-expert humans is limited to a few narrowly defined special cases. However, there are many scenarios where ordinary individuals would benefit from applying KDD to their own personal data, if only they had the means to do so. Meanwhile, KDD experts are looking for more advanced tools and methods capable of coping with the challenges posed by big data. Both these needs would be addressed by autonomous software experts capable of taking on some of the responsibilities of human KDD experts, but there are several obstacles that need to be cleared before the implementation of such experts is feasible. One of these is that while there is a widely accepted process model for knowledge discovery, there is not one for knowledge consolidation: the process of integrating a KDD result with established domain knowledge. This paper explores the requirements of the knowledge consolidation process and outlines a process model based on how the concept of knowledge is understood in KDD. Furthermore, it evaluates the state of the art and attempts to estimate how far away we are from achieving the necessary technology level to implement at least one major step of the process in software. Finally, the options available for making significant advances in the near future are discussed.

Paper Citation

in Harvard Style

Tuovinen L. (2017). Towards Software Experts for Knowledge Discovery - A Process Model for Knowledge Consolidation.In Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR, ISBN 978-989-758-271-4, pages 224-232. DOI: 10.5220/0006500502240232

in Bibtex Style

@conference{kdir17,
author={Lauri Tuovinen},
title={Towards Software Experts for Knowledge Discovery - A Process Model for Knowledge Consolidation},
booktitle={Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR,},
year={2017},
pages={224-232},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006500502240232},
isbn={978-989-758-271-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR,
TI - Towards Software Experts for Knowledge Discovery - A Process Model for Knowledge Consolidation
SN - 978-989-758-271-4
AU - Tuovinen L.
PY - 2017
SP - 224
EP - 232
DO - 10.5220/0006500502240232