Authors: Pegdwendé Sawadogo 1 ; Tokio Kibata 2 and Jérôme Darmont 1

Affiliations: 1 Université de Lyon, Lyon 2, ERIC EA 3083, 5 avenue Pierre Mendès France, F69676, Bron and France ; 2 Université de Lyon, Ecole Centrale de Lyon, 36 avenue Guy de Collongue, F69134, Ecully and France

ISBN: 978-989-758-372-8

ISSN: 2184-4984

Keyword(s): Data Lakes, Textual Documents, Metadata Management, Data Ponds.

Related Ontology Subjects/Areas/Topics: Artificial Intelligence ; Coupling and Integrating Heterogeneous Data Sources ; Data Mining ; Data Warehouses and OLAP ; Databases and Information Systems Integration ; Enterprise Information Systems ; Non-Relational Databases ; Sensor Networks ; Signal Processing ; Soft Computing

Abstract: Data lakes have emerged as an alternative to data warehouses for the storage, exploration and analysis of big data. In a data lake, data are stored in a raw state and bear no explicit schema. Thence, an efficient metadata system is essential to avoid the data lake turning to a so-called data swamp. Existing works about managing data lake metadata mostly focus on structured and semi-structured data, with little research on unstructured data. Thus, we propose in this paper a methodological approach to build and manage a metadata system that is specific to textual documents in data lakes. First, we make an inventory of usual and meaningful metadata to extract. Then, we apply some specific techniques from the text mining and information retrieval domains to extract, store and reuse these metadata within the COREL research project, in order to validate our proposals.

PDF ImageFull Text


Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Sawadogo, Pegdwende N.; Kibata, T. and Darmont, J. (2019). Metadata Management for Textual Documents in Data Lakes.In Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-372-8, ISSN 2184-4984, pages 72-83. DOI: 10.5220/0007706300720083

author={Sawadogo, Pegdwende N. and Tokio Kibata. and Jérôme Darmont.},
title={Metadata Management for Textual Documents in Data Lakes},
booktitle={Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS,},


JO - Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Metadata Management for Textual Documents in Data Lakes
SN - 978-989-758-372-8
AU - Sawadogo, Pegdwende N.
AU - Kibata, T.
AU - Darmont, J.
PY - 2019
SP - 72
EP - 83
DO - 10.5220/0007706300720083

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.