Balancing Performance and Effort in Deep Learning via the Fusion of Real and Synthetic Cultural Heritage Photogrammetry Training Sets

Eugene Ch’ng, Eugene Ch’ng, Pinyuan Feng, Hongtao Yao, Zihao Zeng, Danzhao Cheng, Shengdan Cai

2021

Abstract

Cultural heritage presents both challenges and opportunities for the adoption and use of deep learning in 3D digitisation and digitalisation endeavours. While unique features in terms of the identity of artefacts are important factors that can contribute to training performance in deep learning algorithms, challenges remain with regards to the laborious efforts in our ability to obtain adequate datasets that would both provide for the diversity of imageries, and across the range of multi-facet images for each object in use. One solution, and perhaps an important step towards the broader applicability of deep learning in the field of digital heritage is the fusion of both real and virtual datasets via the automated creation of diverse datasets that covers multiple views of individual objects over a range of diversified objects in the training pipeline, all facilitated by close-range photogrammetry generated 3D objects. The question is the ratio of the combination of real and synthetic imageries in which an inflection point occurs whereby performance is reduced. In this research, we attempt to reduce the need for manual labour by leveraging the flexibility provided for in automated data generation via close-range photogrammetry models with a view for future deep learning facilitated cultural heritage activities, such as digital identification, sorting, asset management and categorisation.

Paper Citation

in Harvard Style

Ch’ng E., Feng P., Yao H., Zeng Z., Cheng D. and Cai S. (2021). Balancing Performance and Effort in Deep Learning via the Fusion of Real and Synthetic Cultural Heritage Photogrammetry Training Sets.In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ARTIDIGH, ISBN 978-989-758-484-8, pages 611-621. DOI: 10.5220/0010381206110621

in Bibtex Style

@conference{artidigh21,
author={Eugene Ch’ng and Pinyuan Feng and Hongtao Yao and Zihao Zeng and Danzhao Cheng and Shengdan Cai},
title={Balancing Performance and Effort in Deep Learning via the Fusion of Real and Synthetic Cultural Heritage Photogrammetry Training Sets},
booktitle={Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ARTIDIGH,},
year={2021},
pages={611-621},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010381206110621},
isbn={978-989-758-484-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ARTIDIGH,
TI - Balancing Performance and Effort in Deep Learning via the Fusion of Real and Synthetic Cultural Heritage Photogrammetry Training Sets
SN - 978-989-758-484-8
AU - Ch’ng E.
AU - Feng P.
AU - Yao H.
AU - Zeng Z.
AU - Cheng D.
AU - Cai S.
PY - 2021
SP - 611
EP - 621
DO - 10.5220/0010381206110621