Novel View Synthesis for Unseen Surgery Recordings

Mana Masuda, Hideo Saito, Yoshifumi Takatsume, Hiroki Kajita

2023

Abstract

Recording surgery in operating rooms is a crucial task for both medical education and evaluation of medical treatment. In this paper, we propose a method for visualizing surgical areas that are occluded by the heads or hands of medical professionals in various surgical scenes. To recover the occluded surgical areas, we utilize a surgery recording system equipped with multiple cameras embedded in the surgical lamp, with the aim of ensuring that at least one camera can capture the surgical area without occlusion. We propose the application of a transformer-based Neural Radiance Field (NeRF) model, originally proposed for normal scenes, to surgery scenes, and demonstrate through experimentation that it is feasible to generate occluded surgical areas. We believe this research has the potential to make our multi-camera recording system practical and useful for physicians.

Paper Citation

in Harvard Style

Masuda M., Saito H., Takatsume Y. and Kajita H. (2023). Novel View Synthesis for Unseen Surgery Recordings. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 944-949. DOI: 10.5220/0011897200003417

in Bibtex Style

@conference{visapp23,
author={Mana Masuda and Hideo Saito and Yoshifumi Takatsume and Hiroki Kajita},
title={Novel View Synthesis for Unseen Surgery Recordings},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={944-949},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011897200003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - Novel View Synthesis for Unseen Surgery Recordings
SN - 978-989-758-634-7
AU - Masuda M.
AU - Saito H.
AU - Takatsume Y.
AU - Kajita H.
PY - 2023
SP - 944
EP - 949
DO - 10.5220/0011897200003417
PB - SciTePress