Detecting and Tracking Surgical Tools for Recognizing Phases of the Awake Brain Tumor Removal Surgery

Hiroki Fujie, Keiju Hirata, Takahiro Horigome, Hiroshi Nagahashi, Jun Ohya, Manabu Tamura, Ken Masamune, Yoshihiro Muragaki

2019

Abstract

In order to realize automatic recognition of surgical processes in surgical brain tumor removal using microscopic camera, we propose a method of detecting and tracking surgical tools by video analysis. The proposed method consists of a detection part and tracking part. In the detection part, object detection is performed for each frame of surgery video, and the category and bounding box are acquired frame by frame. The convolution layer strengthens the robustness using data augmentation (central cropping and random erasing). The tracking part uses SORT, which predicts and updates the acquired bounding box corrected by using Kalman Filter; next, the object ID is assigned to each corrected bounding box using the Hungarian algorithm. The accuracy of our proposed method is very high as follows. As a result of experiments on spatial detection. the mean average precision is 90.58%. the mean accuracy of frame label detection is 96.58%. These results are very promising for surgical phase recognition.

Paper Citation

in Harvard Style

Fujie H., Hirata K., Horigome T., Nagahashi H., Ohya J., Tamura M., Masamune K. and Muragaki Y. (2019). Detecting and Tracking Surgical Tools for Recognizing Phases of the Awake Brain Tumor Removal Surgery.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 190-199. DOI: 10.5220/0007385701900199

in Bibtex Style

@conference{icpram19,
author={Hiroki Fujie and Keiju Hirata and Takahiro Horigome and Hiroshi Nagahashi and Jun Ohya and Manabu Tamura and Ken Masamune and Yoshihiro Muragaki},
title={Detecting and Tracking Surgical Tools for Recognizing Phases of the Awake Brain Tumor Removal Surgery},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={190-199},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007385701900199},
isbn={978-989-758-351-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Detecting and Tracking Surgical Tools for Recognizing Phases of the Awake Brain Tumor Removal Surgery
SN - 978-989-758-351-3
AU - Fujie H.
AU - Hirata K.
AU - Horigome T.
AU - Nagahashi H.
AU - Ohya J.
AU - Tamura M.
AU - Masamune K.
AU - Muragaki Y.
PY - 2019
SP - 190
EP - 199
DO - 10.5220/0007385701900199