3D SHAPE RECONSTRUCTION ENDOSCOPE USING SHAPE FROM FOCUS

T. Takeshita, Y. Nakajima, M. K. Kim, S. Onogi, M. Mitsuishi, Y. Matsumoto

Abstract

In this paper, we propose three-dimensional (3-D) shape reconstruction endoscope using shape from focus/defocus (SFF/SFD). 3-D shape measurement that uses the endoscope image sequence can measure both the shape and the texture at the same time. It has some advantages such as the analysis of lesion location that integrates the analysis of shape and texture. And the shape and the texture from the endoscope can be recorded quantitatively. To obtain 3-D information, shape measurement methods using stereo cameras is often used. But in case of narrow space, 3-D reconstruction using focus information such as SFF/SFD is more appropriate in terms of apparatus size. Therefore, we apply SFF method to endoscope for shape reconstruction, and conducted two basic experiments to confirm the possibility of the system using general camera as a first step. First, to estimate the accuracy of shape measurement of the system, shape measurement of the objects that the shape is already-known was conducted. And the error of the system was calculated about 1 to 5 mm. Next, to confirm the possibility to measure biological inner wall, the measurement of inner wall of the pig stomach was conducted, and the shape was reconstructed.

References

  1. Vining DJ and Gelfand DW, Noninvasive colonoscopy using helical CT scanning, 3D reconstruction, and virtual reality, Presented at the 23rd Annual Meeting and Postgraduate Course of the Society of Gastrointestinal Radiologists, Maui, Hawaii, 1994.
  2. D. K. Iakovidis, D. E. Maroulis, S. A. Karkanis and A. Brokos, A Comparative Study of Texture Features for the Discrimination of Gastric Polyps in Endoscopic Video, In 18th IEEE symposium on Computer-Based Medical Systems (CBMS'05) IEEE Computer Society Los Alamitos:575-580, 2005.
  3. D. Stoyanov, A. Darzi and G. Z. Yang, A practical approach towards accurate dense 3D depth recovery for robotic laparoscopic surgery, Computer Aided Surgery, 10(4):199-208,2005.
  4. M. Hayashibe, N. Suzuki and Y. Nakamura, Laser-scan endoscope system for intraoperative geometry acquisition and surgical robot safety management, Medical Image Analysis 10: 509-519, 2006.
  5. T. Okatani and K. Deguchi, Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center, Computer Vision and Image Understanding, 66(2):119-131, 1997.
  6. P. Sánchez-González, F. Gayá et al, Segmentation and 3D Reconstruction Approaches for the Design of Laparoscopic Augmented Reality Environments, ISBMS 2008:127-134, 2008
  7. K. Deguchi, T. Sasano, H. Arai and H. Yoshikawa, 3-D Shape Reconstruction from Endoscope Image Sequences by The Factorization Method, IEICE Transactions on Information and Systems, E79- D(9):1329-1336, 1996.
  8. T. Nagakura, K. Okazaki et al, The Study for Automatic 3D Reconstruction of Endoscopic Video Image, Proceedings of the Second International Conference on Innovative Computing, Informatio and Control:308, 2007
  9. B. K. P. Horn, Focusing, MIT Artificial Intelligence Laboratory MEMO NO.160, 1968
  10. E. P. Krotkov, Focusing, International Journal of Computer Vision, 1:223-237, 1987.
  11. S. K. Nayar and Y. Nakagawa, Shape from focus: An effective approach for rough surface, IEEE Transaction, on Pattern Analysis and Machine Intelligence, 16(8):824-831, 1994.
  12. M. Subbarao and G. Gurya, Depth from defocus: A spatial domain approach, Int. J. Computer Vision, 13:271- 294, 1994.
  13. A. Pentland, A new sense for depth of field, IEEE Transactions on Pattern Analysis and Machine Intelligence, 9(4):523-531, 1987
Download


Paper Citation


in Harvard Style

Takeshita T., Nakajima Y., Kim M., Onogi S., Mitsuishi M. and Matsumoto Y. (2009). 3D SHAPE RECONSTRUCTION ENDOSCOPE USING SHAPE FROM FOCUS . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 411-416. DOI: 10.5220/0001804004110416


in Bibtex Style

@conference{visapp09,
author={T. Takeshita and Y. Nakajima and M. K. Kim and S. Onogi and M. Mitsuishi and Y. Matsumoto},
title={3D SHAPE RECONSTRUCTION ENDOSCOPE USING SHAPE FROM FOCUS},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={411-416},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001804004110416},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - 3D SHAPE RECONSTRUCTION ENDOSCOPE USING SHAPE FROM FOCUS
SN - 978-989-8111-69-2
AU - Takeshita T.
AU - Nakajima Y.
AU - Kim M.
AU - Onogi S.
AU - Mitsuishi M.
AU - Matsumoto Y.
PY - 2009
SP - 411
EP - 416
DO - 10.5220/0001804004110416