Stabilization of Endoscopic Videos using Camera Path from Global Motion Vectors

Navya Amin, Thomas Gross, Marvin C. Offiah, Susanne Rosenthal, Nail El-Sourani, Markus Borschbach

2014

Abstract

Many algorithms for video stabilization have been proposed so far. However, not many digital video stabilization procedures for endoscopic videos are discussed. Endoscopic videos contain immense shakes and distortions as a result of some internal factors like body movements or secretion of body fluids as well as external factors like manual handling of endoscopic devices, introduction of surgical devices into the body, luminance changes etc.. The feature detection and tracking approaches that successfully stabilize the non-endoscopic videos might not give similar results for the endoscopic videos due to the presence of these distortions. Our focus of research includes developing a stabilization algorithm for such videos. This paper focusses on a special motion estimation method which uses global motion vectors for tracking applied to different endoscopic types (while taking into account the endoscopic region of interest). It presents a robust video processing and stabilization technique that we have developed and the results of comparing it with the state-of-the-art video stabilization tools. Also it discusses the problems specific to the endoscopic videos and the processing techniques which were necessary for such videos unlike the real-world videos.

References

  1. Bergen, J. R., Anandan, P., Hanna, K. J., and Hingorani, R. (1992). Hierarchical model-based motion estimation. In ECCV 7892 Proc. of the Second European Conference on Computer Vision, pages 237-252. SpringerVerlag London, UK.
  2. Breedveld, P. (2005). A new, easily miniaturized steerable endoscope. IEEE Engineering in Medicine and Biology Magazine, Volume 24:40-47.
  3. Cai, Z. (2001). Weighted nadaraya-watson regression estimation. In Statistics and Probability Letters, volume Volume 51, pages 307-318.
  4. Canon (1995). Optical image Stabilizer. Canon U.S.A. Inc., http://www.usa.canon.com/cusa/consumer/standarddisplay/Lens Advantage IS, Accessed:November 5, 2013.
  5. Chatenever, D., Mattsson-Boze, D., and Amling, M. R. (August 1, 2000). Image orientation for endoscopic video displays. U.S. Patent 6097423 A.
  6. Daniels, R. (2009). Delmar's Guide to Laboratory and Diagnostic Tests. Delmar - Thomson Learning.
  7. Gershman, G. and Thomson, M. (2011). Practical Pediatric Gastrointestinal Endoscopy (1st Edition). Wiley, John & Sons, Incorporated.
  8. Gross, T., Amin, N., Offiah, M. C., Rosenthal, S., ElSourani, N., and Borschbach, M. (2014). Optimization of the endoscopic video stabilization algorithm by local motion exclusion. In 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, to appear.
  9. Grundmann, M., Kwatra, V., Castro, D., and Essa, I. (2012). Calibration-free rolling shutter removal. In International Conference on Computational Photography.
  10. Grundmann, M., Kwatra, V., and Essa, I. (2011). Autodirected video stabilization with robust l1 optimal camera paths. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  11. Koltai, P. J. and Nixon, R. (1972). Laparoscopy-new instruments for suturing and ligation. Fertility and Sterility, Volume 23:274-277.
  12. Koltai, P. J. and Nixon, R. (1989). The story of the laryngoscope. Ear, Nose, & Throat Journal 68, Volume 7:494-502.
  13. Liu, F., Gleicher, M., Jin, H., and Agarwala, A. (2009). Plane-based content-preservingwarps for video stabilization. In SIGGRAPH 2009. ACM New York, NY, USA.
  14. Liu, F., Gleicher, M., Wang, J., Jin, H., and Agarwala, A. (2011). Subspace video stabilization. ACM Transcations on Graphics, Volume 30:1-10.
  15. Luó, X., Feuerstein, M., Reichl, T., Kitasaka, T., and Mori, K. (2010). An application driven comparison of several feature extraction algorithms in bronchoscope tracking during navigated bronchoscopy. In Proc. of the 5th international conference on Medical imaging and augmented reality, pages 475-484.
  16. Matsushita, Y., Ofek, E., Tang, X., and Shum, H.-Y. (2005). Full-frame video stabilization. In In Proc. Computer Vision and Pattern Recognition, pages 50-57.
  17. Matsushita, Y., Ofek, E., Tang, X., and Shum, H.-Y. (2006). Full-frame video stabilization with motion inpainting. Volume 28:1150-1163.
  18. Offiah, M. C., Amin, N., Gross, T., El-Sourani, N., and Borschbach, M. (2012a). An approach towards a fullreference-based benchmarking for quality-optimized endoscopic video stabilization systems. In ICVGIP 2012, page 65.
  19. Offiah, M. C., Amin, N., Gross, T., El-Sourani, N., and Borschbach, M. (2012b). On the ability of state-ofOffiah, M. C., Amin, N., Gross, T., El-Sourani, N., and Borschbach, M. (2012c). Towards a benchmarking framework for quality-optimized endoscopic video stabilization. In ELMAR, Sep.,2012 Proceedings, pages 23-26.
  20. Sachs, L. (1984). Applied Statistics: A Handbook of Techniques. New York: Springer-Verlag.
  21. University of Tennessee College of Veterinary Medicine, R. (2012). http://www.vet.utk.edu/clinical/sacs/. internal/mips/rhinoscopy.php.
  22. Wang, H., Mirota, D., Ishii, M., and Hager, G. D. (2008). Robust motion estimation and structure recovery from endoscopic image sequences with an adaptive scale kernel consensus estimator. In CVPR.
  23. Zhou, Z., Jin, H., and Ma, Y. (2013). Content-preserving warps for 3d video stabilization. In IEEE Conference on Computer Vision and Pattern Recognition.
Download


Paper Citation


in Harvard Style

Amin N., Gross T., C. Offiah M., Rosenthal S., El-Sourani N. and Borschbach M. (2014). Stabilization of Endoscopic Videos using Camera Path from Global Motion Vectors . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 130-137. DOI: 10.5220/0004688801300137


in Bibtex Style

@conference{visapp14,
author={Navya Amin and Thomas Gross and Marvin C. Offiah and Susanne Rosenthal and Nail El-Sourani and Markus Borschbach},
title={Stabilization of Endoscopic Videos using Camera Path from Global Motion Vectors},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={130-137},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004688801300137},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Stabilization of Endoscopic Videos using Camera Path from Global Motion Vectors
SN - 978-989-758-003-1
AU - Amin N.
AU - Gross T.
AU - C. Offiah M.
AU - Rosenthal S.
AU - El-Sourani N.
AU - Borschbach M.
PY - 2014
SP - 130
EP - 137
DO - 10.5220/0004688801300137