Visual Servoing-based Registration of Multimodal Images

M. Ourak, B. Tamadazte, N. Andreff, E. Marchand

2015

Abstract

This paper deals with mutual information-based numerical and physical registration of white light images vs. fluorescence images for microrobotic laser microphonosurgery of the vocal folds. More precisely, it presents two techniques: a numerical registration of multimodal images and a vision feedback control for positioning an endoscope with regards to a preoperative image (fluorescence image). Nelder-Mead Simplex for nonlinear optimization is used to minimize the cost-function. The proposed methods are successfully validated in an experimental set-up using preoperative fluorescence images and real-time white light images of the vocal folds.

References

  1. Arens, C., Dreyer, T., and Glanz, H. Malzahn, K. (2004). Indirect autofluorescence laryngoscopy in the diagnosis of laryngeal cancer and its precursor lesions. European Archives of Oto-Rhino-Laryngology and Head & Neck, 261(2):71-76.
  2. Collewet, C. and Marchand, E. (2011). Photometric visual servoing. IEEE Trans. on Robotics, 27(4):828-834.
  3. Dame, A. and Marchand, E. (2009). Entropy-based visual servoing. In IEEE Int. Conf. on Robotics and Automation, pages 707-713, Kobe, Japan.
  4. Dame, A. and Marchand, E. (2011). Mutual informationbased visual servoing. IEEE Trans. on Robotics, 27(5):958-969.
  5. Degani, A., Choset, H., Wolf, A., and Zenati, M. A. (2006). Highly articulated robotic probe for minimally invasive surgery. In Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on, pages 4167-4172. IEEE.
  6. Dowson, N. and Bowden, R. (2006). A unifying framework for mutual information methods for use in non-linear optimisation. In Computer Vision ECCV, volume 3951 of Lecture Notes in Computer Science, pages 365-378. Springer Berlin Heidelberg.
  7. Eckel, H., Berendes, S., Damm, M., and Klusmann, J. (2003). Suspension laryngoscopy for endotracheal stenting. Laryngoscope, 113:11-15.
  8. Jackel, M., Martin, A., and Steine, W. (2013). Twenty-five years experience with laser surgery for head and neck tumors. volume 264 of European Archives of OtoRhino-Laryngology, pages 577-585.
  9. Kelley, C. (1999). Iterative Methods for Optimization. Frontiers in Applied Mathematics 18.
  10. Marchand, E. and Collewet, C. (2010). Using image gradient as a visual feature for visual servoing. In IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS'10, pages 5687-5692, Taipei, Taiwan.
  11. Miura, K., Hashimoto, K., Gangloff, J., and de Mathelin, M. (2005). Visual servoing without jacobian using modified simplex optimization. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on, pages 3504-3509. IEEE.
  12. Nelder, A. and Mead, R. (1965). A simplex method for function minimization. ComputerJournal, 7:308-313.
  13. Pham, N. and Wilamowskial, B. (2011). Improved nelder mead's simplex method and applications. Journal of computing, 3(3):55-63.
  14. Sevick-Muraca, E. (2004). Fluorescence-enhanced optical imaging and tomography for cancer diagnostics. In Biomedical Imaging: Nano to Macro, 2004. IEEE International Symposium on, volume 2, pages 1482- 1485.
  15. Tamadazte, B. and Andreff, N. (2014). Weakly calibrated stereoscopic visual servoing for laser steering: Application to phonomicrosurgery. In IROS, pages 743- 748.
  16. Zitová, B. and Flusser, J. (2003). Image registration methods: a survey. Image and Vision Computing, 21(11):977-1000.
Download


Paper Citation


in Harvard Style

Ourak M., Tamadazte B., Andreff N. and Marchand E. (2015). Visual Servoing-based Registration of Multimodal Images . In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-123-6, pages 44-51. DOI: 10.5220/0005528900440051


in Bibtex Style

@conference{icinco15,
author={M. Ourak and B. Tamadazte and N. Andreff and E. Marchand},
title={Visual Servoing-based Registration of Multimodal Images},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2015},
pages={44-51},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005528900440051},
isbn={978-989-758-123-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Visual Servoing-based Registration of Multimodal Images
SN - 978-989-758-123-6
AU - Ourak M.
AU - Tamadazte B.
AU - Andreff N.
AU - Marchand E.
PY - 2015
SP - 44
EP - 51
DO - 10.5220/0005528900440051