BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA

Arturo Gil, David Valiente, Oscar Reinoso, Lorenzo Fernández, J. M. Marín

2011

Abstract

This paper describes an approach to the Simultaneous Localization and Mapping (SLAM) problem using a single omnidirectional camera. We consider that the robot is equipped with a catadioptric sensor and is able to extract interest points from the images. In the approach, the map is represented by a set of omnidirectional images and their positions. Each omnidirectional image has a set of interest points and visual descriptors associated to it. When the robot captures an omnidirectional image it extracts interest points and finds correspondences with the omnidirectional images stored in the map. If a sufficient number of points are matched, a translation and rotation can be computed between the images, thus allowing the localization of the robot with respect to the images in the map. Typically, visual SLAMapproaches concentrate on the estimation of a set of visual landmarks, each one defined by a 3D position and a visual descriptor. In contrast with these approaches, the solution presented here simplifies the computation of the map and allows for a compact representation of the environment. We present results obtained in a simulated environment that validate the SLAM approach. In addition, we present results obtained using real data that demonstrate the validity of the proposed solution.

References

  1. Andrew J. Davison, A. J., Gonzalez Cid, Y., and Kita, N. (2004). Improving data association in vision-based SLAM. In Proc. of IFAC/EURON, Lisboa, Portugal.
  2. Andrew J. Davison, A. J., Gonzalez Cid, Y., and Kita, N. (2004). Improving data association in vision-based SLAM. In Proc. of IFAC/EURON, Lisboa, Portugal.
  3. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). SURF: Speeded up robust features. In Proc. of the ECCV, Graz, Austria.
  4. Bay, H., Tuytelaars, T., and Van Gool, L. (2006). SURF: Speeded up robust features. In Proc. of the ECCV, Graz, Austria.
  5. Civera, J., Davison, A. J., and Martínez Montiel, J. M. (2008). Inverse depth parametrization for monocular slam. IEEE Trans. on Robotics.
  6. Civera, J., Davison, A. J., and Martínez Montiel, J. M. (2008). Inverse depth parametrization for monocular slam. IEEE Trans. on Robotics.
  7. Davison, A. J. and Murray, D. W. (2002). Simultaneous localisation and map-building using active vision. IEEE Trans. on PAMI.
  8. Davison, A. J. and Murray, D. W. (2002). Simultaneous localisation and map-building using active vision. IEEE Trans. on PAMI.
  9. Fernandez, L., Gil, A., Paya, L., and Reinoso, O. (2010). An evaluation of weighting methods for appearancebased monte carlo localization using omnidirectional images. In Proc. of the ICRA, Anchorage, Alaska.
  10. Fernandez, L., Gil, A., Paya, L., and Reinoso, O. (2010). An evaluation of weighting methods for appearancebased monte carlo localization using omnidirectional images. In Proc. of the ICRA, Anchorage, Alaska.
  11. Gil, A., Martinez-Mozos, O., Ballesta, M., and Reinoso, O. (2010a). A comparative evaluation of interest point detectors and local descriptors for visual slam. Machine Vision and Applications.
  12. Gil, A., Martinez-Mozos, O., Ballesta, M., and Reinoso, O. (2010a). A comparative evaluation of interest point detectors and local descriptors for visual slam. Machine Vision and Applications.
  13. Gil, A., Reinoso, O., Ballesta, M., Juliá, M., and Payá, L. (2010b). Estimation of visual maps with a robot network equipped with vision sensors. Sensors.
  14. Gil, A., Reinoso, O., Ballesta, M., Juliá, M., and Payá, L. (2010b). Estimation of visual maps with a robot network equipped with vision sensors. Sensors.
  15. Gil, A., Reinoso, O., Martnez-Mozos, O., Stachniss, C., and Burgard, W. (2006). Improving data association in vision-based SLAM. In Proc. of the IROS, Beijing, China.
  16. Gil, A., Reinoso, O., Martnez-Mozos, O., Stachniss, C., and Burgard, W. (2006). Improving data association in vision-based SLAM. In Proc. of the IROS, Beijing, China.
  17. Grisetti, G., Stachniss, C., Grzonka, S., and Burgard, W. (2007). A tree parameterization for efficiently computing maximum likelihood maps using gradient descent. In Proc. of RSS, Atlanta, Georgia.
  18. Grisetti, G., Stachniss, C., Grzonka, S., and Burgard, W. (2007). A tree parameterization for efficiently computing maximum likelihood maps using gradient descent. In Proc. of RSS, Atlanta, Georgia.
  19. Harris, C. G. and Stephens, M. (1988). A combined corner and edge detector. In Proc. of Alvey Vision Conference, Manchester, UK.
  20. Harris, C. G. and Stephens, M. (1988). A combined corner and edge detector. In Proc. of Alvey Vision Conference, Manchester, UK.
  21. Hartley, R. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press.
  22. Hartley, R. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press.
  23. Jae-Hean, K. and Myung Jin, C. (2003). Slam with omnidirectional stereo vision sensor. In Proc. of the IROS, Las Vegas (Nevada).
  24. Jae-Hean, K. and Myung Jin, C. (2003). Slam with omnidirectional stereo vision sensor. In Proc. of the IROS, Las Vegas (Nevada).
  25. Joly, C. and Rives, P. (2010). Bearing-only SAM using a minimal inverse depth parametrization. In Proc. of ICINCO, Funchal, Madeira (Portugal).
  26. Joly, C. and Rives, P. (2010). Bearing-only SAM using a minimal inverse depth parametrization. In Proc. of ICINCO, Funchal, Madeira (Portugal).
  27. Kawanishi, R., Yamashita, A., and Kaneko, T. (2008). Construction of 3D environment model from an omnidirectional image sequence. In Proc. of the Asia International Symposium on Mechatronics 2008, Sapporo, Japan.
  28. Kawanishi, R., Yamashita, A., and Kaneko, T. (2008). Construction of 3D environment model from an omnidirectional image sequence. In Proc. of the Asia International Symposium on Mechatronics 2008, Sapporo, Japan.
  29. Konolige, K., Bowman, J., Chen, J., and Mihelich, P. (2010). View-based maps. IJRR.
  30. Konolige, K., Bowman, J., Chen, J., and Mihelich, P. (2010). View-based maps. IJRR.
  31. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision.
  32. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision.
  33. Montemerlo, M., Thrun, S., Koller, D., and Wegbreit, B. (2002). Fastslam: a factored solution to the simultaneous localization and mapping problem. In Proc. of the 18th national conference on Artificial Intelligence, Edmonton, Canada.
  34. Montemerlo, M., Thrun, S., Koller, D., and Wegbreit, B. (2002). Fastslam: a factored solution to the simultaneous localization and mapping problem. In Proc. of the 18th national conference on Artificial Intelligence, Edmonton, Canada.
  35. Murillo, A. C., Guerrero, J. J., and Sagüés, C. (2007). SURF features for efficient robot localization with omnidirectional images. In Proc. of the ICRA, San Diego, USA.
  36. Murillo, A. C., Guerrero, J. J., and Sagüés, C. (2007). SURF features for efficient robot localization with omnidirectional images. In Proc. of the ICRA, San Diego, USA.
  37. Neira, J. and Tardós, J. D. (2001). Data association in stochastic mapping using the joint compatibility test. IEEE Trans. on Robotics and Automation.
  38. Neira, J. and Tardós, J. D. (2001). Data association in stochastic mapping using the joint compatibility test. IEEE Trans. on Robotics and Automation.
  39. Nister, D. (2003). An efcient solution to the five-point relative pose problem. In Proc. of the IEEE CVPR, Madison, USA.
  40. Nister, D. (2003). An efcient solution to the five-point relative pose problem. In Proc. of the IEEE CVPR, Madison, USA.
  41. Nistér, D. (2005). Preemptive RANSAC for live structure and motion estimation. Machine Vision and Applications.
  42. Nistér, D. (2005). Preemptive RANSAC for live structure and motion estimation. Machine Vision and Applications.
  43. Scaramuzza, D., Fraundorfer, F., and Siegwart, R. (2009). Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC. In Proc. of the ICRA, Kobe, Japan.
  44. Scaramuzza, D., Fraundorfer, F., and Siegwart, R. (2009). Real-time monocular visual odometry for on-road vehicles with 1-point RANSAC. In Proc. of the ICRA, Kobe, Japan.
  45. Scaramuzza, D., Martinelli, A., and Siegwart, R. (2006). A toolbox for easily calibrating omnidirectional cameras. In Proc. of the IROS, Beijing, China.
  46. Scaramuzza, D., Martinelli, A., and Siegwart, R. (2006). A toolbox for easily calibrating omnidirectional cameras. In Proc. of the IROS, Beijing, China.
  47. Se, S., Lowe, D., and Little, J. (2001). Vision-based mobile robot localization and mapping using scale-invariant features. In Proc. of the ICRA, Seoul, Korea.
  48. Se, S., Lowe, D., and Little, J. (2001). Vision-based mobile robot localization and mapping using scale-invariant features. In Proc. of the ICRA, Seoul, Korea.
  49. Stachniss, C., Grisetti, G., Haehnel, D., and Burgard, W. (2004). Improved Rao-Blackwellized mapping by adaptive sampling and active loop-closure. In Proc. of the SOAVE, Ilmenau, Germany.
  50. Stachniss, C., Grisetti, G., Haehnel, D., and Burgard, W. (2004). Improved Rao-Blackwellized mapping by adaptive sampling and active loop-closure. In Proc. of the SOAVE, Ilmenau, Germany.
  51. Stewenius, H., Engels, C., and Nister, D. (2006). Recent developments on direct relative orientation. ISPRS Journal of Photogrammetry and Remote Sensing.
  52. Stewenius, H., Engels, C., and Nister, D. (2006). Recent developments on direct relative orientation. ISPRS Journal of Photogrammetry and Remote Sensing.
Download


Paper Citation


in Harvard Style

Gil A., Valiente D., Reinoso O., Fernández L. and M. Marín J. (2011). BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA . In Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-8425-75-1, pages 145-154. DOI: 10.5220/0003459701450154


in Harvard Style

Gil A., Valiente D., Reinoso O., Fernández L. and M. Marín J. (2011). BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA . In Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-8425-75-1, pages 145-154. DOI: 10.5220/0003459701450154


in Bibtex Style

@conference{icinco11,
author={Arturo Gil and David Valiente and Oscar Reinoso and Lorenzo Fernández and J. M. Marín},
title={BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA},
booktitle={Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2011},
pages={145-154},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003459701450154},
isbn={978-989-8425-75-1},
}


in Bibtex Style

@conference{icinco11,
author={Arturo Gil and David Valiente and Oscar Reinoso and Lorenzo Fernández and J. M. Marín},
title={BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA},
booktitle={Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2011},
pages={145-154},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003459701450154},
isbn={978-989-8425-75-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA
SN - 978-989-8425-75-1
AU - Gil A.
AU - Valiente D.
AU - Reinoso O.
AU - Fernández L.
AU - M. Marín J.
PY - 2011
SP - 145
EP - 154
DO - 10.5220/0003459701450154


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - BUILDING VISUAL MAPS WITH A SINGLE OMNIDIRECTIONAL CAMERA
SN - 978-989-8425-75-1
AU - Gil A.
AU - Valiente D.
AU - Reinoso O.
AU - Fernández L.
AU - M. Marín J.
PY - 2011
SP - 145
EP - 154
DO - 10.5220/0003459701450154