Data Fusion Between a 2D Laser Profile Sensor and a Camera

M. Wagner, P. Heß, S. Reitelshöfer, J. Franke

2015

Abstract

This paper describes a color extension of a 2D laser profile sensor by extracting the corresponding color from a camera image. For these purpose, we developed a routine for an extrinsic calibration between the profile sensor and the camera. Based on the resulting translation and rotation vectors a belonging pixel can be calculated for each profile point. Consequently, the color for each profile point can be extracted from the image. This approach is used to extend the geometric data of a robotic based 3D scanning system by color data.

References

  1. Borangiu, T. and Dumitrache, A. (2010). Robot arms with 3d vision capabilities. In Advances in Robot Manipulator, Vukovar, Croatia. InTech.
  2. Cobzas, D., Zhang, H., and Jagersand, M. (2002). A comparative analysis of geometric and image-based volumetric and intensity data registration algorithms. In Proceedings of the International Conference on Robotics and Automation, volume 3, Washington, DC, USA. IEEE.
  3. G. Li, L. D., Pan, L., and Henghai, F. (2009). The calibration algorithm of a 3d color measurement system based on the line feature.
  4. Garcia-Alegre, M. C., Martin, D., Guinea, D. M., and Guinea, D. (2011). Real-time fusion of visual images and laser data images for safe navigation in outdoor environments. In Sensor Fusion - Foundation and Applications, Vukovar, Croatia. InTech.
  5. Klimentjew, D., Hendrich, N., and Zhang, J. (2010). Multi sensor fusion of camera and 3d laser range finder for object recognition. In Proceedings of the Conference on Multisensor Fusion and Integration for Intelligent Systems, Salt Lake City, UT, USA. IEEE.
  6. Larsson, S. and Kjellander, J. (2006). Motion control and data capturing for laser scanning with an industrial robot. In Robotics and Autonomous Systems, volume 54, Amsterdam, Netherlands. Elsevier B.V.
  7. Li, J., Chen, M., Jin, X., Xuebi, C., Yu, D., Z.Dai, Ou, Z., and Tang, Q. (2011). Calibration of a multiple axes 3- d laser scanning system consisting of robot, portable laser scanner and turntable. In Optik - International Journal for Light and Electron Optics, volume 122, Amsterdam, Netherlands. Elsevier B.V.
  8. Mei, C. and Rives, P. (2006). Calibration between a central catadioptric camera and a laser range finder for robotic applications. In Proceedings of the International Conference on Robotics and Automation, Orlando, FL, USA. IEEE.
  9. Mohottala, S., Ono, S., M.Kagesawa, and Ikeuchi, K. (2009). Fusion of a camera and a laser range sensor for vehicle recognition. In Proceedings of the Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Miami, FL, USA. IEEE.
  10. Navarrete, J., Viejo, D., and Cazorla, M. (2013). Portable 3d laser-camera calibration system with color fusion for slam. volume 3, Taipei, Taiwan. AUSMT.
  11. Nunez, P., Drews, P., Rocha, R., and Dias, J. (2009). Data fusion calibration for a 3d laser range finder and a camera using inertial data. In Proceedings of the 4th European Conference on Mobile Robots, Barcelona, Spain. IEEE.
  12. Osgood, T. J. and Huang, Y. (2013). Calibration of laser scanner and camera fusion system for intelligent vehicles using neldermead optimization. volume 24. IOP Publishing Ltd.
  13. Scaramuzza, D., Harati, A., and Siegwart, R. (2007). Extrinsic self calibration of a camera and a 3d laser range finder from natural scenes. In Proceedings of the International Conference on Intelligent Robots and Systems, San Diego, CA, USA. IEEE.
  14. Shen, C. and Zhu, S. (2012). A robotic system for surface measurement via 3d laser scanner. In Proceedings of the 2nd International Conference on Computer Application and System Modeling, volume 21, Paris, France. Atlantis Press.
  15. Tan, T. N., Sullivan, G. D., and Baker, K. D. (1995). Recovery of intrinsic and extrinsic camera parameters using perspective views of rectangles. In Proceedings of the 1995 British Conference on Machine Vision (Vol. 1), BMVC 7895, pages 177-186, Surrey, UK. BMVA Press.
  16. Zhang, Q. and Pless, R. (2004). Extrinsic calibration of a camera and laser range finder (improves camera calibration). In Proceedings of the International Conference on Intelligent Robots and Systems, volume 3, Sendai, Japan. IEEE.
  17. Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11):1330-1334.
Download


Paper Citation


in Harvard Style

Wagner M., Heß P., Reitelshöfer S. and Franke J. (2015). Data Fusion Between a 2D Laser Profile Sensor and a Camera . In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-123-6, pages 159-165. DOI: 10.5220/0005501601590165


in Bibtex Style

@conference{icinco15,
author={M. Wagner and P. Heß and S. Reitelshöfer and J. Franke},
title={Data Fusion Between a 2D Laser Profile Sensor and a Camera},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2015},
pages={159-165},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005501601590165},
isbn={978-989-758-123-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Data Fusion Between a 2D Laser Profile Sensor and a Camera
SN - 978-989-758-123-6
AU - Wagner M.
AU - Heß P.
AU - Reitelshöfer S.
AU - Franke J.
PY - 2015
SP - 159
EP - 165
DO - 10.5220/0005501601590165