Relative Pose Estimation from Straight Lines using Parallel Line Clustering and its Application to Monocular Visual Odometry

Naja von Schmude, Pierre Lothe, Bernd Jähne

2016

Abstract

This paper tackles the problem of relative pose estimation between two monocular camera images in textureless scenes. Due to a lack of point matches, point-based approaches such as the 5-point algorithm often fail when used in these scenarios. Therefore we investigate relative pose estimation from line observations. We propose a new approach in which the relative pose estimation from lines is extended by a 3D line direction estimation step. The estimated line directions serve to improve the robustness and the efficiency of all processing phases: they enable us to guide the matching of line features and allow an efficient calculation of the relative pose. First, we describe in detail the novel 3D line direction estimation from a single image by clustering of parallel lines in the world. Secondly, we propose an innovative guided matching in which only clusters of lines with corresponding 3D line directions are considered. Thirdly, we introduce the new relative pose estimation based on 3D line directions. Finally, we combine all steps to a visual odometry system. We evaluate the different steps on synthetic and real sequences and demonstrate that in the targeted scenarios we outperform the state-of-the-art in both accuracy and computation time.

References

  1. Antone, M. E. and Teller, S. (2000). Automatic recovery of relative camera rotations for urban scenes. In IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000, pages 282-289.
  2. Bartoli, A. and Sturm, P. (2005). Structure-from-motion using lines: Representation, triangulation, and bundle adjustment. Computer Vision and Image Understanding, 100(3):416-441.
  3. Bazin, J., Demonceaux, C., Vasseur, P., and Kweon, I. (2010). Motion estimation by decoupling rotation and translation in catadioptric vision. Computer Vision and Image Understanding, 114(2):254-273.
  4. Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society. Series B (Methodological), pages 1-38.
  5. Duda, R. O. and Hart, P. E. (1972). Use of the hough transformation to detect lines and curves in pictures. Communications of the ACM, 15(1):11-15.
  6. Elqursh, A. and Elgammal, A. (2011). Line-based relative pose estimation. In 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3049-3056.
  7. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6):381-395.
  8. Gioi, R. v., Jakubowicz, J., Morel, J.-M., and Randall, G. (2010). Lsd: A fast line segment detector with a false detection control. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(4):722-732.
  9. Gower, J. C. and Dijksterhuis, G. B. (2004). Procrustes problems, volume 3. Oxford University Press.
  10. Hartley, R. I. (1994). Projective reconstruction from line correspondences. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pages 903-907.
  11. Hartley, R. I. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition.
  12. Hirose, K. and Saito, H. (2012). Fast line description for line-based slam. In Bowden, R., Collomosse, J., and Mikolajczyk, K., editors, British Machine Vision Conference 2012, pages 83.1-83.11.
  13. Kos?ecká, J. and Zhang, W. (2002). Video compass. In Goos, G., Hartmanis, J., Leeuwen, J., Heyden, A., Sparr, G., Nielsen, M., and Johansen, P., editors, Computer Vision - ECCV 2002 , volume 2353 of Lecture Notes in Computer Science, pages 476-490. Springer Berlin Heidelberg, Berlin, Heidelberg.
  14. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2):91-110.
  15. Nister, D. (2004). An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6):756-770.
  16. Schindler, G., Krishnamurthy, P., and Dellaert, F. (2006). Line-based structure from motion for urban environments. In Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06), pages 846-853.
  17. Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012). A benchmark for the evaluation of rgb-d slam systems. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012), pages 573-580.
  18. Umeyama, S. (1991). Least-Squares Estimation of Transformation Parameters Between Two Point Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(4):376-380.
  19. Wang, G., Wu, J., and Ji, Z. (2008). Single view based pose estimation from circle or parallel lines. Pattern Recognition Letters, 29(7):977-985.
  20. Wang, L., Neumann, U., and You, S. (2009). Wide-baseline image matching using line signatures. In 2009 IEEE 12th International Conference on Computer Vision (ICCV), pages 1311-1318.
  21. Weng, J., Huang, T., and Ahuja, N. (1992). Motion and structure from line correspondences; closed-form solution, uniqueness, and optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(3):318-336.
  22. Witt, J. and Weltin, U. (2013). Robust stereo visual odometry using iterative closest multiple lines. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, page XX.
  23. Zhou, H., Zou, D., Pei, L., Ying, R., Liu, P., and Yu, W. (2015). Structslam: Visual slam with building structure lines. IEEE Transactions on Vehicular Technology, page 1.
Download


Paper Citation


in Harvard Style

von Schmude N., Lothe P. and Jähne B. (2016). Relative Pose Estimation from Straight Lines using Parallel Line Clustering and its Application to Monocular Visual Odometry . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 421-431. DOI: 10.5220/0005661404210431


in Bibtex Style

@conference{visapp16,
author={Naja von Schmude and Pierre Lothe and Bernd Jähne},
title={Relative Pose Estimation from Straight Lines using Parallel Line Clustering and its Application to Monocular Visual Odometry},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={421-431},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005661404210431},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - Relative Pose Estimation from Straight Lines using Parallel Line Clustering and its Application to Monocular Visual Odometry
SN - 978-989-758-175-5
AU - von Schmude N.
AU - Lothe P.
AU - Jähne B.
PY - 2016
SP - 421
EP - 431
DO - 10.5220/0005661404210431