W-PnP Method: Optimal Solution for the Weak-Perspective n-Point Problem and Its Application to Structure from Motion

Levente Hajder

2017

Abstract

Camera calibration is a key problem in 3D computer vision since the late 80's. Most of the calibration methods deal with the (perspective) pinhole camera model. This is not a simple goal: the problem is nonlinear due to the perspectivity. The strategy of these methods is to estimate the intrinsic camera parameters first; then the extrinsic ones are computed by the so-called PnP method. Finally, the accurate camera parameters are obtained by slow numerical optimization. In this paper, we show that the weak-perspective camera model can be optimally calibrated without numerical optimization if the $L_2$ norm is used. The solution is given by a closed-form formula, thus the estimation is very fast. We call this method as the Weak-Perspective n-Point (W-PnP) algorithm. Its advantage is that it simultaneously estimates the two intrinsic weak-perspective camera parameters and the extrinsic ones. We show that the proposed calibration method can be utilized as the solution for a subproblem of 3D reconstruction with missing data. An alternating least squares method is also defined that optimizes the camera motion using the proposed optimal calibration method.

References

  1. Arun, K. S., Huang, T. S., and Blostein, S. D. (1987). Leastsquares fitting of two 3-D point sets. IEEE Trans. on PAMI, 9(5):698-700.
  2. B. Triggs and P. McLauchlan and R. Hartley and A. Fitzgibbon (2000). Bundle Adjustment - A Modern Synthesis. In Vision Algorithms: Theory and Practice, pages 298-375.
  3. Buchanan, A. M. and Fitzgibbon, A. W. (2005). Damped newton algorithms for matrix factorization with missing data. In Proceedings of the 2005 IEEE CVPR, pages 316-322.
  4. Bue, A. D., Xavier, J., Agapito, L., and Paladini, M. (2012). Bilinear modeling via augmented lagrange multipliers (balm). IEEE Trans. on PAMI, 34(8):1496-1508.
  5. Dementhon, D. F. and Davis, L. S. (1995). Model-based object pose in 25 lines of code. IJCV, 15:123-141.
  6. Hartley, R. and Kahl, F. (2007). Optimal algorithms in multiview geometry. In Proceedings of the Asian Conf. Computer Vision, pages 13-34.
  7. Hartley, R. and Schaffalitzky, F. (2003). Powerfactorization: 3d reconstruction with missing or uncertain data.
  8. Hartley, R. I. and Zisserman, A. (2000). Multiple View Geometry in Computer Vision. Cambridge University Press.
  9. Hesch, J. A. and Roumeliotis, S. I. (2011). A direct leastsquares (dls) method for pnp. In International Conference on Computer Vision, pages 383-390. IEEE.
  10. Horaud, R., Dornaika, F., Lamiroy, B., and Christy, S. (1997). Object pose: The link between weak perspective, paraperspective and full perspective. International Journal of Computer Vision, 22(2):173-189.
  11. Horn, B., Hilden, H., and Negahdaripourt, S. (1988). Closed-form Solution of Absolute Orientation Using Orthonormal Matrices. Journal of the Optical Society of America, 5(7):1127-1135.
  12. Jenkins, M. A. and Traub, J. F. (1970). A Three-Stage Variables-Shift Iteration for Polynomial Zeros and Its Relation to Generalized Rayleigh Iteration. Numer. Math, 14:252263.
  13. Kahl, F. and Hartley, R. I. (2008). Multiple-view geometry under the linfinity-norm. IEEE Trans. Pattern Anal. Mach. Intell., 30(9):1603-1617.
  14. Kanatani, K., Sugaya, Y., and Ackermann, H. (2007). Uncalibrated factorization using a variable symmetric affine camera. IEICE - Trans. Inf. Syst., E90- D(5):851-858.
  15. Ke, Q. and Kanade, T. (2005). Quasiconvex Optimization for Robust Geometric Reconstruction. In ICCV 7805: Proceedings of the Tenth IEEE International Conference on Computer Vision, pages 986-993.
  16. L. Hajder and Í. Pernek and Cs. Kazó (2011). WeakPerspective Structure from Motion by Fast Alternation. The Visual Computer, 27(5):387-399.
  17. Lepetit, V., F.Moreno-Noguer, and P.Fua (2009). Epnp: An accurate o(n) solution to the pnp problem. International Journal of Computer Vision, 81(2):155-166.
  18. Marques, M. and Costeira, J. (2009). Estimating 3d shape from degenerate sequences with missing data. CVIU, 113(2):261-272.
  19. Matthews, I. and Baker, S. (2003). Active appearance models revisited. International Journal of Computer Vision, 60:135-164.
  20. Okatani, T. and Deguchi, K. (2006). On the wiberg algorithm for matrix factorization in the presence of missing components. IJCV, 72(3):329-337.
  21. Pernek, A., Hajder, L., and Kazó, C. (2008). Metric Reconstruction with Missing Data under Weak-Perspective. In BMVC, pages 109-116.
  22. Poelman, C. J. and Kanade, T. (1997). A Paraperspective Factorization Method for Shape and Motion Recovery. IEEE Trans. on PAMI, 19(3):312-322.
  23. Ruhe, A. (1974). Numerical computation of principal components when several observations are missing. Technical report, Umea Univesity, Sweden.
  24. Schweighofer, G. and Pinz, A. (2008). Globally optimal o(n) solution to the pnp problem for general camera models. In BMVC.
  25. Shum, H.-Y., Ikeuchi, K., and Reddy, R. (1995). Principal component analysis with missing data and its application to polyhedral object modeling. IEEE Trans. Pattern Anal. Mach. Intell., 17(9):854-867.
  26. Sturm, P. and Triggs, B. (1996). A Factorization Based Algorithm for Multi-Image Projective Structure and Motion. In ECCV, volume 2, pages 709-720.
  27. Tomasi, C. and Kanade, T. (1992). Shape and Motion from Image Streams under orthography: A factorization approach. Intl. Journal Computer Vision, 9:137-154.
  28. Tomasi, C. and Shi, J. (1994). Good Features to Track. In IEEE Conf. Computer Vision and Pattern Recognition, pages 593-600.
  29. Wang, G., Wu, Q. M. J., and Sun, G. (2008). Quasiperspective projection with applications to 3d factorization from uncalibrated image sequences. In CVPR.
  30. Weinshall, D. and Tomasi, C. (1995). Linear and Incremental Acquisition of Invariant Shape Models From Image Sequences. IEEE Trans. on PAMI, 17(5):512-517.
  31. Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Trans. on PAMI, 22(11):1330-1334.
  32. Zheng, Y., Kuang, Y., Sugimoto, S., A°str öm, K., and Okutomi, M. (2013). Revisiting the pnp problem: A fast, general and optimal solution. In ICCV, pages 2344- 2351.
Download


Paper Citation


in Harvard Style

Hajder L. (2017). W-PnP Method: Optimal Solution for the Weak-Perspective n-Point Problem and Its Application to Structure from Motion . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 265-276. DOI: 10.5220/0006158902650276


in Bibtex Style

@conference{visapp17,
author={Levente Hajder},
title={W-PnP Method: Optimal Solution for the Weak-Perspective n-Point Problem and Its Application to Structure from Motion},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={265-276},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006158902650276},
isbn={978-989-758-227-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - W-PnP Method: Optimal Solution for the Weak-Perspective n-Point Problem and Its Application to Structure from Motion
SN - 978-989-758-227-1
AU - Hajder L.
PY - 2017
SP - 265
EP - 276
DO - 10.5220/0006158902650276