MONOCULAR RECTANGLE RECONSTRUCTION - Based on Direct Linear Transformation

Cornelius Wefelscheid, Tilman Wekel, Olaf Hellwich

Abstract

3D reconstruction is an important field in computer vision. Many approaches are based on multiple images of a given scene. Using only one single image is far more challenging. Monocular image reconstruction can still be achieved by using regular and symmetric structures, which often appear in human environment. In this work we derive two schemes to recover 3D rectangles based on their 2D projections. The first method improves a commonly known standard geometric derivation while the second one is a new algebraic solution based on direct linear transformation (DLT). In a second step, the obtained solutions of both methods serve as seeding points for an iterative linear least squares optimization technique. The robustness of the reconstruction to noise is shown. An insightful thought experiment investigates the ambiguity of the rectangle identification. The presented methods have various potential applications which cover a wide range of computer vision topics such as single image based reconstruction, image registration or camera path estimation.

References

  1. Davison, A. J., Reid, I. D., Molton, N. D., and Stasse, O. (2007). MonoSLAM: real-time single camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(6):1052-1067.
  2. Delage, E., Lee, H., and Ng, A. (2007). Automatic singleimage 3d reconstructions of indoor manhattan world scenes. Robotics Research, pages 305-321.
  3. Faugeras, O. D. and Lustman, F. (1988). Motion and Structure From Motion in a Piecewise Planar Environment. Intern. J. of Pattern Recogn. and Artific. Intelige., 2(3):485-508.
  4. Haralick, R. M. (1989). Determining camera parameters from the perspective projection of a rectangle. Pattern Recognition, 22(3):225-230.
  5. Hartley, R. and Zisserman, A. (2003). Multiple view geometry in computer vision. Cambridge University Press New York, NY, USA.
  6. Lee, D. C., Hebert, M., and Kanade, T. (2009). Geometric reasoning for single image structure recovery. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR).
  7. Micusk, B., Wildenauer, H., and Kosecka, J. (2008). Detection and matching of rectilinear structures. In CVPR. IEEE Computer Society.
  8. Nister, D. (2004). An efficient solution to the five-point relative pose problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6).
  9. Pizlo, Z. (2008). 3D shape: its unique place in visual perception. The MIT Press.
  10. Sturm, P. and Maybank, S. J. (1999). A method for interactive 3d reconstruction of piecewise planar objects from single images. In British Machine Vision Conference, pages 265-274.
  11. Todd, J. T. (2004). The visual perception of 3d shape. Trends in Cognitive Sciences, 8(3):115-121.
  12. Wilczkowiak, M., Boyer, E., and Sturm, P. (2001). Camera calibration and 3D reconstruction from single images using parallelepipeds. In International Conference on Computer Vision, Vancouver, pages 142-148.
Download


Paper Citation


in Harvard Style

Wefelscheid C., Wekel T. and Hellwich O. (2011). MONOCULAR RECTANGLE RECONSTRUCTION - Based on Direct Linear Transformation . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011) ISBN 978-989-8425-47-8, pages 271-276. DOI: 10.5220/0003317502710276


in Bibtex Style

@conference{visapp11,
author={Cornelius Wefelscheid and Tilman Wekel and Olaf Hellwich},
title={MONOCULAR RECTANGLE RECONSTRUCTION - Based on Direct Linear Transformation},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)},
year={2011},
pages={271-276},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003317502710276},
isbn={978-989-8425-47-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2011)
TI - MONOCULAR RECTANGLE RECONSTRUCTION - Based on Direct Linear Transformation
SN - 978-989-8425-47-8
AU - Wefelscheid C.
AU - Wekel T.
AU - Hellwich O.
PY - 2011
SP - 271
EP - 276
DO - 10.5220/0003317502710276