SPHERA - A Unifying Structure from Motion Framework for Central Projection Cameras

Christiano Couto Gava, Didier Stricker

2015

Abstract

As multi-view reconstruction techniques evolve, they accomplish to reconstruct larger environments. This is possible due to the availability of vast image collections of the target scenes. Within the next years it will be necessary to account for all available sources of visual information to supply future 3D reconstruction approaches. Accordingly, Structure from Motion (SfM) algorithms will need to handle such variety of image sources, i.e. perspective, wide-angle or spherical images. Although SfM for perspective and spherical images as well as catadioptric systems have already been studied, state of the art algorithms are not able to deal with these images simultaneously. To close this gap, we developed SPHERA, a unifying SfM framework designed for central projection cameras. It uses a sphere as underlying model, allowing single effective viewpoint vision systems to be treated in a unified way. We validate our framework with quantitative evaluations on synthetic spherical as well as real perspective, spherical and hybrid image datasets. Results show that SPHERA is a powerful framework to support upcoming algorithms and applications on large scale 3D reconstruction.

References

  1. Agarwal, S., Mierle, K., and Others (2010). Ceres solver. https://code.google.com/p/ceres-solver/.
  2. Agarwal, S., Snavely, N., Simon, I., Seitz, S. M., and Szeliski, R. (2009). Building rome in a day. In ICCV, pages 72-79, Kyoto, Japan.
  3. Aly, M. and Bouguet, J.-Y. (2012). Street view goes indoors: Automatic pose estimation from uncalibrated unordered spherical panoramas. In WACV, pages 1-8. IEEE.
  4. Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., and Weaver, J. (2010). Google street view: Capturing the world at street level. Computer, 43.
  5. Bagnato, L., Frossard, P., and Vandergheynst, P. (2011). A Variational Framework for Structure from Motion inOmnidirectional Image Sequences. Journal of Mathematical Imaging and Vision, 41(3):182-193.
  6. Blender (2014). http://www.blender.org/. Retrieved October 19, 2014.
  7. Chang, P. and Hebert, M. (2000). Omni-directional structure from motion. In OMNIVIS, Washington, DC, USA. IEEE Computer Society.
  8. Civetta (2009). http://www.weiss-ag.org/solutions/civetta/. Retrieved October 16, 2014.
  9. Furukawa, Y., Curless, B., Seitz, S. M., and Szeliski, R. (2010). Towards internet-scale multi-view stereo. In CVPR.
  10. Furukawa, Y. and Ponce, J. (2008). Accurate, dense, and robust multi-view stereopsis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 01(01):1- 14.
  11. Gava, C. C., Hengen, J.-M., Taetz, B., and Stricker, D. (2013). Keypoint detection and matching on high resolution spherical images. In ISVC, pages 363-372, Rethymnon, Crete, Greece.
  12. Geyer, C. and Daniilidis, K. (2001). Catadioptric projective geometry. Int. Journal of Computer Vision, 43:223- 243.
  13. Hartley, R. I. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition.
  14. Huynh, D. Q. (2009). Metrics for 3d rotations: Comparison and analysis. Journal of Mathematical Imaging and Vision, 35(2):155-164.
  15. Kangni, F. and Laganiere, R. (2007). Orientation and pose recovery from spherical panoramas. ICCV, 0:1-8.
  16. LizardQ (2014). http://www.lizardq.com. Retrieved October 16, 2014.
  17. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. Int. Journal of Computer Vision, 60:91-110.
  18. Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. (2003). An invitation to 3D vision, from images to models. Springer Verlag.
  19. Micusik, B. and Pajdla, T. (2006). Structure from motion with wide circular field of view cameras. IEEE Trans. Pattern Anal. Mach. Intell., 28(7):1135-1149.
  20. Pagani, A. and Stricker, D. (2011). Structure from motion using full spherical panoramic cameras. In OMNIVIS.
  21. PTgui-Pro (2014). New house internet services b.v. http://www.ptgui.com. Retrieved October 16, 2014.
  22. Quan, L. and Lan, Z. (1999). Linear n-point camera pose determination. IEEE Trans. Pattern Anal. Mach. Intell., 21(8):774-780.
  23. Seitz-Roundshot (2014). http://www.roundshot.ch. Retrieved October 16, 2014.
  24. Snavely, N., Seitz, S. M., and Szeliski, R. (2006). Photo tourism: exploring photo collections in 3D. In ACM SIGGRAPH 2006 Papers, SIGGRAPH, pages 835- 846, New York, NY, USA. ACM.
  25. Stewénius, H., Engels, C., and Nistér, D. (2006). Recent developments on direct relative orientation. Journal of Photogrammetry and Remote Sensing, 60:284-294.
  26. Strecha, C., von Hansen, W., Van Gool, L., Fua, P., and Thoennessen, U. (2008). On Benchmarking Camera Calibration and Multi-View Stereo for High Resolution Imagery. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
  27. Torii, A., Imiya, A., and Ohnishi, N. (2005). Two- and Three- View Geometry for Spherical Cameras. In OMNIVIS.
  28. Triggs, B., Mclauchlan, P. F., Hartley, R. I., and Fitzgibbon, A. W. (1999). Bundle adjustment: A modern synthesis. In Proc. of the International Workshop on Vision Algorithms: Theory and Practice, pages 298-372.
Download


Paper Citation


in Harvard Style

Gava C. and Stricker D. (2015). SPHERA - A Unifying Structure from Motion Framework for Central Projection Cameras . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 285-293. DOI: 10.5220/0005301702850293


in Bibtex Style

@conference{visapp15,
author={Christiano Couto Gava and Didier Stricker},
title={SPHERA - A Unifying Structure from Motion Framework for Central Projection Cameras},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={285-293},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005301702850293},
isbn={978-989-758-091-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - SPHERA - A Unifying Structure from Motion Framework for Central Projection Cameras
SN - 978-989-758-091-8
AU - Gava C.
AU - Stricker D.
PY - 2015
SP - 285
EP - 293
DO - 10.5220/0005301702850293