VISUALIZATION OF LONG SCENES FROM DENSE IMAGE SEQUENCES USING PERSPECTIVE COMPOSITION

Siyuan Fang, Neill Campbell

2012

Abstract

This paper presents a system for generating multi-perspective panoramas for long scenes from dense image sequences. Panoramas are created by combining different perspectives, including both original and novel perspectives. The latter are rendered using our perspective synthesis algorithm, which employs geometrical information to eliminate the sampling error distortion caused by depth parallax of on-planar scenes. Our approach for creating multi-perspective panoramas is different from existing methods in that a perspective composition framework is presented to combine various perspectives to form a panorama without undesired visual artifacts, through suppressing both colour inconsistencies and structural misalignments among input perspectives. We show that this perspective composition can facilitate the generation of panoramas from user specified multi-perspective configurations.

References

  1. Acha, A., Eagel, G., and Peleg, S. (2008). Minimal Aspect Distortion (MAD) mosaicing of long scenes. International Journal of Computer Vision, 78(2-3):187-206.
  2. Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., and Szeliski, R. (2006). Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics, 25(3):853 - 861.
  3. Birchfield, S. and Tomasi, C. (1999). Multiway cut for stereo and motion with slanted surfaces. In Proceedings of the International Conference on Computer Vision, pages 489-495.
  4. Brown, M. and Lowe, D. G. (2003). Recognising panoramas. In Proceedings of IEEE International Conference on Computer Vision, volume 2, pages 1218- 1225.
  5. Fang, H. and Hart, J. C. (2004). Textureshop: texture synthesis as a photograph editing tool. In Proceedings of SIGGRAPH, volume 23, pages 354-359.
  6. Jia, J. and Tang, C.-K. (2008). Image stitching using structure deformation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(4):617-631.
  7. Kolmogorov, V. and Zabih, R. (2004). What energy functions can be minimized via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(2):147-159.
  8. Kopf, J., Chen, B., Szeliski, R., and Cohen, M. (2010). Street slide: Browsing street level imagery. ACM Transactions on Graphics, 29(4):96:1-96:8.
  9. Kumar, R., Anandan, P., Irani, M., Bergen, J., and Hanna, K. (1995). Representation of scenes from collections of images. In Proceedings of IEEE Workshop on Representation of Visual Scenes, pages 10-17.
  10. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 60(2):91-110.
  11. Peleg, S., Rousso, B., Rav-Acha, A., and Zomet, A. (2000). Mosaicing on adaptive manifold. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(10):1144-1154.
  12. Pérez, P., Gangnet, M., and Blake, A. (2003). Poisson image editing. In Proceedings of SIGGRAPH, volume 22, pages 313-318.
  13. Roman, A., Garg, G., and Levoy, M. (2004). Interactive design of multi-perspective images for visualizing urban landscapes. In Proceedings of IEEE Visualization, pages 537-544.
  14. Roman, A. and Lensch, H. (2006). Automatic multiperspective images. In Proceedings of Eurographics Symposium on Rendering, pages 161-171.
  15. Shi, J. and Tomasi, C. (1994). Good features to track. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 593-600.
  16. Shum, H. and Szeliski, R. (2000). Construction of panoramic image mosaics with global and local alignment. International Journal of Computer Vision, 36(2):101-130.
  17. Szeliski, R. and Kang, S. (1995). Direct methods for visual scene reconstruction. In Proceedings of IEEE Workshop on Representation of Visual Scenes, pages 26- 33.
  18. Szeliski, R. and Shum, H. (1997). Creating full view panoramic image mosaics and environment maps. Journal of Computer Graphics, 31:251-258.
  19. Wahba, G. (1990). Spline Models for Observational Data. SIAM.
  20. Wexler, Y. and Simakov, D. (2005). Space-time scene manifolds. In Proceedings of the International Conference on Computer Vision, volume 1, pages 858 - 863.
  21. Zheng, J. (2003). Digital route panoramas. IEEE Multimedia, 10(3):57- 67.
  22. Zheng, K. C. and Kang, S. B. (2007). Layered depth panoramas. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1-8.
  23. Zomet, A., Feldman, D., Peleg, S., and Weinshall, D. (2003). Mosaicing new views: The crossed-slits projection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(6):741- 754.
Download


Paper Citation


in Harvard Style

Fang S. and Campbell N. (2012). VISUALIZATION OF LONG SCENES FROM DENSE IMAGE SEQUENCES USING PERSPECTIVE COMPOSITION . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 227-237. DOI: 10.5220/0003848702270237


in Bibtex Style

@conference{grapp12,
author={Siyuan Fang and Neill Campbell},
title={VISUALIZATION OF LONG SCENES FROM DENSE IMAGE SEQUENCES USING PERSPECTIVE COMPOSITION},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)},
year={2012},
pages={227-237},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003848702270237},
isbn={978-989-8565-02-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)
TI - VISUALIZATION OF LONG SCENES FROM DENSE IMAGE SEQUENCES USING PERSPECTIVE COMPOSITION
SN - 978-989-8565-02-0
AU - Fang S.
AU - Campbell N.
PY - 2012
SP - 227
EP - 237
DO - 10.5220/0003848702270237