Using Local Refinements on 360 Stitching from Dual-fisheye Cameras

Rafael Roberto, Daniel Perazzo, João Paulo Lima, João Paulo Lima, Veronica Teichrieb, Jonysberg Peixoto Quintino, Fabio Q. B. da Silva, Andre L. M. Santos, Helder Pinho

2020

Abstract

Full panoramic images have several applications, ranging from virtual reality to 360º broadcasting. Such visualization method is growing, especially after the popularization of dual-fisheye cameras, which are compact and easy-to-use 360º imaging devices, and low-cost platforms that allow immersive experiences. However, low-quality registration and compositing in which artifacts are noticeable in the stitching area can harm the user experience. Although it is challenging to compose such images due to their narrow overlap area, recent works can provide good results when performing a global alignment. Nevertheless, they often cause artifacts since global alignment is not able to address every aspect of an image. In this work, we present a stitching method that performs local refinements to improve the registration and compositing quality of 360º images and videos. It builds on a feature clustering approach for global alignment. The proposed technique applies seam estimation and rigid moving least squares to remove undesired artifacts locally. Finally, we evaluate both to select the best result between them using a seam evaluation metric. Experiments showed that our method reduced the stitching error in at least 42.56% for images and 49.45% for videos when compared with existing techniques. Moreover, it provided the best results in all tested images and in 94.52% of the video frames.

Paper Citation

in Harvard Style

Roberto R., Perazzo D., Lima J., Teichrieb V., Quintino J., B. da Silva F., Santos A. and Pinho H. (2020). Using Local Refinements on 360 Stitching from Dual-fisheye Cameras. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 17-26. DOI: 10.5220/0008874100170026

in Bibtex Style

@conference{visapp20,
author={Rafael Roberto and Daniel Perazzo and João Paulo Lima and Veronica Teichrieb and Jonysberg Peixoto Quintino and Fabio Q. B. da Silva and Andre L. M. Santos and Helder Pinho},
title={Using Local Refinements on 360 Stitching from Dual-fisheye Cameras},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={17-26},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008874100170026},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Using Local Refinements on 360 Stitching from Dual-fisheye Cameras
SN - 978-989-758-402-2
AU - Roberto R.
AU - Perazzo D.
AU - Lima J.
AU - Teichrieb V.
AU - Quintino J.
AU - B. da Silva F.
AU - Santos A.
AU - Pinho H.
PY - 2020
SP - 17
EP - 26
DO - 10.5220/0008874100170026
PB - SciTePress