Patch-based Statistical Performance Analysis of Upsampling for Precise Super–Resolution

Djamila Aouada, Kassem Al Ismaeil, Björn Ottersten

2015

Abstract

All existent methods for the statistical analysis of super–resolution approaches have stopped at the variance term, not accounting for the bias in the mean square error. In this paper we give an original derivation of the bias term. We propose to use a patch-based method inspired by the work of (Chatterjee and Milanfar, 2009). Our approach, however, is completely new as we derive a new affine bias model dedicated for the multi-frame super resolution framework. We apply the proposed statistical performance analysis to the Upsampling for Precise Super–Resolution (UP-SR) algorithm. This algorithm was shown experimentally to be a good solution for enhancing the resolution of depth sequences in both cases of global and local motions. Its performance is herein analyzed theoretically in terms of its approximated mean square error, using the proposed derivation of the bias. This analysis is validated experimentally on simulated static and dynamic depth sequences with a known ground truth. This provides an insightful understanding of the effects of noise variance, number of observed low resolution frames, and super–resolution factor on the final and intermediate performance of UP–SR. Our conclusion is that increasing the number of frames should improve the performance while the error is increased due to local motions, and to the upsampling which is part of UP-SR.

References

  1. 3d MLI (2014). http://www.iee.lu/technologies.
  2. Beaulieu, N. and Jiang, S. (2010). Ml estimation of signal amplitude in laplace noise,. In Global Telecommunications Conference. IEEE.
  3. Chatterjee, P. and Milanfar, P. (2009). Bias modeling for image denoising,. In 43rd Asilomar Conference on Signals, Systems and Computers.
  4. Elad, M. and Feuer, A. (1999). Super-resolution reconstruction of continuous image sequences,. In Transaction Pattern Analysis and Machine Intelligence. IEEE.
  5. K. Al Ismaeil, D. Aouada, B. M. B. O. (2013a). Depth super-resolution by enhanced shift & add,. In 15th International Conference on Computer Analysis of Images and Patterns. Springer.
  6. K. Al Ismaeil, D. Aouada, B. M. B. O. (2013b). Dynamic super-resolution of depth sequences with nonrigid motions,. In 20th IEEE International Conference on Image Processing. IEEE.
  7. Milanfar, P. (2010). Super-resolution imaging,. In CRC Press.
  8. pmd CamBoard nano (2014). http://www.pmdtec.com/.
  9. Rajagopalan, A. and Kiran, P. (2003). Motion-free superresolution and the role of relative blur,. In J. Opt. Soc. Amer.
  10. Robinson, D. and Milanfar, P. (2003). Bias-minimizing filters for gradient-based motion estimation,. In 37th Asilomar Conference on Signals, Systems and Computers. IEEE.
  11. Robinson, D. and Milanfar, P. (2006). Statistical performance analysis of super-resolution,. In Transaction Image Processing. IEEE.
  12. S. Farsiu, D. Robinson, M. E. P. M. (2003). Robust shift and add approach to super-resolution,. In International symposium on Optical Science and Technology, SPIE's 48th Annual Meeting.
  13. S. Farsiu, D. Robinson, M. E. P. M. (2004). Fast and robust multi-frame super-resolution,. In Transaction Image Processing. IEEE.
  14. V-REP (2014). http://www.k-team.com/mobile-roboticsproducts/v-rep.
Download


Paper Citation


in Harvard Style

Aouada D., Al Ismaeil K. and Ottersten B. (2015). Patch-based Statistical Performance Analysis of Upsampling for Precise Super–Resolution . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 186-193. DOI: 10.5220/0005316001860193


in Bibtex Style

@conference{visapp15,
author={Djamila Aouada and Kassem Al Ismaeil and Björn Ottersten},
title={Patch-based Statistical Performance Analysis of Upsampling for Precise Super–Resolution},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={186-193},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005316001860193},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Patch-based Statistical Performance Analysis of Upsampling for Precise Super–Resolution
SN - 978-989-758-089-5
AU - Aouada D.
AU - Al Ismaeil K.
AU - Ottersten B.
PY - 2015
SP - 186
EP - 193
DO - 10.5220/0005316001860193