Exemplar-based Human Body Super-resolution for Surveillance Camera Systems

Kento Nishibori, Tomokazu Takahashi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase

2014

Abstract

In this paper, we propose an exemplar-based super-resolution method applied to a human body in a surveillance video. Since persons are usually captured as low-resolution images by a video surveillance system, it is sometimes necessary to perform detection and identification of persons from not only a human face but also from the human body appearance. The super-resolution for a human body image is difficult because the appearances of person images vary according to the color of clothing and the posture of persons. Thus, we focus on the high-frequency components that could restore the lost high-frequency components of the low resolution image regardless to the variation of the clothing. Therefore, the purpose of the work presented in this paper is to apply the exemplar-based super-resolution using high-frequency components for a lowresolution human body image to generate a high-resolution human body image so that both computer systems and humans can identify persons more accurately. As a result of experiments, we confirmed the effectiveness of the proposed super-resolution method.

References

  1. Baker, S. and Kanade, T. (2000). Hallucinating faces. In Proc. IEEE Fourth Int'l Conf. Automatic Face and Gesture Recognition (FG'00), pages 83-88.
  2. Baker, S. and Kanade, T. (2002). Limits on super-resolution and how to break them. IEEE Trans. Pattern Analysis and Machine Intelligence, 24(9):1167-1183.
  3. Bonet, J. S. D. (1997). Multiresolution sampling procedure for analysis and synthesis of texture images. In Proc. ACM 24th Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH'97), pages 361-368.
  4. Freeman, W. T., Jones, T. R., and Pasztor, E. C. (2002). Example-based super-resolution. IEEE Trans. Computer Graphics and Applications, 22(2):56-65.
  5. Ho, T. and Zeng, B. (2012). Super-resolution image by curve fitting in the threshold decomposition domain. Visual Communication and Image Representation, 23(1):208-221.
  6. Jiang, J., , Hu, R., Han, Z., Lu, T., and Huang, K. (2012a). Position-patch based face hallucination via localityconstrained representation. In Proc. IEEE 13th Int'l Conf. on Multimedia and Expo (ICME'12), pages 212-217.
  7. Jiang, J., Hu, R., Han, Z., Huang, K., and Lu, T. (2012b). Efficient single image super-resolution via graph embedding. In Proc. IEEE 13th Int'l Conf. on Multimedia and Expo (ICME'12), pages 610-615.
  8. Lin, Z. and Shum, H. Y. (2004). Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans. Pattern Analysis and Machine Intelligence, 26(1):83-97.
  9. Liu, C., Shum, H. Y., and Freeman, W. T. (2007). Face hallucination: Theory and practice. ACM Trans. Computer Vision, 75(1):115-134.
  10. Ma, X., Li, W., Xu, H., Yang, X., and Song, H. (2013). A general residue compensation framework of learningbased face super-resolution. Computational Information Systems, 9(10):4049-4056.
  11. Milanfar, P. (2011). Super-Resolution Imaging (Digital Imaging and Computer Vision). CRC Press.
  12. Muja, M. and Lowe, D. G. (2009). Fast approximate nearest neighbors with automatic algorithm configuration. In Proc. Fourth Int'l Conf. Computer Vision Theory and Applications (VISSAP'09), pages 331-340.
  13. Nakajima, C., Pontil, M., Heisele, B., and Poggio, T. (2003). Full-body person recognition system. Trans. Pattern Recognition in Kernel and Subspace Methods for Computer Vision, 36(9):1997-2006.
  14. Shibata, T., Iketani, A., and Senda, S. (2013). Single image super resolution reconstruction in perturbed exemplar sub-space. In Proc. IEEE 12th Conf. Asian Conference on Computer Vision (ACCV'13), pages 401-412.
  15. Wang, J. T., Liang, K. W., Chang, S. F., and Chang, P. C. (2009). Super-resolution image with estimated high frequency compensated algorithm. In Proc. 9th Int'l Symp. Communications and Information Technology (ISCIT'09), pages 175-180.
  16. Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Processing, 13(4):600-612.
  17. Yoshida, T., Takahashi, T., Deguchi, D., Ide, I., and Murase, H. (2012). Robust face super-resolution using freeform deformations for low-quality surveillance video. In Proc. IEEE 13th Int'l Conf. on Multimedia and Expo (ICME'12), pages 368-373.
  18. Zeyde, R., Elad, M., and Protter, M. (2010). On single image scale-up using sparse representation. In Proc. 7th Int'l Conf. Curves and Surfaces, pages 711-730.
Download


Paper Citation


in Harvard Style

Nishibori K., Takahashi T., Deguchi D., Ide I. and Murase H. (2014). Exemplar-based Human Body Super-resolution for Surveillance Camera Systems . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 115-121. DOI: 10.5220/0004686101150121


in Bibtex Style

@conference{visapp14,
author={Kento Nishibori and Tomokazu Takahashi and Daisuke Deguchi and Ichiro Ide and Hiroshi Murase},
title={Exemplar-based Human Body Super-resolution for Surveillance Camera Systems},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={115-121},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004686101150121},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Exemplar-based Human Body Super-resolution for Surveillance Camera Systems
SN - 978-989-758-003-1
AU - Nishibori K.
AU - Takahashi T.
AU - Deguchi D.
AU - Ide I.
AU - Murase H.
PY - 2014
SP - 115
EP - 121
DO - 10.5220/0004686101150121