Real-time Super Resolution Equipment for 8K Video

Seiichi Gohshi

2014

Abstract

Resolution is one of the most important things when assessing image quality, and image quality improves in proportion to resolution. Super Resolution (SR) is a resolution improving technology that is different from conventional image enhancement methods. SR methods, of which there are many, typically have complex algorithms that involve iterations, and it is not easy to apply them to video running in real time at 50 or 60 frames a second; i.e., each frame would have to be processed in 20 ms (50 Hz) or 16.7 ms (60 Hz). In this paper, a simple form of SR that uses non-linear signal processing is proposed to cope with the difficulties in real-time processing. Real-time hardware equipped with an FPGA (Field Programmable Gate Array) for 4K and 8K video is shown and its SR capability is discussed.

References

  1. W. F. Schreiber, ”Wirephoto Quality Improvement by Unsharp Masking”, J. Pattern Recognition, 2, 1970, pp. 111-121.
  2. J-S. Lee, ”Digital Image Enhancement and Noise Filtering by Use of Local Statistics”, IEEE Trans. Pattern Analysis and Machine Intelligence, PAMI-2, 2, March 1980, pp. 165-168.
  3. W. K. Pratt, ”Digital Image Processing (3rd Ed)”, John Wiley and Sons, 2001, pg. 278.
  4. S. C. Park et al., ”Super-Resolution Image Reconstruction: A Technical Overview”, IEEE Signal Processing Magazine, 1053-5888/03, pp. 21-36, May, 2003.
  5. S. Farsiu et al., ”Fast and Robust Multi-frame Superresolution”, IEEE Transactions on Image Processing , vol. 13, no. 10, pp. 1327-1344, October, 2004.
  6. A. W. M. van Eekeren et al., ”Multiframe SuperResolution Reconstruction of Small Moving Objects”, IEEE Transactions on Image Processing, pp. 2901- 2912, Vol. 19, No. 11, November, 2010.
  7. Xianghua Houa et al., ”Super-resolution Image Reconstruction for Video Sequence”, 2011 International Conference on Electronic & Mechanical Engineering and Information Technology, pp. 4600-4603, 12-14 August, 2011.
  8. Matan Protter et al., ”Generalizing the Nonlocal-Means to Super-Resolution Reconstruction”, IEEE Transactions on Image Processing, pp. 36-51, Vol. 18, No. 1, Jan. 2009.
  9. S. Panda et al., ”POCS Based Super-Resolution Image Reconstruction Using an Adaptive Regularization Parameter”, IJCSI International Journal of Computer Science Issues, Vol. 8, Issue 5, No. 2, September 2011, ISSN (Online), 1694-0814.
  10. P. Mertz and F. Gray, ”A Theory of Scanning and Its Relation to the Characteristics of the Transmitted Signal in Telephotography and Television”, Bell System Technical Journal, Vol.63B, pp.464-515, (1934).
  11. S. Gohshi and I. Echizen, ”Limitations of Super Resolution Image Reconstruction and How to Overcome them for a Single Image”, ICETE2013 (SIGMAP), Reykjavik, Iceland , pp. 71-78, July, 2013.
  12. N. Matsumoto and T. Ida, ”Reconstruction Based SuperResolution Using Self-Congruency around Image Edges”, Journal of IEICE , Vol. J93-D, No. 2, pp. 118- 126, Feb. 2010 (in Japanese).
  13. Seiichi Gohshi et al., ”Real-Time Up-Converter from HDTV to 4K with Super Resolution”, 42.2, pp. 582-585, 0097-966X-13-4402, Society for Information Display SID 2013 DIGEST, 23rd May 2013.
  14. H. Sakata, ”Assessment of TV noise and Frequency Characteristics”, Journal of ITE , Vol. 34, No. 3, pp. 239-245, Mar. 1980 (in Japanese).
  15. Seiichi Gohshi, ”Limitation of Super Resolution Image Reconstruction for Video”, Computational Intelligence, Communication and Networks (CICSyN), Madrid, Jun. 2007.
  16. M. A. T. Figueiredo and R. D. Nowak, ”An EM algorithm for wavelet-based image restoration”, IEEE Transactions on Image Processing, vol. 12, pp. 906-916, Aug. 2003.
  17. Hanjie Pan , Thierry Blu, ”Sparse Image Restoration using Iterated Linear Expansion of Thresholds”, Image Processing (ICIP), pp. 1905 - 1908, 18th IEEE International Conference, Sept. 2011.
  18. Stephen Karungaru, Masakazu Sugizaki, Minoru Fukumi, Yasue Mitsukura, and Norio Akamatsu, ”Out-ofFocus Blur Image Restoration using the Akamatsu Transform”, Industrial Electronics, IECON 7809. 35th Annual Conference of IEEE, pp. 4257-4261, Nov. 2009.
Download


Paper Citation


in Harvard Style

Gohshi S. (2014). Real-time Super Resolution Equipment for 8K Video . In Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014) ISBN 978-989-758-046-8, pages 149-156. DOI: 10.5220/0005014901490156


in Bibtex Style

@conference{sigmap14,
author={Seiichi Gohshi},
title={Real-time Super Resolution Equipment for 8K Video},
booktitle={Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)},
year={2014},
pages={149-156},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005014901490156},
isbn={978-989-758-046-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)
TI - Real-time Super Resolution Equipment for 8K Video
SN - 978-989-758-046-8
AU - Gohshi S.
PY - 2014
SP - 149
EP - 156
DO - 10.5220/0005014901490156