Automatic Letter/Pillarbox Detection for Optimized Display of Digital TV

Lúcia Carreira, Maria Paula Queluz

Abstract

In this paper we propose a method for the automatic detection of the true aspect ratio of digital video, by detecting the presence and width of horizontal and vertical black bars, also known as letterbox and pillarbox effects. If active format description (AFD) metadata is not present, the proposed method can be used to identify the right AFD and associate it to the video content. In the case AFD information is present, the method can be used to verify its correctness and to correct it in case of error. Additionally, the proposed method also allows to detect if relevant information (as broadcaster logos and hard subtitles) is merged within the black bars and, in the case of subtitles, is able to extract it from the bars and dislocate it to the active picture area (allowing the letterbox removal).

References

  1. https://www.youtube.com/watch?v=IM_dOoUXgLE
  2. https://www.youtube.com/watch?v=6NvVwA6Er8c
  3. https://www.youtube.com/watch?v=ocTUey4mIac
  4. https://www.youtube.com/watch?v=rtOvBOTyX00
  5. https://www.youtube.com/watch?v=7Y6oRLJvjAo
  6. , Prabhavathy, A., & Shree, J. (2012). A Survey on Video Inpainting. International Journal of Computer Applications.
  7. (2011). Multimedia Quality Assessment - A World of Applications. IEEE Signal Processing Magazine - Special Issue, 28(6).
  8. (2002). Recommendation ITU-R BT.709-5 - Parameter values for the HDTV standards for production and international programme exchange.
  9. (2011). Recommendation ITU-R BT.601-7 - Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios.
  10. (2006). Metadata for Formatting with Multiple Aspect Ratios. HPA Technology Retreat.
  11. , & Behrad, A. (2012). Text Localization, Extraction and Inpainting in Color Images. Iranian Conferance on Electrical Engineering, (pp. 1035- 1040). Tehran.
  12. (2010). Content Readiness Ensuring Content Quality Across Content Lifecycle. Australian Broadcast Exhibition (ABE). Sidney.
  13. (2002). Patente N.º US 6,340,992 B1. United Stated of America.
  14. , & Yan, J. (2011). Rolling and Non-Rolling Subtitle Detection with Temporal and Spatial Analysis for News Video. International Conference on Modelling, Identification and Control, (pp. 285-288). Shanghai.
  15. , & Neuman, D. (2008). Patente N.º US 7,339,627 B2. United States of America.
  16. (1983). Image Analysis and Mathematical Morphology. Academic Press.
  17. (2009). Format for Active Format Description and Bar Data, ST 2016-1. SMPTE.
  18. , Gao, X., Lin, J., & Zhang, H. (July de 2002). A spatio-temporal approach for video caption detection and recognition. IEEE Trans. on Neural Networks.
  19. R., & Rao, K. R. (2006). Digital Video Image Quality and Perceptual Vision. CRC Press.
Download


Paper Citation


in Harvard Style

Carreira L. and Queluz M. (2014). Automatic Letter/Pillarbox Detection for Optimized Display of Digital TV . In Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014) ISBN 978-989-758-046-8, pages 281-288. DOI: 10.5220/0005064202810288


in Bibtex Style

@conference{sigmap14,
author={Lúcia Carreira and Maria Paula Queluz},
title={Automatic Letter/Pillarbox Detection for Optimized Display of Digital TV},
booktitle={Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)},
year={2014},
pages={281-288},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005064202810288},
isbn={978-989-758-046-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)
TI - Automatic Letter/Pillarbox Detection for Optimized Display of Digital TV
SN - 978-989-758-046-8
AU - Carreira L.
AU - Queluz M.
PY - 2014
SP - 281
EP - 288
DO - 10.5220/0005064202810288