Least Square based Multi-spectral Color Interpolation Algorithm for RGB-NIR Image Sensors

Ji Yong Kwon, Chul Hee Park, Moon Gi Kang

2015

Abstract

The use of near-infrared (NIR) band gives us additional invisible information to discriminate objects and enables us to recognize objects more clearly under low light conditions. To acquire color and NIR bands together in a single image sensor developed from a conventional color filter array (CFA), we use a multispectral filter array (MSFA) in the RGB-NIR sensors and design a color interpolation algorithm to fill the information about the multi-spectral (MS) bands from the subsampled MSFA image. Aliasing in the MSFA image caused by the subsampled bands is minimized by balancing the energy of the bands. A panchromatic (PAN) image is generated by filtering the low-pass kernel to the MSFA image. This PAN image without chrominance signals, which contains the most high-frequency in the MSFA image, is used to reconstruct the MS images by solving the least square cost function between the PAN and MS images. The experiments show that the proposed algorithm estimates the high-resolution MS images very well.

References

  1. Alleysson, D., Susstrunk, S., and Herault, J. (2005). Linear demosaicing inspired by the human visual system. Image Processing, IEEE Transactions on, 14(4):439- 449.
  2. Fang, L., Au, O., Tang, K., and Katsaggelos, A. (2012a). Antialiasing filter design for subpixel downsampling via frequency-domain analysis. Image Processing, IEEE Transactions on, 21(3):1391-1405.
  3. Fang, L., Au, O., Tang, K., Wen, X., and Wang, H. (2012b). Novel 2-d mmse subpixel-based image down-sampling. Circuits and Systems for Video Technology, IEEE Transactions on, 22(5):740-753.
  4. Gunturk, B., Altunbasak, Y., and Mersereau, R. (2002). Color plane interpolation using alternating projections. Image Processing, IEEE Transactions on, 11(9):997-1013.
  5. Koyama, S., Inaba, Y., Kasano, M., and Murata, T. (2008). A day and night vision mos imager with robust photonic-crystal-based rgb-and-ir. Electron Devices, IEEE Transactions on, 55(3):754-759.
  6. Lu, Y., Fredembach, C., Vetterli, M., and Susstrunk, S. (2009). Designing color filter arrays for the joint capture of visible and near-infrared images. In Image Processing (ICIP), 2009 16th IEEE International Conference on, pages 3797-3800.
  7. Luenberger, D. G. and Ye, Y. (1984). Linear and Nonlinear Programming. Addison-Wesley.
  8. Miao, L., Qi, H., Ramanath, R., and Snyder, W. (2006). Binary tree-based generic demosaicking algorithm for multispectral filter arrays. Image Processing, IEEE Transactions on, 15(11):3550-3558.
  9. Monno, Y., Tanaka, M., and Okutomi, M. (2011). Multispectral demosaicking using adaptive kernel upsampling. In Image Processing (ICIP), 2011 18th IEEE International Conference on, pages 3157-3160.
  10. Park, B. K., Choe, W., Lim, J., Lee, S., and Kim, C. (2012). Color correction with edge preserving and minimal snr decrease using multi-layer decomposition. volume 8296, pages 829613-829613-7.
  11. Sadeghipoor, Z., Lu, Y., and Susstrunk, S. (2011). Correlation-based joint acquisition and demosaicing of visible and near-infrared images. In Image Processing (ICIP), 2011 18th IEEE International Conference on, pages 3165-3168.
  12. Schaul, L., Fredembach, C., and Susstrunk, S. (2009). Color image dehazing using the near-infrared. In Image Processing (ICIP), 2009 16th IEEE International Conference on, pages 1629-1632.
  13. Wang, X., Thomas, J.-B., Hardeberg, J. Y., and Gouton, P. (2013). Median filtering in multispectral filter array demosaicking.
  14. Zhang, Y. (1999). A new merging method and its spectral and spatial effects. International Journal of Remote Sensing, 20(10):2003-2014.
Download


Paper Citation


in Harvard Style

Kwon J., Park C. and Kang M. (2015). Least Square based Multi-spectral Color Interpolation Algorithm for RGB-NIR Image Sensors . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 38-45. DOI: 10.5220/0005265000380045


in Bibtex Style

@conference{visapp15,
author={Ji Yong Kwon and Chul Hee Park and Moon Gi Kang},
title={Least Square based Multi-spectral Color Interpolation Algorithm for RGB-NIR Image Sensors},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={38-45},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005265000380045},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Least Square based Multi-spectral Color Interpolation Algorithm for RGB-NIR Image Sensors
SN - 978-989-758-089-5
AU - Kwon J.
AU - Park C.
AU - Kang M.
PY - 2015
SP - 38
EP - 45
DO - 10.5220/0005265000380045