Color Restoration for Infrared Cutoff Filter Removed RGBN Multispectral Filter Array Image Sensor

Chul Hee Park, Hyun Mook Oh, Moon Gi Kang

Abstract

Imaging systems based on multispectral filter arrays(MSFA) can simultaneously acquire wide spectral information. A MSFA image sensor with R, G, B, and near-infrared(NIR) filters can obtain the mixed spectral information of visible bands and that of the NIR bands. Since the color filter materials used in MSFA sensors were almost transparent in the NIR range, the observed colors of multispectral images were degraded by the additional NIR spectral band information. To overcome this color degradation, a new signal processing approach is needed to separate the spectral information of visible bands from the mixed spectral information. In this paper, a color restoration method for imaging systems based on MSFA sensors is proposed. The proposed method restores the received image by removing NIR band spectral information from the mixed wide spectral information. To remove additional spectral information of the NIR band, spectral estimation and spectral decomposition were performed based on the spectral characteristics of the MSFA sensor. The experimental results show that the proposed method restored color information by removing unwanted NIR contributions to the RGB color channels.

References

  1. D. Yi, R. Liu, R. C. Z. L. and Li, S. Z. (2007). Face matching between near infrared and visible light images. In Proc. IAPR/IEEE International Conference on Biometrics on.
  2. Fredembach, C. and Susstrunk, S. (2008). Colouring the near-infrared. In IS&T/SID 16th Color Imaging Conference. SPIE.
  3. Fredembach, C. and Susstrunk, S. (2009). Illumination estimation and detection using near infrared. In SPIE/IS&T Electronic Imaging, Digital Photography. SPIE.
  4. G. D. Finlayson, S. D. H. (2000). Improving gamut mapping color constancy. IEEE Transactions on Image Processing, 9(10).
  5. G. D. Finlayson, S. D. H. and Hubel, P. M. (2001). Color by correlation: a simple, unifying framework for color constancy. IEEE Transactions on Pattern Anal. and Machine Intell, 23(11).
  6. J. Choi, K. Y. and Kim, Y. (2011). A new adaptive component-substitution-based satellite image fusion by using partial replacement. IEEE Transaction on Geoscience and Remote Sensing on, 49(1).
  7. K. Barnard, V. C. and Funt, B. (2002). A comparison of computational color constancy algorithms - part i: methodology and experiments with synthesized data. IEEE Transactions on Image Processing, 11(9).
  8. Kumar, A. and Prathyusha, K. V. (2009). Personal authenticatoin using hand vein triangulation and knuckle shape. IEEE Transactions on Image Processing on, 18(9).
  9. L. Schaul, C. F. and Susstrunk, S. (2009). Color image dehazing using the near-infrared. In IEEE International Conference on Image Processing. IEEE.
  10. M. Kise, B. Park, G. W. H. K. C. L. and Windham, W. R. (2010). Multispectral imaging system with interchangeable filter design. Computers and Eloctronics in Agriculture, 72(2).
  11. Park, J. H. and Kang, M. G. (2004). Spatially adaptive multi-resolution multispectral image fusion. International Journal of Remote Sensing on, 25(23):5491- 5508.
  12. S. Koyama, Y. Inaba, M. K. and Murata, T. (2008). A day and night visoin mos imager with robust pphotoniccrystal-based rgb-and-ir. IEEE Transactions on Electron Devices, 55(3).
  13. S. Matsui, T. Okabe, M. S. and Sato, Y. (2010). Image enhancement of low-light scenes with near-infrared flash images. In Lecture Notes in computer Science: Computer Vision. SPIE.
  14. S. Z. Li, C. RuFeng Chu, L. S. and Lun, Z. (2007). Illumination invariant face recognition using near-infrared images. IEEE Transactions on Pattern Analysis and Machine Intelligence on, 29(4).
  15. Salamati, N. and Susstrunk, S. (2010). Material-based object segmentation using nir information. In IS& T/SID 18th Color Imaging Conference on. SPIE.
  16. X. Hao, H. Chen, C. Y. N. Y. H. B. and Wang, C. (2010). A near-infrared imaging method for capturing the interior of a vehicle through windshield. In 2010 IEEE Southwest Symposium on Image Analysis & Interpretatioin on. IEEE.
Download


Paper Citation


in Harvard Style

Park C., Oh H. and Kang M. (2015). Color Restoration for Infrared Cutoff Filter Removed RGBN Multispectral Filter Array Image Sensor . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 30-37. DOI: 10.5220/0005263600300037


in Bibtex Style

@conference{visapp15,
author={Chul Hee Park and Hyun Mook Oh and Moon Gi Kang},
title={Color Restoration for Infrared Cutoff Filter Removed RGBN Multispectral Filter Array Image Sensor},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={30-37},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005263600300037},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Color Restoration for Infrared Cutoff Filter Removed RGBN Multispectral Filter Array Image Sensor
SN - 978-989-758-089-5
AU - Park C.
AU - Oh H.
AU - Kang M.
PY - 2015
SP - 30
EP - 37
DO - 10.5220/0005263600300037