Multi-spectral Flash Imaging under Low-light Condition using Optimization with Weight Map

Bong-Seok Choi, Dae-Chul Kim, Wang-Jun Kyung, Yeong-Ho Ha

2014

Abstract

Long exposure shot and flash lights are generally used to acquire images under low-light environments. However, flash lights often induce color distortion, red-eye effect, and they can disturb the subject. The other hand, long-exposure shots are prone to motion-blur due to camera shake or subject-motion. Recently, multi-spectral flash imaging has been introduced to overcome the limitations of traditional low-light photography. Multi-spectral flash imaging is performed by combining the invisible and visible spectrum information. However, common multi spectral flash approaches induce color distortion due to the lower accuracy of the invisible spectrum image. In this paper, we propose a multi-spectral flash imaging algorithm using optimization with weight map in order to improve color accuracy and brightness of image. The UV/IR and visible spectrum images are firstly captured, respectively. Then, to compensate luminance value under low light condition, tone reproduction is performed by using adaptive curve due to image features that is obtained by Naka-Rushton formula. Next, to discriminate uniform regions from detail regions, weight map is generated by using Canny operator. Finally, the optimization object function takes into account the output likelihood with respect to the visible light image, the sparsity of image gradients as well as the spectral constraints for the IR-red channels and UV-blue channels. The performance of the proposed method has been subjectively evaluated using z-score, and we also show that output images have improved color accuracy and lower noise with respect to other methods.

References

  1. Agrawal A., Raskar R., Nayar S. K., and Li Y. (2005). Removing Photography Arifacts using Gradient Projection and Flash-Exposure Sampling. ACM Transaction on Graphics, 24(3): 828-835.
  2. Canny J. (1986). A Computational Approach to Edge Detection. IEEE Transaction on Pattern Analysis and Machine Intelligence, 8(6): 679-714.
  3. Eisemann E., and Durand F. (2004). Flash Photography Enhancement via Intrinsic Relighting. ACM Transaction on Graphics, 23(3): 673-678.
  4. Fergus R., Singh B., Hertzmann A., Roweis S. T. and Freeman W. T. (2006). Removing Camera Shake from a Single Photograph. ACM Transaction on Graphics, 25(3): 787-794.
  5. Jiaya J. (2007). Single Image Motion Deblurring using Transparency. Confference on IEEE Computer Vision and Pattern Recongnition.
  6. Krishnan D. and Fergus R. (2009). Dark Flash photography. ACM Transaction on Graphics, 28(3): 1- 11.
  7. Morovic J. (2008). Color Gamut Mapping. Published in Association with the Society for IS&T.
  8. Naka K. I. and Rushton W. A. H. (1966). S-potentials from luminosity units in the retina of fish. Journal of physiol. 185(3): 587-599
  9. Petschnigg G., Szeliski R., Agrawala M., Cohen M., Hoppe H., and Toyama K. (2004). Digital photography with Flash and No-Flash Image Pairs. ACM Transaction on Graphics, 23(3): 664-672.
  10. Wang S., Hou T., Border J., Qin H., and Miller R. (2012) High Quality Image Deblurring Panchromatic Pixels. ACM Transaction on Graphics, 31(5): 120:1-120:11.
  11. Yangfang W. and Yupin L. (2012). Balanced color contrast enhancement for digital images. Optical Engineering, 51(10): 107001-1 - 107001-11
  12. Zhuo S., Zhang X., Miao X., and Sim T. (2010). Enhancing Low Light Images using infrared Flash Images. IEEE 17th International Conference on Image Processing.
Download


Paper Citation


in Harvard Style

Choi B., Kim D., Kyung W. and Ha Y. (2014). Multi-spectral Flash Imaging under Low-light Condition using Optimization with Weight Map . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 33-39. DOI: 10.5220/0004657500330039


in Bibtex Style

@conference{visapp14,
author={Bong-Seok Choi and Dae-Chul Kim and Wang-Jun Kyung and Yeong-Ho Ha},
title={Multi-spectral Flash Imaging under Low-light Condition using Optimization with Weight Map},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={33-39},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004657500330039},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Multi-spectral Flash Imaging under Low-light Condition using Optimization with Weight Map
SN - 978-989-758-003-1
AU - Choi B.
AU - Kim D.
AU - Kyung W.
AU - Ha Y.
PY - 2014
SP - 33
EP - 39
DO - 10.5220/0004657500330039