Real-time Material Transformation using Single Frame Surface Orientation Imager

Toru Kurihara, Shigeru Ando

2015

Abstract

In this paper, we propose real-time reflectance transformation system using correlation image sensor and four LEDs. The reflectance transformation system changes object appearance into different materials one and displays it in the monitor. We have developed real-time surface orientation imager to add specular component according to captured normal vector map for reflectance transformation. Surface orientation of the object is encoded into amplitude and phase of the reflected light intensity by using phase shifted blinking LEDs, The correlation image sensor, provided by us, demodulates those amplitude and phase in each pixel during exposure time. Therefore, the surface orientation is captured by single frame, which can be applied to moving object. We developed reflectance transformation system using surface orientation captured by our real-time surface orientation imager. We demonstrated that the system provides relighting and changing reflectance property in real-time.

References

  1. Ando, S. and Kimachi, A. (2003). Correlation image sensor: Two-dimensional matched detection of amplitude-modulated light. IEEE Trans. on Electron Devices, 50(3):2059-2066.
  2. Kurihara, T., Ono, N., and Ando, S. (2003). Surface orientation imager using three-phase amplitude-modulated illumination and correlation image sensor. In Proceedings of the SPIE, volume 5013, pages 95-102.
  3. KURIHARA, T., ONO, N., and ANDO, S. (2012). Singleframe surface orientation imager using triangular three-phase amplitude-modulated illuminations and correlation image sensor. Transactions of the Society of Instrument and Control Engineers, 48(8):505-513.
  4. Kurihara, T., Shimizu, T., Ono, N., and Ando, S. (2005). Surface orientation imager with excluding capability of non-lambertian reflectance. In Proceedings of the SPIE, volume 5665, pages 9-16.
  5. Malzbender, T., Wilburn, B., Gelb, D., and Ambrisco, B. (2006). Surface enhancement using real-time photometric stereo and reflectance transformation. In Proceedings of the 17th Eurographics Conference on Rendering Techniques, EGSR 7806, pages 245-250, Aire-la-Ville, Switzerland, Switzerland. Eurographics Association.
  6. Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., and Debevec, P. (2005). Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph., 24(3):756-764.
Download


Paper Citation


in Harvard Style

Kurihara T. and Ando S. (2015). Real-time Material Transformation using Single Frame Surface Orientation Imager . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 240-245. DOI: 10.5220/0005357602400245


in Bibtex Style

@conference{visapp15,
author={Toru Kurihara and Shigeru Ando},
title={Real-time Material Transformation using Single Frame Surface Orientation Imager},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={240-245},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005357602400245},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Real-time Material Transformation using Single Frame Surface Orientation Imager
SN - 978-989-758-089-5
AU - Kurihara T.
AU - Ando S.
PY - 2015
SP - 240
EP - 245
DO - 10.5220/0005357602400245