# EXACT ALGEBRAIC METHOD OF OPTICAL FLOW DETECTION VIA MODULATED INTEGRAL IMAGING - Theoretical Formulation and Real-time Implementation using Correlation Image Sensor

### Shigeru Ando, Toru Kurihara, Dabi Wei

#### Abstract

A novel mathematical method and a sensing system that detects velocity vector distribution on an optical image with a pixel-wise spatial resolution and a frame-wise temporal resolution is proposed. It is provided by the complex sinusoidally-modulated imaging using the three-phase correlation image sensor (3PCIS) and the exact algebraic inversion method based on the optical flow identity (OFI) satisfied by an intensity image and a complex-sinusoidally modulated image captured by the 3PCIS. Since the OFI is free from time derivatives, any limitations on the object velocity and inaccuracies due to approximated time derivatives is thoroughly avoided. An experimental system was constructed with a 320×256 pixel 3PCIS device and a standard PC for inversion operations and display. Several experimental results are shown including the dense motion capture of face and gesture and the particle image velocimetry of water vortices.

#### References

- Ando, S. (1986). A velocity vector field measurement system based on spatio-temporal image derivative. In Trans. SICE, vol.22, pp.1330-1336.
- Ando, S. (2000). Consistent gradient operators. In IEEE Trans. Pattern Anal. Machine Intell., vol.22, no.3, pp.252-265.
- Ando, S. and Kimachi, A. (2003). Correlation image sensor: Two-dimensional matched detection of amplitude modulated light. In IEEE Trans. Electron Devices, vol.50, no.10, pp.2059-2066.
- Ando, S., Nara, T., Ono, N., and Kurihara, T. (2007). Realtime orientation-sensitive magneto-optic imager for leakage flux inspection. In IEEE Trans. Magnetics, vol.43, no.3, pp.1044-1051.
- Ando, S., Wei, D., and Masurel, P. (2008). Optical flow detection via complex-sinusoidally modulated imaging and its realization with correlation image sensor. In Trans. IPSJ, Computer Vision and Image Media, vol.49, no.6, p.13-21.
- Horn, B. K. P. and Schunk, B. G. (1981). Determining optical flow. In Artificial Intell., vol.17, pp.185-203.
- Kimachi, A. (2007). Real-time heterodyne imaging interferometry: focal-plane amplitude and phase demodulation using a three-phase correlation image sensor. In Applied Optics, vol.46, no.1, pp.87-94.
- Kimachi, A., Imaizumi, T., Kato, A., and Ando, S. (2002). Spectral matching imager using correlation image sensor. In Trans. IEEJ, vol.122-E, no.4, pp.200-206.

#### Paper Citation

#### in Harvard Style

Ando S., Kurihara T. and Wei D. (2009). **EXACT ALGEBRAIC METHOD OF OPTICAL FLOW DETECTION VIA MODULATED INTEGRAL IMAGING - Theoretical Formulation and Real-time Implementation using Correlation Image Sensor** . In *Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)* ISBN 978-989-8111-69-2, pages 481-487. DOI: 10.5220/0001794104810487

#### in Bibtex Style

@conference{visapp09,

author={Shigeru Ando and Toru Kurihara and Dabi Wei},

title={EXACT ALGEBRAIC METHOD OF OPTICAL FLOW DETECTION VIA MODULATED INTEGRAL IMAGING - Theoretical Formulation and Real-time Implementation using Correlation Image Sensor},

booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},

year={2009},

pages={481-487},

publisher={SciTePress},

organization={INSTICC},

doi={10.5220/0001794104810487},

isbn={978-989-8111-69-2},

}

#### in EndNote Style

TY - CONF

JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)

TI - EXACT ALGEBRAIC METHOD OF OPTICAL FLOW DETECTION VIA MODULATED INTEGRAL IMAGING - Theoretical Formulation and Real-time Implementation using Correlation Image Sensor

SN - 978-989-8111-69-2

AU - Ando S.

AU - Kurihara T.

AU - Wei D.

PY - 2009

SP - 481

EP - 487

DO - 10.5220/0001794104810487