OPTICAL FLOW BY MULTI-SCALE ANNOTATED KEYPOINTS - A Biological Approach

Miguel Farrajota, J. M. F. Rodrigues, J. M. H. du Buf

Abstract

Optical flow is the pattern of apparent motion of objects in a visual scene and the relative motion, or egomotion, of the observer in the scene. In this paper we present a new cortical model for optical flow. This model is based on simple, complex and end-stopped cells. Responses of end-stopped cells serve to detect keypoints and those of simple cells are used to detect orientations of underlying structures and to classify the junction type. By combining a hierarchical, multi-scale tree structure and saliency maps, moving objects can be segregated, their movement can be obtained, and they can be tracked over time. We also show that optical flow at coarse scales suffices to determine egomotion. The model is discussed in the context of an integrated cortical architecture which includes disparity in stereo vision.

References

  1. Bar, M. (2004). Visual objects in context. Nature Rev.: Neuroscience, 5:619-629.
  2. du Buf, J. (1993). Responses of simple cells: events, interferences, and ambiguities. Biol. Cybern., 68:321-333.
  3. Duffy, C. and Wurtz, R. (1991). Sensitivity of mst neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. J. Neurophysiol., 65(6):1329-1345.
  4. Hubel, D. (1995). Eye, brain and vision. Scientific American Library.
  5. Kohn, A. and Movshon, J. (2003). Neuronal adaptation to visual motion in area mt of the macaque. Neuron, 39:681-691.
  6. Morrone, M., Tosetti, M., Montanaro, D., Fiorentini, A., Cioni, G., and Burr, D. (2000). A cortical area that responds specifically to optic flow, revealed by fMRI. Nature Neuroscience, 3(7):1322 - 1328.
  7. Oliva, A. and Torralba, A. (2006). Building the gist of a scene: the role of global image features in recognition. Progress in Brain Res.: Visual Perception, 155:23-26.
  8. Orban, G., Lagae, L., Verri, A., Raiguel, S., Xiao, D., Maes, H., and Torre, V. (1992). First-order analysis of optical flow in monkey brain. PNAS, 89(7):2595-2599.
  9. Rodrigues, J. and du Buf, J. (2006). Multi-scale keypoints in V1 and beyond: object segregation, scale selection, saliency maps and face detection. BioSystems, 2:75- 90.
  10. Rodrigues, J. and du Buf, J. (2009a). A cortical framework for invariant object categorization and recognition. Cognitive Processing, 10(3):243-261.
  11. Rodrigues, J. and du Buf, J. (2009b). Multi-scale lines and edges in v1 and beyond: brightness, object categorization and recognition, and consciousness. BioSystems, 95:206-226.
  12. Smith, A., Wall, M., Williams, A., and Singh, K. (2006). Sensitivity to optic flow in human cortical areas mt and mst. European Journal of Neuroscience, 23(2):561-569.
  13. Wall, M. and Smith, A. (2008). The representation of egomotion in the human brain. Current Biology, 18:191- 194.
  14. Warren, P. and Rushton, S. (2009). Optic flow processing for the assessment of object movement during ego movement. Current Biology, 19(19):1555-1560.
  15. William, K. and Charles, J. (2008). Cortical neuronal responses to optic flow are shaped by visual strategies for steering. Cerebral Cortex, 18(4):727-739.
  16. Wurtz, R. (1998). Optic flow: A brain region devoted to optic flow analysis? Current Biology, 8(16):R554- R556.
Download


Paper Citation


in Harvard Style

Farrajota M., M. F. Rodrigues J. and M. H. du Buf J. (2011). OPTICAL FLOW BY MULTI-SCALE ANNOTATED KEYPOINTS - A Biological Approach . In Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2011) ISBN 978-989-8425-35-5, pages 307-315. DOI: 10.5220/0003172403070315


in Bibtex Style

@conference{biosignals11,
author={Miguel Farrajota and J. M. F. Rodrigues and J. M. H. du Buf},
title={OPTICAL FLOW BY MULTI-SCALE ANNOTATED KEYPOINTS - A Biological Approach},
booktitle={Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2011)},
year={2011},
pages={307-315},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003172403070315},
isbn={978-989-8425-35-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2011)
TI - OPTICAL FLOW BY MULTI-SCALE ANNOTATED KEYPOINTS - A Biological Approach
SN - 978-989-8425-35-5
AU - Farrajota M.
AU - M. F. Rodrigues J.
AU - M. H. du Buf J.
PY - 2011
SP - 307
EP - 315
DO - 10.5220/0003172403070315