IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms

M. Dominguez-Morales, E. Cerezuela-Escudero, A. Jimenez-Fernandez, R. Paz-Vicente, J. L. Font-Calvo, P. Iñigo-Blasco, A. Linares-Barranco, G. Jimenez-Moreno

2011

Abstract

Image processing in digital computer systems usually considers the visual information as a sequence of frames. These frames are from cameras that capture reality for a short period of time. They are renewed and transmitted at a rate of 25-30 fps (typical real-time scenario). Digital video processing has to process each frame in order to obtain a filter result or detect a feature on the input. In stereo vision, existing algorithms use frames from two digital cameras and process them pixel by pixel until it is found a pattern match in a section of both stereo frames. Spike-based processing is a relatively new approach that implements the processing by manipulating spikes one by one at the time they are transmitted, like a human brain. The mammal nervous system is able to solve much more complex problems, such as visual recognition by manipulating neuron’s spikes. The spike-based philosophy for visual information processing based on the neuro-inspired Address-Event- Representation (AER) is achieving nowadays very high performances. In this work we study the existing digital stereo matching algorithms and how do they work. After that, we propose an AER stereo matching algorithm using some of the principles shown in digital stereo methods.

References

  1. G. M. Shepherd, 1990. The Synaptic Organization of the Brain. Oxford University Press, 3rd Edition.
  2. G. M. Shepherd, 1990. The Synaptic Organization of the Brain. Oxford University Press, 3rd Edition.
  3. J. Lee, 1981. A Simple Speckle Smoothing Algorithm for Synthetic Aperture Radar Images. Man and Cybernetics, vol. SMC-13.
  4. J. Lee, 1981. A Simple Speckle Smoothing Algorithm for Synthetic Aperture Radar Images. Man and Cybernetics, vol. SMC-13.
  5. T. Crimmins, 1985. Geometric Filter for Speckle Reduction. Applied Optics, vol. 24, pp. 1438-1443.
  6. T. Crimmins, 1985. Geometric Filter for Speckle Reduction. Applied Optics, vol. 24, pp. 1438-1443.
  7. D. Papadimitriou, T. Dennis, 1996. Epipolar line estimation and rectification for stereo image pairs. IEEE Trans. Image Processing, 5(4):672-676.
  8. D. Papadimitriou, T. Dennis, 1996. Epipolar line estimation and rectification for stereo image pairs. IEEE Trans. Image Processing, 5(4):672-676.
  9. S. B. Pollard, et al, 1985. PMF: a stereo correspondence algorithm using a disparity gradient limit. Perception, 14:449-470.
  10. S. B. Pollard, et al, 1985. PMF: a stereo correspondence algorithm using a disparity gradient limit. Perception, 14:449-470.
  11. S. T. Barnard, M. A. Fischler, 1982. Computational Stereo. Journal ACM CSUR. Volume 14 Issue 4.
  12. S. T. Barnard, M. A. Fischler, 1982. Computational Stereo. Journal ACM CSUR. Volume 14 Issue 4.
  13. G. Pajares et al, 2006. Fuzzy Cognitive Maps for stereovision matching. Pattern Recognition, 39, 2101- 2114.
  14. G. Pajares et al, 2006. Fuzzy Cognitive Maps for stereovision matching. Pattern Recognition, 39, 2101- 2114.
  15. R. Berner et al. In ISCAS'07, A 5 Meps $100 USB2.0 Address-Event Monitor-Sequencer Interface.
  16. R. Berner et al. In ISCAS'07, A 5 Meps $100 USB2.0 Address-Event Monitor-Sequencer Interface.
  17. A. Linares-Barranco et al. In ISCAS'10, AER Convolution Processors for FPGA.
  18. A. Linares-Barranco et al. In ISCAS'10, AER Convolution Processors for FPGA.
  19. B. Cope et al, 2006. Implementation of 2D Convolution on FPGA, GPU and CPU. Imperial College Report.
  20. B. Cope et al, 2006. Implementation of 2D Convolution on FPGA, GPU and CPU. Imperial College Report.
  21. B. Cope et al. In FPT'05, Have GPUs made FPGAs redundant in the field of video processing?
  22. B. Cope et al. In FPT'05, Have GPUs made FPGAs redundant in the field of video processing?
  23. M. Sivilotti, 1991. Wiring Considerations in analog VLSI Systems with Application to Field-Programmable Networks. Ph.D. Thesis, Caltech.
  24. M. Sivilotti, 1991. Wiring Considerations in analog VLSI Systems with Application to Field-Programmable Networks. Ph.D. Thesis, Caltech.
  25. T. Tuytelaars et al. In BMVC'00 Wide baseline stereo matching based on local, affinely invariant regions.
  26. T. Tuytelaars et al. In BMVC'00 Wide baseline stereo matching based on local, affinely invariant regions.
Download


Paper Citation


in Harvard Style

Dominguez-Morales M., Cerezuela-Escudero E., Jimenez-Fernandez A., Paz-Vicente R., Font-Calvo J., Iñigo-Blasco P., Linares-Barranco A. and Jimenez-Moreno G. (2011). IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms . In Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011) ISBN 978-989-8425-72-0, pages 79-84. DOI: 10.5220/0003518500790084


in Harvard Style

Dominguez-Morales M., Cerezuela-Escudero E., Jimenez-Fernandez A., Paz-Vicente R., Font-Calvo J., Iñigo-Blasco P., Linares-Barranco A. and Jimenez-Moreno G. (2011). IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms . In Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011) ISBN 978-989-8425-72-0, pages 79-84. DOI: 10.5220/0003518500790084


in Bibtex Style

@conference{sigmap11,
author={M. Dominguez-Morales and E. Cerezuela-Escudero and A. Jimenez-Fernandez and R. Paz-Vicente and J. L. Font-Calvo and P. Iñigo-Blasco and A. Linares-Barranco and G. Jimenez-Moreno},
title={IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms},
booktitle={Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011)},
year={2011},
pages={79-84},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003518500790084},
isbn={978-989-8425-72-0},
}


in Bibtex Style

@conference{sigmap11,
author={M. Dominguez-Morales and E. Cerezuela-Escudero and A. Jimenez-Fernandez and R. Paz-Vicente and J. L. Font-Calvo and P. Iñigo-Blasco and A. Linares-Barranco and G. Jimenez-Moreno},
title={IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms},
booktitle={Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011)},
year={2011},
pages={79-84},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003518500790084},
isbn={978-989-8425-72-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011)
TI - IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms
SN - 978-989-8425-72-0
AU - Dominguez-Morales M.
AU - Cerezuela-Escudero E.
AU - Jimenez-Fernandez A.
AU - Paz-Vicente R.
AU - Font-Calvo J.
AU - Iñigo-Blasco P.
AU - Linares-Barranco A.
AU - Jimenez-Moreno G.
PY - 2011
SP - 79
EP - 84
DO - 10.5220/0003518500790084


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2011)
TI - IMAGE MATCHING ALGORITHMS IN STEREO VISION USING ADDRESS-EVENT-REPRESENTATION - A Theoretical Study and Evaluation of the Different Algorithms
SN - 978-989-8425-72-0
AU - Dominguez-Morales M.
AU - Cerezuela-Escudero E.
AU - Jimenez-Fernandez A.
AU - Paz-Vicente R.
AU - Font-Calvo J.
AU - Iñigo-Blasco P.
AU - Linares-Barranco A.
AU - Jimenez-Moreno G.
PY - 2011
SP - 79
EP - 84
DO - 10.5220/0003518500790084