SMARTCAM FOR REAL-TIME STEREO VISION - Address-event Based Embedded System

Stephan Schraml, Peter Schön, Nenad Milosevic

2007

Abstract

We present a novel real-time stereo smart camera for sparse disparity (depth) map estimation of moving objects at up to 200 frames/sec. It is based on a 128x128 pixel asynchronous optical transient sensor, using address-event representation (AER) protocol. An address-event based algorithm for stereo depth calculation including calibration, correspondence and reconstruction processing steps is also presented. Due to the on-chip data pre-processing the algorithm can be implemented on a single low-power digital signal processor.

References

  1. Boahen, K., 2000. Point-to-Point Connectivity between neuromorphic chips using address events. In IEEE Trans. on Circuits and Systems II, 47 (5), 416-433.
  2. Bouguet, J. Y., 2005. Matlab camera calibration Toolbox, http://www.vision.caltech.edu/bouguetj/calib_doc.
  3. Di Stefano, L., Marchionni, M., Mattoccia, S., 2004. A fast area-based stereo matching algorithm. In Image and Vision Computing, 22, 983-1005.
  4. Häfliger, Ph., Bergh., F., 2002. An integrated circuit computing shift in stereo pictures using time domain spike signals. In Conference paper NORCHIP 2002, Københaven.
  5. Kramer, J., 2002. An integrated optical transient sensor. In IEEE Transactions on Circuits and Systems II, 49(9), 612-628.
  6. Lichtsteiner, P., Posch, C. and Delbruck, T., 2006. A 128×128 120dB 30mW Asynchronous Vision Sensor that Responds to Relative Intensity Change. In International Solid State Circuits Conference, San Francisco, pp. 25-27 .
  7. Lichtsteiner, P., Kramer, J., Delbruck, T., 2004. Improved ON/OFF temporally differentiating address-event imager. In 11th IEEE International Conference on Electronics, Circuits and Systems, Tel Aviv, Israel.
  8. Moore, R., Lopes, J., 1999. Paper templates. In TEMPLATE'06, 1st International Conference on Template Production. INSTICC Press.
  9. Mahowald, M., 1992. VLSI analogs of neuronal visual processing: a synthesis of form and function, Ph.D. dissertation, California Institute of Technology.
  10. Mortara, A., 1998. A pulsed communication / computation framework for analog VLSI perceptive systems. In Neuromorphic Systems Engineering, T. S. Lande, Ed. Norwell, MA: Kluwer Academic, pp. 217-228.
  11. Sivilotti, M., 1991. Wiring considerations in analog VLSI systems, with application to field-programmable networks”, Ph.D. dissertation, California Institute of Technology.
  12. Zabih, R., Woodfill, J., 1994. Non-parametric Local Transforms for Computing Visual Correspondence. In Proceedings of 3rd European Conf. on Computer Vision, pp. 150-158.
Download


Paper Citation


in Harvard Style

Schraml S., Schön P. and Milosevic N. (2007). SMARTCAM FOR REAL-TIME STEREO VISION - Address-event Based Embedded System . In Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 978-972-8865-74-0, pages 466-471. DOI: 10.5220/0002057604660471


in Bibtex Style

@conference{visapp07,
author={Stephan Schraml and Peter Schön and Nenad Milosevic},
title={SMARTCAM FOR REAL-TIME STEREO VISION - Address-event Based Embedded System},
booktitle={Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2007},
pages={466-471},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002057604660471},
isbn={978-972-8865-74-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - SMARTCAM FOR REAL-TIME STEREO VISION - Address-event Based Embedded System
SN - 978-972-8865-74-0
AU - Schraml S.
AU - Schön P.
AU - Milosevic N.
PY - 2007
SP - 466
EP - 471
DO - 10.5220/0002057604660471