High-speed Motion Detection using Event-based Sensing

Jose A. Boluda, Fernando Pardo, Francisco Vegara

2017

Abstract

Event-based vision emerges as an alternative to conventional full-frame image processing. In event-based systems there is a vision sensor which delivers visual events asynchronously, typically illumination level changes. The asynchronous nature of these sensors makes it difficult to process the corresponding data stream. It might be possible to have few events to process if there are minor changes in the scene, or conversely, to have an untreatable explosion of events if the whole scene is changing quickly. A Selective Change-Driven (SCD) sensing system is a special event-based sensor which only delivers, in a synchronous manner and ordered by the magnitude of its change, those pixels that have changed most since the last time they have been read-out. To prove this concept, a processing architecture for high-speed motion analysis, based on the processing of the SCD pixel stream has been developed and implemented into a Field Programmable Gate-Array (FPGA). The system measures average distances using a laser line projected into moving objects. The acquisition, processing and delivery of distance takes less than 2 us. To obtain a similar result using a conventional frame-based camera it would be required a device working at more than 500 Kfps, which is not practical in embedded and limited-resource systems. The implemented system is small enough to be mounted on an autonomous platform.

References

  1. Acosta, D., Garcia, O., and Aponte, J. (2006). Laser triangulation for shape acquisition in a 3d scanner plus scanner. In Ceballos, S., editor, CERMA2006: Electronics, Robotics and Automotive Mechanics Conference, Proceedings, pages 14-19. IEEE Computer Society. Electronics, Robotics and Automotive Mechanics Conference, Cuernavaca, MEXICO, SEP 26-29, 2006.
  2. Boluda, J. A., Pardo, F., and Vegara, F. (2016). A selective change driven system for high-speed motion analysis. Sensors, 16(11):1875:1-19.
  3. Camunas-Mesa, L., Zamarreno-Ramos, C., LinaresBarranco, A., Acosta-Jimenez, A. J., SerranoGotarredona, T., and Linares-Barranco, B. (2012). An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors. IEEE J. Solid-St. Circ., 47(2):504-517.
  4. Camunas-Mesa, L. A., Serrano-Gotarredona, T., and Linares-Barranco, B. (2014). Event-driven sensing and processing for high-speed robotic vision. In 2014 IEEE Biomedical Circuits and Systems Conference (BIOCAS), Biomedical Circuits and Systems Conference, pages 516-519. IEEE; IEEE Circuits & Syst Soc; Nano Tera; Medtronic Inc; gsk; Ecole Polytechnique Federale Lausanne; CSEM; IEEE Engn Med & Biol Soc.
  5. Gollisch, T. and Meister, M. (2008). Rapid neural coding in the retina with relative spike latencies. Science, 319(5866):1108-1111.
  6. Herculano-Houzel, S. (2009). The human brain in numbers: a linearly scaled-up primate brain. Front. Hum. Neurosci., 3.
  7. Khoshelham, K. and Elberink, S. O. (2012). Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors, 12(2):1437-1454.
  8. Liu, S.-C., Delbruck, T., Indiveri, G., Whatley, A., and Douglas, R. (2015). Event-Based Neuromorphic Systems. John Wiley & Sons Ltd., The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, England, United Kingdom.
  9. Mahowald, M. (1992). VLSI Analogs of neural visual processing: A synthesis of form and function. PhD thesis, Computer Science Divivision, California Institute of Technology, Pasadena, CA.
  10. Pardo, F., Boluda, J. A., and Vegara, F. (2015). Selective Change Driven Vision Sensor With ContinuousTime Logarithmic Photoreceptor and Winner-TakeAll Circuit for Pixel Selection. IEEE J. Solid-St. Circ., 50(3):786-798.
  11. Pardo, F., Zuccarello, P., Boluda, J. A., and Vegara, F. (2011). Advantages of selective change driven vision for resource-limited systems. special issue on video analysis on resource-limited systems. IEEE T. Circ. Syst. Vid., 21(10):1415-1423.
  12. van Schaik, A., Delbruck, T., and Hasler, J. (2015). Neuromorphic Engineering Systems and Applications. Frontiers in Neuroscience. Frontiers Media.
  13. Vincent, J. F. V. (2009). Biomimetics - a review. Proceedings of the Institution of Mechanical Engineers Part H-Journal of Engineering in Medicine, 223(H8):919- 939.
  14. Yousefzadeh, A., Serrano-Gotarredona, T., and LinaresBarranco, B. (2015). Fast pipeline 128x128 pixel spiking convolution core for event-driven vision processing in fpgas. In Event-based Control, Communication, and Signal Processing (EBCCSP), 2015 International Conference on, pages 1-8. IEEE.
  15. Zuccarello, P., Pardo, F., de la Plaza, A., and Boluda, J. A. (2010a). A 32×32 pixels vision sensor for selective change driven readout strategy. In Fringe Posters of the 36th European Sold-State Circuits Confernece (ESSCIRC 2010).
  16. Zuccarello, P., Pardo, F., de la Plaza, A., and Boluda, J. A. (2010b). 32×32 winner-take-all matrix with single winner selection. Electron. Lett., 46(5):333-335.
Download


Paper Citation


in Harvard Style

Boluda J., Pardo F. and Vegara F. (2017). High-speed Motion Detection using Event-based Sensing . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 246-253. DOI: 10.5220/0006183902460253


in Bibtex Style

@conference{visapp17,
author={Jose A. Boluda and Fernando Pardo and Francisco Vegara},
title={High-speed Motion Detection using Event-based Sensing},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={246-253},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006183902460253},
isbn={978-989-758-225-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - High-speed Motion Detection using Event-based Sensing
SN - 978-989-758-225-7
AU - Boluda J.
AU - Pardo F.
AU - Vegara F.
PY - 2017
SP - 246
EP - 253
DO - 10.5220/0006183902460253