ROAD INTERPRETATION FOR DRIVER ASSISTANCE BASED ON AN EARLY COGNITIVE VISION SYSTEM

Emre Başeski, Lars Baunegaard With Jensen, Nicolas Pugeault, Florian Pilz, Karl Pauwels, Marc M. Van Hulle, Florentin Wörgötter, Norbert Krüger

Abstract

In this work, we address the problem of road interpretation for driver assistance based on an early cognitive vision system. The structure of a road and the relevant traffic are interpreted in terms of ego-motion estimation of the car, independently moving objects on the road, lane markers and large scale maps of the road. We make use of temporal and spatial disambiguation mechanisms to increase the reliability of visually extracted 2D and 3D information. This information is then used to interpret the layout of the road by using lane markers that are detected via Bayesian reasoning. We also estimate the ego-motion of the car which is used to create large scale maps of the road and also to detect independently moving objects. Sample results for the presented algorithms are shown on a stereo image sequence, that has been collected from a structured road.

References

  1. Bas¸eski, E., Pugeault, N., Kalkan, S., Kraft, D., Wö rgö tter, F., and Krüger, N. (2007). A Scene Representation Based on Multi-Modal 2D and 3D Features. ICCV 2007 Workshop on 3D Representation for Recognition 3dRR-07.
  2. Bertozzi, M. and Broggi, A. (1998). GOLD: A Parallel Real-Time Stereo Vision System for Generic Obstacle and Lane Detection. Image Processing, IEEE Transactions on, 7(1):62-81.
  3. Bertozzi, M., Broggi, A., and Fascioli, A. (2000). Visionbased Intelligent Vehicles: State of the Art and Perspectives.
  4. Faugeras, O. (1993). Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press.
  5. Fischler, R. and Bolles, M. (1981). Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM, 24(6):619-638.
  6. Gordon, N., Salmond, D., and Smith, A. (1993). Novel Approach to nonlinear/non-Gaussian Bayesian State Estimation. In IEE Proceedings-F, volume 140, pages 107-113.
  7. Hermann, S. and Klette, R. (2008). A Study on Parameterization and Preprocessing for Semi-Global Matching. Technical Report Number 221, Computer-Science Department of The University of Auckland, CITR.
  8. Jensen, L. B. W., Kjaer-Nielsen, A., Alonso, J. D., Ros, E., and Krüger, N. (2008). A Hybrid FPGA/Coarse Parallel Processing Architecture for Multi-modal Visual Feature Descriptors. ReConFig'08.
  9. Klette, R. (2008). Stereo-Vision-Support for Intelligent Vehicles - The Need for Quantified Evidence. Technical Report Number 226, Computer-Science Department of The University of Auckland, CITR.
  10. Krüger, N., Lappe, M., and Wörgötter, F. (2004). Biologically Motivated Multi-modal Processing of Visual Primitives. The Interdisciplinary Journal of Artificial Intelligence and the Simulation of Behaviour, 1(5):417-428.
  11. Leibe, B., Cornelis, N., Cornelis, K., and Van Gool, L. (2007). Dynamic 3D Scene Analysis from a Moving Vehicle. Computer Vision and Pattern Recognition, 2007. CVPR 7807. IEEE Conference on, pages 1-8.
  12. Lemaire, T., Berger, C., Jung, I.-K., and Lacroix, S. (2007). Vision-Based SLAM: Stereo and Monocular Approaches. International Journal of Computer Vision, 74(3):343-364.
  13. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. International Journal of Computer Vision, 2(60):91-110.
  14. McCall, J. and Trivedi, M. (2004). An Integrated, Robust Approach to Lane Marking Detection and Lane Tracking. pages 533-537.
  15. Pauwels, K. (2008). Computational Modeling of Visual Attention:Neuronal Response Modulation in the Thalamocortical Complex and Saliency-based Detection of Independent Motion. PhD thesis, K.U.Leuven.
  16. Pauwels, K. and Van Hulle, M. M. (2008). Optic Flow from Unstable Sequences through Local Velocity Constancy Maximization. Image and Vision Computing, page in press.
  17. Piegl, L. and Tiller, W. (1995). The NURBS Book. SpringerVerlag, London, UK.
  18. Pugeault, N., Wörgötter, F., and Krüger, N. (2006). Multimodal Scene Reconstruction Using Perceptual Grouping Constraints. In Proc. IEEE Workshop on Perceptual Organization in Computer Vision (in conjunction with CVPR'06).
  19. Pugeault, N., Wörgötter, F., and Krüger, N. (2008). Accumulated Visual Representation for Cognitive Vision. In Proceedings of the British Machine Vision Conference (BMVC).
  20. Rosenhahn, B., Krüger, N., Rabsch, T., and Sommer, G. (2001). Automatic tracking with a novel pose estimation algorithm. Robot Vision 2001.
  21. Wang, Y., Teoh, E., and Shen, D. (2004). Lane Detection and Tracking Using B-Snake. 22(4):269-280.
Download


Paper Citation


in Harvard Style

Başeski E., Baunegaard With Jensen L., Pugeault N., Pilz F., Pauwels K., M. Van Hulle M., Wörgötter F. and Krüger N. (2009). ROAD INTERPRETATION FOR DRIVER ASSISTANCE BASED ON AN EARLY COGNITIVE VISION SYSTEM . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 496-505. DOI: 10.5220/0001796104960505


in Bibtex Style

@conference{visapp09,
author={Emre Başeski and Lars Baunegaard With Jensen and Nicolas Pugeault and Florian Pilz and Karl Pauwels and Marc M. Van Hulle and Florentin Wörgötter and Norbert Krüger},
title={ROAD INTERPRETATION FOR DRIVER ASSISTANCE BASED ON AN EARLY COGNITIVE VISION SYSTEM},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={496-505},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001796104960505},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - ROAD INTERPRETATION FOR DRIVER ASSISTANCE BASED ON AN EARLY COGNITIVE VISION SYSTEM
SN - 978-989-8111-69-2
AU - Başeski E.
AU - Baunegaard With Jensen L.
AU - Pugeault N.
AU - Pilz F.
AU - Pauwels K.
AU - M. Van Hulle M.
AU - Wörgötter F.
AU - Krüger N.
PY - 2009
SP - 496
EP - 505
DO - 10.5220/0001796104960505