Machine Learning based Video Processing for Real-time Near-Miss Detection

Xiaohui Huang, Tania Banerjee, Ke Chen, Naga Varanasi, Anand Rangarajan, Sanjay Ranka

2020

Abstract

Video-based sensors are ubiquitous and are therefore indispensable in understanding traffic behavior at intersections. Deriving near-misses from large scale video processing is extremely useful in assessing the level of safety of intersections. In this paper, we develop real-time or near real-time algorithms for detecting near-misses for intersection video collected using fisheye cameras. We propose a novel method consisting of the following steps: 1) extracting objects and multiple object tracking features using convolutional neural networks; 2) densely mapping object coordinates to an overhead map; 3) learning to detect near-misses by new distance measures and temporal motion. The experimental results demonstrate the effectiveness of our approach with real-time performance at 40 fps and high specificity.

Paper Citation

in Harvard Style

Huang X., Banerjee T., Chen K., Varanasi N., Rangarajan A. and Ranka S. (2020). Machine Learning based Video Processing for Real-time Near-Miss Detection.In Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS, ISBN 978-989-758-419-0, pages 169-179. DOI: 10.5220/0009345401690179

in Bibtex Style

@conference{vehits20,
author={Xiaohui Huang and Tania Banerjee and Ke Chen and Naga Varanasi and Anand Rangarajan and Sanjay Ranka},
title={Machine Learning based Video Processing for Real-time Near-Miss Detection},
booktitle={Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,},
year={2020},
pages={169-179},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009345401690179},
isbn={978-989-758-419-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,
TI - Machine Learning based Video Processing for Real-time Near-Miss Detection
SN - 978-989-758-419-0
AU - Huang X.
AU - Banerjee T.
AU - Chen K.
AU - Varanasi N.
AU - Rangarajan A.
AU - Ranka S.
PY - 2020
SP - 169
EP - 179
DO - 10.5220/0009345401690179