Raindrop Removal in a Vehicle Camera Video Considering the Temporal Consistency for Driving Support

Hiroki Inoue, Keisuke Doman, Jun Adachi, Yoshito Mekada

2020

Abstract

This paper proposes a recursive framework for raindrop removal in a vehicle camera video considering the temporal consistency. Raindrops attached to a vehicle camera lens may prevent a driver or a camera-based system from recognizing the traffic environment. This research aims to develop a framework for raindrop detection and removal in order to deal with such a situation. The proposed method sequentially and recursively restores a video containing no raindrops from original one that may contain raindrops. The proposed method uses an output (restored) image as one of the input frames for the next image restoration process in order to improve the restoration quality, which is the key concept of the proposed framework. In each restoration process, the proposed method first detects raindrops in each input video frame, and then restores the raindrop regions based on the optical flow. The optical flow can be calculated in the outer part of the raindrop region more accurately than the inner part due to the difficulty of finding a corresponding pixel, which is the assumption for designing the proposed method. We confirmed that the proposed framework has the potential for improving the restoration accuracy through several preliminary experiments and evaluation experiments.

Paper Citation

in Harvard Style

Inoue H., Doman K., Adachi J. and Mekada Y. (2020). Raindrop Removal in a Vehicle Camera Video Considering the Temporal Consistency for Driving Support. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 429-436. DOI: 10.5220/0009106504290436

in Bibtex Style

@conference{visapp20,
author={Hiroki Inoue and Keisuke Doman and Jun Adachi and Yoshito Mekada},
title={Raindrop Removal in a Vehicle Camera Video Considering the Temporal Consistency for Driving Support},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP},
year={2020},
pages={429-436},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009106504290436},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 4: VISAPP
TI - Raindrop Removal in a Vehicle Camera Video Considering the Temporal Consistency for Driving Support
SN - 978-989-758-402-2
AU - Inoue H.
AU - Doman K.
AU - Adachi J.
AU - Mekada Y.
PY - 2020
SP - 429
EP - 436
DO - 10.5220/0009106504290436
PB - SciTePress