Movement Control with Vehicle-to-Vehicle Communication by using End-to-End Deep Learning for Autonomous Driving

Zelin Zhang, Jun Ohya

2021

Abstract

In recent years, autonomous driving through deep learning has gained more and more attention. This paper proposes a novel Vehicle-to-Vehicle (V2V) communication based autonomous vehicle driving system that takes advantage of both spatial and temporal information. The proposed system consists of a novel combination of CNN layers and LSTM layers for controlling steering angle and speed by taking advantage of the information from both the autonomous vehicle and cooperative vehicle. The CNN layers process the input sequential image frames, and the LSTM layers process historical data to predict the steering angle and speed of the autonomous vehicle. To confirm the validity of the proposed system, we conducted experiments for evaluating the MSE of the steering angle and vehicle speed using the Udacity dataset. Experimental results are summarized as follows. (1) “with a cooperative car” significantly works better than “without”. (2) Among all the network, the Res-Net performs the best. (3) Utilizing the LSTM with Res-Net, which processes the historical motion data, performs better than “no LSTM”. (4) As the number of inputted sequential frames, eight frames turn out to work best. (5) As the distance between the autonomous host and cooperative vehicle, ten to forty meters turn out to achieve the robust result on the autonomous driving movement control.

Paper Citation

in Harvard Style

Zhang Z. and Ohya J. (2021). Movement Control with Vehicle-to-Vehicle Communication by using End-to-End Deep Learning for Autonomous Driving.In Proceedings of the 10th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-486-2, pages 377-385. DOI: 10.5220/0010235703770385

in Bibtex Style

@conference{icpram21,
author={Zelin Zhang and Jun Ohya},
title={Movement Control with Vehicle-to-Vehicle Communication by using End-to-End Deep Learning for Autonomous Driving},
booktitle={Proceedings of the 10th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2021},
pages={377-385},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010235703770385},
isbn={978-989-758-486-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 10th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Movement Control with Vehicle-to-Vehicle Communication by using End-to-End Deep Learning for Autonomous Driving
SN - 978-989-758-486-2
AU - Zhang Z.
AU - Ohya J.
PY - 2021
SP - 377
EP - 385
DO - 10.5220/0010235703770385