Taxi Demand Prediction based on LSTM with Residuals and Multi-head Attention

Chih-Jung Hsu, Hung-Hsuan Chen

2020

Abstract

This paper presents a simple yet effective framework to accurately predict the taxi demands of different regions in a city in the near future. This framework is based on a deep-learning structure with residual connections in the LSTM layers and the attention mechanism. We found that adding residuals accelerates optimization and that adding the attention mechanism makes the model better predict the taxi demands, especially when the demand fluctuates greatly in the peak hours and off-peak hours. We conducted extensive experiments by comparing the proposed models to the time-series model (ARIMA), traditional supervised learning model (ridge regression), strong machine learning model that won many Kaggle competitions (Gradient Boosted Decision Tree implemented in the XGBoost library), and deep learning models (LSTM and DMVST-Net) on two real and open-source datasets. Experimental results show that the proposed models outperform the baselines for most cases. We believe the greatest improvement comes from the attention mechanism, which helps distinguish the demands in the peak hours and off-peak hours. Additionally, the proposed model runs 10% to 40%-times faster than the other deep-learning-based models. We applied the models to participate in a taxi demand prediction challenge and won second place out of hundreds of teams.

Paper Citation

in Harvard Style

Hsu C. and Chen H. (2020). Taxi Demand Prediction based on LSTM with Residuals and Multi-head Attention.In Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS, ISBN 978-989-758-419-0, pages 268-275. DOI: 10.5220/0009562002680275

in Bibtex Style

@conference{vehits20,
author={Chih-Jung Hsu and Hung-Hsuan Chen},
title={Taxi Demand Prediction based on LSTM with Residuals and Multi-head Attention},
booktitle={Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,},
year={2020},
pages={268-275},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009562002680275},
isbn={978-989-758-419-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 6th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,
TI - Taxi Demand Prediction based on LSTM with Residuals and Multi-head Attention
SN - 978-989-758-419-0
AU - Hsu C.
AU - Chen H.
PY - 2020
SP - 268
EP - 275
DO - 10.5220/0009562002680275