Accelerating Deep Learning Model Training on Cloud Tensor Processing Unit

Cristiano Künas, Edson Padoin, Philippe Navaux

2023

Abstract

Deep learning techniques have grown rapidly in recent years due to their success in image classification, speech recognition, and natural language understanding. These techniques have the potential to solve complex problems and are being applied in various fields, such as agriculture, medicine, and administration. However, training large and complex models requires high-performance computational platforms, making accelerator hardware an essential tool and driving up its cost. An alternative solution is to use cloud computing, where users only pay for usage and have access to a wide range of computing resources and services. In this paper, we adapt a Diabetic Retinopathy neural network model for TPU-based training in the cloud and observe promising results, including reduced training time without code optimization. This demonstrates the potential of cloud computing in reducing the burden on local systems that are often overwhelmed by multiple running applications. This allows for training larger and more advanced models at a lower cost than local computational centers.

Paper Citation

in Harvard Style

Künas C., Padoin E. and Navaux P. (2023). Accelerating Deep Learning Model Training on Cloud Tensor Processing Unit. In Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-650-7, SciTePress, pages 316-323. DOI: 10.5220/0012017300003488

in Bibtex Style

@conference{closer23,
author={Cristiano Künas and Edson Padoin and Philippe Navaux},
title={Accelerating Deep Learning Model Training on Cloud Tensor Processing Unit},
booktitle={Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2023},
pages={316-323},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012017300003488},
isbn={978-989-758-650-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Accelerating Deep Learning Model Training on Cloud Tensor Processing Unit
SN - 978-989-758-650-7
AU - Künas C.
AU - Padoin E.
AU - Navaux P.
PY - 2023
SP - 316
EP - 323
DO - 10.5220/0012017300003488
PB - SciTePress