Mixed Software/Hardware based Neural Network Learning Acceleration

Abdelkader Ghis, Abdelkader Ghis, Kamel Smiri, Kamel Smiri, Abderezzak Jemai

2021

Abstract

Neural Network Learning is a persistent optimization problem due to its complexity and its size that increase considerably with system size. Different optimization approaches has been introduced to overcome the memory occupation and time consumption of neural networks learning. However, with the development of modern systems that are more and more scalable with a complex nature, the existing solutions in literature need to be updated to respond to the recent changes in modern systems. For this reason, we propose a mixed software/hardware optimization approach for neural network learning acceleration. The proposed approach combines software improvement and hardware distribution where data are partitioned in a way that avoid the problem of local convergence. The weights are updated in a manner that overcome the latency problem and learning process is distributed over multiple processing units to minimize time consumption. The proposed approach is tested and validated by exhaustive simulations.

Paper Citation

in Harvard Style

Ghis A., Smiri K. and Jemai A. (2021). Mixed Software/Hardware based Neural Network Learning Acceleration. In Proceedings of the 16th International Conference on Software Technologies - Volume 1: ICSOFT, ISBN 978-989-758-523-4, pages 417-425. DOI: 10.5220/0010606104170425

in Bibtex Style

@conference{icsoft21,
author={Abdelkader Ghis and Kamel Smiri and Abderezzak Jemai},
title={Mixed Software/Hardware based Neural Network Learning Acceleration},
booktitle={Proceedings of the 16th International Conference on Software Technologies - Volume 1: ICSOFT,},
year={2021},
pages={417-425},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010606104170425},
isbn={978-989-758-523-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Software Technologies - Volume 1: ICSOFT,
TI - Mixed Software/Hardware based Neural Network Learning Acceleration
SN - 978-989-758-523-4
AU - Ghis A.
AU - Smiri K.
AU - Jemai A.
PY - 2021
SP - 417
EP - 425
DO - 10.5220/0010606104170425