Novel Radar-based Gesture Recognition System using Optimized CNN-LSTM Deep Neural Network for Low-power Microcomputer Platform

Mateusz Chmurski, Mateusz Chmurski, Mariusz Zubert

2021

Abstract

The goal of the embedded hand gesture recognition based on a radar sensor is to improve a human-machine interface, while taking into consideration privacy issues of camera sensors. In addition, the system has to be deployable on a low-power microcomputer for the applicability in broadly defined IoT and smart home solutions. Currently available gesture sensing solutions are ineffective in terms of low-power consumption what prevents them from the deployment on the low-power microcomputers. Recent advances exhibit a potential of deep learning models for a gesture classification whereas they are still limited to high-performance hardware. Embedded microcomputers are constrained in terms of memory, CPU clock speed and GPU performance. These limitations imply a topology design problem that is addressed in this work. Moreover, this research project proposes an alternative signal processing approach – using the continuous wavelet transform, which enables us to see the distribution of frequencies formed by every gesture. The newly proposed neural network topology performs equally well compared to the state of the art neural networks, however it needs only 54.6% of memory and it needs 20% of time to perform inference relative to the state of the art models. This dedicated neural network architecture allows for the deployment on resource constrained microcomputers, thus enabling a human-machine interface implementation on the embedded devices. Our system achieved an overall accuracy of 95.05% on earlier unseen data.

Paper Citation

in Harvard Style

Chmurski M. and Zubert M. (2021). Novel Radar-based Gesture Recognition System using Optimized CNN-LSTM Deep Neural Network for Low-power Microcomputer Platform.In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-484-8, pages 882-890. DOI: 10.5220/0010258008820890

in Bibtex Style

@conference{icaart21,
author={Mateusz Chmurski and Mariusz Zubert},
title={Novel Radar-based Gesture Recognition System using Optimized CNN-LSTM Deep Neural Network for Low-power Microcomputer Platform},
booktitle={Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2021},
pages={882-890},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010258008820890},
isbn={978-989-758-484-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Novel Radar-based Gesture Recognition System using Optimized CNN-LSTM Deep Neural Network for Low-power Microcomputer Platform
SN - 978-989-758-484-8
AU - Chmurski M.
AU - Zubert M.
PY - 2021
SP - 882
EP - 890
DO - 10.5220/0010258008820890