VersaTL: Versatile Transfer Learning for IMU-based Activity Recognition using Convolutional Neural Networks

Mubarak Abdu-Aguye, Walid Gomaa

2019

Abstract

The advent of Deep Learning has, together with massive gains in predictive accuracy, made it possible to reuse knowledge learnt from solving one problem in solving related problems. This is described as Transfer Learning, and has seen wide adoption especially in computer vision problems, where Convolutional Neural Networks have shown great flexibility and performance. On the other hand, transfer learning for sequences or timeseries data is typically made possible through the use of recurrent neural networks, which are difficult to train and prone to overfitting. In this work we present VersaTL, a novel approach to transfer learning for fixed and variable-length activity recognition timeseries data. We train a Convolutional Neural Network and use its convolutional filters as a feature extractor, then subsequently train a feedforward neural network as a classifier over the extracted features for other datasets. Our experiments on five different activity recognition datasets show the promise of this method, yielding results typically within 5% of trained-from-scratch networks while obtaining between a 24-52x reduction in the training time.

Paper Citation

in Harvard Style

Abdu-Aguye M. and Gomaa W. (2019). VersaTL: Versatile Transfer Learning for IMU-based Activity Recognition using Convolutional Neural Networks.In Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-380-3, pages 507-516. DOI: 10.5220/0007916705070516

in Bibtex Style

@conference{icinco19,
author={Mubarak Abdu-Aguye and Walid Gomaa},
title={VersaTL: Versatile Transfer Learning for IMU-based Activity Recognition using Convolutional Neural Networks},
booktitle={Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2019},
pages={507-516},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007916705070516},
isbn={978-989-758-380-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - VersaTL: Versatile Transfer Learning for IMU-based Activity Recognition using Convolutional Neural Networks
SN - 978-989-758-380-3
AU - Abdu-Aguye M.
AU - Gomaa W.
PY - 2019
SP - 507
EP - 516
DO - 10.5220/0007916705070516