Enhancing Time Series Classification with Self-Supervised Learning

Ali Ismail-Fawaz, Maxime Devanne, Jonathan Weber, Germain Forestier

2023

Abstract

Self-Supervised Learning (SSL) is a range of Machine Learning techniques having the objective to reduce the amount of labeled data required to train a model. In Deep Learning models, SSL is often implemented using specific loss functions relying on pretext tasks leveraging from unlabelled data. In this paper, we explore SSL for the specific task of Time Series Classification (TSC). In the last few years, dozens of Deep Learning architectures were proposed for TSC. However, they almost exclusively rely on the traditional training step involving only labeled data in sufficient numbers. In order to study the potential of SSL for TSC, we propose the TRIplet Loss In TimE (TRILITE) which relies on an existing triplet loss mechanism and which does not require labeled data. We explore two use cases. In the first one, we evaluate the interest of TRILITE to boost a supervised classifier when very few labeled data are available. In the second one, we study the use of TRILITE in the context of semi-supervised learning, when both labeled and unlabeled data are available. Experiments performed on 85 datasets from the UCR archive reveal interesting results on some datasets in both use cases.

Paper Citation

in Harvard Style

Ismail-Fawaz A., Devanne M., Weber J. and Forestier G. (2023). Enhancing Time Series Classification with Self-Supervised Learning. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-623-1, pages 40-47. DOI: 10.5220/0011611300003393

in Bibtex Style

@conference{icaart23,
author={Ali Ismail-Fawaz and Maxime Devanne and Jonathan Weber and Germain Forestier},
title={Enhancing Time Series Classification with Self-Supervised Learning},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2023},
pages={40-47},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011611300003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - Enhancing Time Series Classification with Self-Supervised Learning
SN - 978-989-758-623-1
AU - Ismail-Fawaz A.
AU - Devanne M.
AU - Weber J.
AU - Forestier G.
PY - 2023
SP - 40
EP - 47
DO - 10.5220/0011611300003393