Continuous Perception for Classifying Shapes and Weights of Garments for Robotic Vision Applications

Li Duan, Gerardo Aragon-Camarasa

2022

Abstract

We present an approach to continuous perception for robotic laundry tasks. Our assumption is that the visual prediction of a garment’s shapes and weights is possible via a neural network that learns the dynamic changes of garments from video sequences. Continuous perception is leveraged during training by inputting consecutive frames, of which the network learns how a garment deforms. To evaluate our hypothesis, we captured a dataset of 40K RGB and depth video sequences while a garment is being manipulated. We also conducted ablation studies to understand whether the neural network learns the physical properties of garments. Our findings suggest that a modified AlexNet-LSTM architecture has the best classification performance for the garment’s shapes and discretised weights. To further provide evidence for continuous perception, we evaluated our network on unseen video sequences and computed the ’Moving Average’ over a sequence of predictions. We found that our network has a classification accuracy of 48% and 60% for shapes and weights of garments, respectively.

Paper Citation

in Harvard Style

Duan L. and Aragon-Camarasa G. (2022). Continuous Perception for Classifying Shapes and Weights of Garments for Robotic Vision Applications. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 348-355. DOI: 10.5220/0010804300003124

in Bibtex Style

@conference{visapp22,
author={Li Duan and Gerardo Aragon-Camarasa},
title={Continuous Perception for Classifying Shapes and Weights of Garments for Robotic Vision Applications},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={348-355},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010804300003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - Continuous Perception for Classifying Shapes and Weights of Garments for Robotic Vision Applications
SN - 978-989-758-555-5
AU - Duan L.
AU - Aragon-Camarasa G.
PY - 2022
SP - 348
EP - 355
DO - 10.5220/0010804300003124
PB - SciTePress