Authors:
Luís Silva
1
;
Ivan Gomes
1
;
C. Araújo
2
;
Tiago Cepeda
1
;
Francisco Oliveira
1
and
João Oliveira
1
Affiliations:
1
Department of Digital Transition, CITEVE, Centro Tecnológico das Indústrias Têxtil e do Vestuário de Portugal, V. N. Famalicão, Portugal
;
2
CMAT, Centro de Matemática and Departamento de Matemática, Universidade do Minho, Braga, Portugal
Keyword(s):
Visual Search, Deep Learning, Outfit, BiLSTM, CNN, Compatibility Learning, Similarity Learning, Transformer.
Abstract:
In the ever-evolving world of fashion, building the perfect outfit can be a challenge. We propose a fashion recommendation system, which we call Visual Search, that uses computer vision and deep learning to ensure that it has a co-ordinated set of fashion recommendations. It looks at photos of incomplete outfits, recognizes existing items, and suggests the most compatible missing piece. At the heart of our system lies a compatibility model made of a Convolutional Neural Network and bidirectional Long Short Term Memory to generate a complementary missing piece. To complete the recommendation process, we incorporated a similarity model, based on Vision Transformer. This model meticulously compares the generated image to the catalog items, selecting the one that most closely matches the generated image in terms of visual features.