MERGE App: A Prototype Software for Multi-User Emotion-Aware Music Management

Pedro Louro, Guilherme Branco, Hugo Redinho, Ricardo Correia, Ricardo Malheiro, Ricardo Malheiro, Renato Panda, Renato Panda, Rui Paiva

2024

Abstract

We present a prototype software for multi-user music library management using the perceived emotional content of songs. The tool offers music playback features, song filtering by metadata, and automatic emotion prediction based on arousal and valence, with the possibility of personalizing the predictions by allowing each user to edit these values based on their own emotion assessment. This is an important feature for handling both classification errors and subjectivity issues, which are inherent aspects of emotion perception. A path-based playlist generation function is also implemented. A multi-modal audio-lyrics regression methodology is proposed for emotion prediction, with accompanying validation experiments on the MERGE dataset. The results obtained are promising, showing higher overall performance on train-validate-test splits (73.20% F1-score with the best dataset/split combination).

Paper Citation

in Harvard Style

Louro P., Branco G., Redinho H., Correia R., Malheiro R., Panda R. and Paiva R. (2024). MERGE App: A Prototype Software for Multi-User Emotion-Aware Music Management. In Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR; ISBN 978-989-758-716-0, SciTePress, pages 159-166. DOI: 10.5220/0013067800003838

in Bibtex Style

@conference{kdir24,
author={Pedro Louro and Guilherme Branco and Hugo Redinho and Ricardo Correia and Ricardo Malheiro and Renato Panda and Rui Paiva},
title={MERGE App: A Prototype Software for Multi-User Emotion-Aware Music Management},
booktitle={Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR},
year={2024},
pages={159-166},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013067800003838},
isbn={978-989-758-716-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KDIR
TI - MERGE App: A Prototype Software for Multi-User Emotion-Aware Music Management
SN - 978-989-758-716-0
AU - Louro P.
AU - Branco G.
AU - Redinho H.
AU - Correia R.
AU - Malheiro R.
AU - Panda R.
AU - Paiva R.
PY - 2024
SP - 159
EP - 166
DO - 10.5220/0013067800003838
PB - SciTePress