Multi-label Emotion Classification using Machine Learning and Deep Learning Methods

Drashti Kher, Kalpdrum Passi

2022

Abstract

Emotion detection in online social networks benefits many applications like personalized advertisement services, suggestion systems etc. Emotion can be identified from various sources like text, facial expressions, images, speeches, paintings, songs, etc. Emotion detection can be done by various techniques in machine learning. Traditional emotion detection techniques mainly focus on multi-class classification while ignoring the co-existence of multiple emotion labels in one instance. This research work is focussed on classifying multiple emotions from data to handle complex data with the help of different machine learning and deep learning methods. Before modeling, first data analysis is done and then the data is cleaned. Data preprocessing is performed in steps such as stop-words removal, tokenization, stemming and lemmatization, etc., which are performed using a Natural Language Processing toolkit (NLTK). All the input variables are converted into vectors by naive text encoding techniques like word2vec, Bag-of-words, and term frequency-inverse document frequency (TF-IDF). This research is implemented using python programming language. To solve multi-label emotion classification problem, machine learning, and deep learning methods were used. The evaluation parameters such as accuracy, precision, recall, and F1-score were used to evaluate the performance of the classifiers Naïve Bayes, support vector machine (SVM), Random Forest, K-nearest neighbour (KNN), GRU (Gated Recurrent Unit) based RNN (Recurrent Neural Network) with Adam optimizer and Rmsprop optimizer. GRU based RNN with Rmsprop optimizer achieves an accuracy of 82.3%, Naïve Bayes achieves highest precision of 0.80, Random Forest achieves highest recall score of 0.823, SVM achieves highest F1 score of 0.798 on the challenging SemEval2018 Task 1: E-c multi-label emotion classification dataset. Also, One-way Analysis of Variance (ANOVA) test was performed on the mean values of performance metrics (accuracy, precision, recall, and F1-score) on all the methods.

Paper Citation

in Harvard Style

Kher D. and Passi K. (2022). Multi-label Emotion Classification using Machine Learning and Deep Learning Methods. In Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-613-2, pages 128-135. DOI: 10.5220/0011532400003318

in Bibtex Style

@conference{webist22,
author={Drashti Kher and Kalpdrum Passi},
title={Multi-label Emotion Classification using Machine Learning and Deep Learning Methods},
booktitle={Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2022},
pages={128-135},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011532400003318},
isbn={978-989-758-613-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Multi-label Emotion Classification using Machine Learning and Deep Learning Methods
SN - 978-989-758-613-2
AU - Kher D.
AU - Passi K.
PY - 2022
SP - 128
EP - 135
DO - 10.5220/0011532400003318