A Classifier Ensemble Approach to Detect Emotions Polarity in Social Media

Isidoros Perikos, Ioannis Hatzilygeroudis

2016

Abstract

The advent of social media has changed completely the role of the users and has transformed them from simple passive information seekers to active producers. The user generated textual data in social media and microblogging platforms are rich in emotions, opinions and attitudes and necessitate automated methods to analyse and extract knowledge from them. In this paper, we present a classifier ensemble approach to detect emotional content in social media and examine its performance under bagging and boosting combination methods. The classifier ensemble aims to take advantage of the base classifiers’ benefits and constitutes a promising approach to detect sentiments in social media. Our classifier ensemble combines a knowledge based tool that performs deep analysis of the natural language and two machine learning classifiers, a Naïve Bayes and a Maximum Entropy which are trained on ISEAR and Affective text datasets. The evaluation study conducted revealed quite promising results and indicates that the ensemble classifier approach can improve the performance of sole classifiers on emotion detection in Twitter and that the boosting seems to be more suitable and to perform better than bagging.

References

  1. Augustyniak, L., Kajdanowicz, T., Szymanski, P., Tuliglowicz, W., Kazienko, P., Alhajj, R., & Szymanski, B., 2014. Simpler is better? Lexicon-based ensemble sentiment classification beats supervised methods. In Advances in Social Networks Analysis and Mining (ASONAM), 2014 IEEE/ACM International Conference on (pp. 924-929). IEEE.
  2. Bollen, J., Mao, H., & Zeng, X., 2011. Twitter mood predicts the stock market. Journal of Computational Science, 2(1), 1-8.
  3. Cambria, E., Schuller, B., Xia, Y., & Havasi, C., 2013. New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems, 28(2), 15-21.
  4. da Silva, N. F., Hruschka, E. R., & Hruschka, E. R. ,2014. Tweet sentiment analysis with classifier ensembles. Decision Support Systems, 66, 170-179.
  5. Devi, K. L., Subathra, P., & Kumar, P. N., 2015. Tweet Sentiment Classification Using an Ensemble of Machine Learning Supervised Classifiers Employing Statistical Feature Selection Methods. In Proceedings of the Fifth International Conference on Fuzzy and Neuro Computing (FANCCO-2015), pp. 1-13. Springer International Publishing.
  6. Dietterich, T. G., 2000. Ensemble methods in machine learning, Proceedings of the First International Workshop on Multiple Classifier Systems, MCS'00, Springer-Verlag, London, UK, 2000, 1-15.
  7. Ekman, P., 1999. Basic emotions. Handbook of cognition and emotion, 45-60.
  8. Fersini, E., Messina, E., & Pozzi, F. A., 2014. Sentiment analysis: Bayesian Ensemble Learning. Decision Support Systems, 68, 26-38.
  9. Firmino Alves, A. L., Baptista, C. D. S., Firmino, A. A., Oliveira, M. G. D., & Paiva, A. C. D., 2014. A Comparison of SVM Versus Naive-Bayes Techniques for Sentiment Analysis in Tweets: A Case Study with the 2013 FIFA Confederations Cup. In Proceedings of the 20th Brazilian Symposium on Multimedia and the Web (pp. 123-130). ACM.
  10. Go, A., R. Bhayani, and L. Huang. 2009. Twitter sentiment classification using distant supervision. Technical report, Stanford Digital Library Technologies Project.
  11. Li, S., Zong, C., & Wang, X., 2007. Sentiment classification through combining classifiers with multiple feature sets. In Natural Language Processing and Knowledge Engineering, 2007. NLP-KE 2007. International Conference on 135-140, IEEE.
  12. Liu, B., 2015. Sentiment Analysis: Mining Opinions, Sentiments, and Emotions. Cambridge University Press.
  13. Medhat, W., Hassan, A., & Korashy, H., 2014. Sentiment analysis algorithms and applications: A survey. Ain Shams Engineering Journal, 5(4), 1093-1113.
  14. Nigam, K., Lafferty, J., & McCallum, A., 1999. Using maximum entropy for text classification. In IJCAI-99 workshop on machine learning for information filtering, Vol. 1, 61-67.
  15. Pang, B., & Lee, L., 2008. Opinion mining and sentiment analysis. Foundations and trends in information retrieval, 2(1-2), 1-135.
  16. Parrott, W. G., 2001. Emotions in social psychology: Essential readings. Psychology Press.
  17. Perikos, I., & Hatzilygeroudis, I., 2013, Recognizing emotion presence in natural language sentences. Engineering Applications of Neural Networks. Springer Berlin Heidelberg, 2013. 30-39.
  18. Perikos, I., & Hatzilygeroudis, I., 2016, Recognizing emotions in text using ensemble of classifiers, Engineering Applications of Artificial Intelligence.
  19. Qiu, L., Lin, H., Ramsay, J. and Yang, F., 2012. You Are What You Tweet: Personality Expression and Perception on Twitter. Journal of Research in Personality, Vol. 46, Issue 6, 710-718.
  20. Ravi, K., & Ravi, V., 2015. A survey on opinion mining and sentiment analysis: Tasks, approaches and applications. Knowledge-Based Systems, 89, 14-46.
  21. Russell, J. A., 1980. A circumplex model of affect. Journal of personality and social psychology, 39(6), 1161.
  22. Schapire, R. E., 1999. A brief introduction to boosting. In Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence (IJCAI), Vol. 99, pp. 1401-1406.
  23. Scherer, K. R., & Wallbott, H. G., 1994. Evidence for universality and cultural variation of differential emotion response patterning. Journal of personality and social psychology, 66(2), 310.
  24. Shaheen, S., El-Hajj, W., Hajj, H., & Elbassuoni, S., 2014. Emotion Recognition from Text Based on Automatically Generated Rules. In Data Mining Workshop (ICDMW), 2014 IEEE International Conference on, pp. 383-392. IEEE.
  25. Strapparava, C., & Mihalcea, R., 2007. Semeval-2007 task 14: Affective text. In Proceedings of the 4th International Workshop on Semantic Evaluations, 70- 74, Association for Computational Linguistics.
  26. Wang, G., Sun, J., Ma, J., Xu, K., & Gu, J., 2014. Sentiment classification: The contribution of ensemble learning. Decision support systems, 57, 77-93.
  27. Wang, Y., & Pal, A., 2015. Detecting Emotions in Social Media: A Constrained Optimization Approach. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), 996-1002.
  28. Whitehead, M., & Yaeger, L. 2010. Sentiment mining using ensemble classification models. In Innovations and advances in computer sciences and engineering (pp. 509-514). Springer Netherlands.
  29. Xia, R., Zong, C., & Li, S., 2011. Ensemble of feature sets and classification algorithms for sentiment classification. Information Sciences, 181(6), 1138-1152.
Download


Paper Citation


in Harvard Style

Perikos I. and Hatzilygeroudis I. (2016). A Classifier Ensemble Approach to Detect Emotions Polarity in Social Media . In Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 1: SRIS, (WEBIST 2016) ISBN 978-989-758-186-1, pages 363-370. DOI: 10.5220/0005864503630370


in Bibtex Style

@conference{sris16,
author={Isidoros Perikos and Ioannis Hatzilygeroudis},
title={A Classifier Ensemble Approach to Detect Emotions Polarity in Social Media},
booktitle={Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 1: SRIS, (WEBIST 2016)},
year={2016},
pages={363-370},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005864503630370},
isbn={978-989-758-186-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 1: SRIS, (WEBIST 2016)
TI - A Classifier Ensemble Approach to Detect Emotions Polarity in Social Media
SN - 978-989-758-186-1
AU - Perikos I.
AU - Hatzilygeroudis I.
PY - 2016
SP - 363
EP - 370
DO - 10.5220/0005864503630370