Target-dependent Sentiment Analysis of Tweets using a Bi-directional Gated Recurrent Unit

Mohammed Jabreel, Antonio Moreno

2017

Abstract

Targeted sentiment analysis classifies the sentiment polarity towards a certain target in a given text. In this paper, we propose a target-dependent bidirectional gated recurrent unit (TD-biGRU) for target-dependent sentiment analysis of tweets. The proposed model has the ability to represent the interaction between the targets and their contexts. We have evaluated the effectiveness of the proposed model on a benchmark dataset from Twitter. The experiments show that our proposed model outperforms the state-of-the-are methods for target-dependent sentiment analysis.

References

  1. Bengio, Y., Ducharme, R., Vincent, P., and Jauvin, C. (2003). A neural probabilistic language model. journal of machine learning research, 3(Feb):1137-1155.
  2. Bengio, Y., Simard, P., and Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE transactions on neural networks, 5(2):157- 166.
  3. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning phrase representations using rnn encoderdecoder for statistical machine translation. arXiv preprint arXiv:1406.1078.
  4. Chollet, F. (2015). Keras. https://github.com/fchollet/keras.
  5. Hinton, G. E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv preprint arXiv:1207.0580.
  6. Jabreel, M. and Moreno, A. (2016). Sentirich: Sentiment analysis of tweets based on a rich set of features. In Artificial Intelligence Research and Development - Proceedings of the 19th International Conference of the Catalan Association for Artificial Intelligence, Barcelona, Catalonia, Spain, October 19-21, 2016, pages 137-146.
  7. Jiang, L., Yu, M., Zhou, M., Liu, X., and Zhao, T. (2011). Target-dependent twitter sentiment classification. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 151-160. Association for Computational Linguistics.
  8. Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882.
  9. Liu, B. (2011). Opinion mining and sentiment analysis. In Web Data Mining, pages 459-526. Springer.
  10. Liu, B. (2012). Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies, 5(1):1-167.
  11. Liu, P., Joty, S., and Meng, H. (2015). Fine-grained opinion mining with recurrent neural networks and word embeddings. In Conference on Empirical Methods in Natural Language Processing (EMNLP 2015).
  12. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
  13. Mohammad, S., Kiritchenko, S., and Zhu, X. (2013). NRCCanada: Building the State-of-the-Art in Sentiment Analysis of Tweets. In Proceedings of the seventh international workshop on Semantic Evaluation Exercises (SemEval-2013), Atlanta, Georgia, USA.
  14. Pang, B. and Lee, L. (2008). Opinion mining and sentiment analysis. Found. Trends Inf. Retr., 2(1-2):1-135.
  15. Pang, B., Lee, L., and Vaithyanathan, S. (2002). Thumbs Up?: Sentiment Classification Using Machine Learning Techniques. In Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing - Volume 10, EMNLP 7802, pages 79- 86, Stroudsburg, PA, USA. Association for Computational Linguistics.
  16. Pennington, J., Socher, R., and Manning, C. D. (2014). Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP), pages 1532-1543.
  17. Severyn, A. and Moschitti, A. (2015). UNITN: Training deep convolutional neural network for Twitter sentiment classification. In Proceedings of the 9th InSun, Y., Lin, L., Tang, D., Yang, N., Ji, Z., and Wang, X. (2015). Modeling mention, context and entity with neural networks for entity disambiguation. In Proceedings of the 24th International Conference on Artificial Intelligence , IJCAI'15, pages 1333-1339. AAAI Press.
  18. Tang, D., Qin, B., Feng, X., and Liu, T. (2015). Targetdependent sentiment classification with long short term memory. arXiv preprint arXiv:1512.01100.
  19. Tang, D., Wei, F., Qin, B., Liu, T., and Zhou, M. (2014a). Coooolll: A Deep Learning System for Twitter Sentiment Classification. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), pages 208-212, Dublin, Ireland. Association for Computational Linguistics and Dublin City University.
  20. Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., and Qin, B. (2014b). Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification. InProceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1555-1565, Baltimore, Maryland. Association for Computational Linguistics.
  21. Theano Development Team (2016). Theano: A Python framework for fast computation of mathematical expressions. arXiv e-prints, abs/1605.02688.
  22. Vo, D.-T. and Zhang, Y. (2015). Target-dependent twitter sentiment classification with rich automatic features. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), pages 1347-1353.
  23. Zhang, M., Zhang, Y., and Vo, D.-T. (2016). Gated neural networks for targeted sentiment analysis. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, Phoenix, Arizona, USA. Association for the Advancement of Artificial Intelligence .
Download


Paper Citation


in Harvard Style

Jabreel M. and Moreno A. (2017). Target-dependent Sentiment Analysis of Tweets using a Bi-directional Gated Recurrent Unit . In Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-246-2, pages 80-87. DOI: 10.5220/0006299900800087


in Bibtex Style

@conference{webist17,
author={Mohammed Jabreel and Antonio Moreno},
title={Target-dependent Sentiment Analysis of Tweets using a Bi-directional Gated Recurrent Unit},
booktitle={Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2017},
pages={80-87},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006299900800087},
isbn={978-989-758-246-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Target-dependent Sentiment Analysis of Tweets using a Bi-directional Gated Recurrent Unit
SN - 978-989-758-246-2
AU - Jabreel M.
AU - Moreno A.
PY - 2017
SP - 80
EP - 87
DO - 10.5220/0006299900800087