Sentiment Classification using N-ary Tree-Structured Gated Recurrent Unit Networks

Vasileios Tsakalos, Roberto Henriques

2018

Abstract

Recurrent Neural Networks(RNN) is a good way of modeling sequences. However this type of Artificial Neural Networks(ANN) has two major drawbacks, it is not good at capturing long range connections and it is not robust at the vanishing gradient problem(Hochreiter, 1998). Luckily, there have been invented RNNs that can deal with these problems. Namely, Gated Recurrent Units(GRU) networks(Chung et al., 2014)(Gülçehre et al., 2013) and Long Short Term Memory(LSTM) networks(Hochreiter and Schmidhuber, 1997). Many problems in Natural Language Processing can be approximated with a sequence model. But, it is known that the syntactic rules of natural language have a recursive structure(Socher et al., 2011b). Therefore a Recursive Neural Network(Goller and Kuchler, 1996) can be a great alternative. Kai Sheng Tai (Tai et al., 2015) has come up with an architecture that gives the good properties of LSTM in a Recursive Neural Network. In this report, we will present another alternative of Recursive Neural Networks combined with GRU which performs very similar on binary and fine-grained Sentiment Classification (on Stanford Sentiment Treebank dataset) with N-ary Tree-Structured LSTM but is trained faster.

Paper Citation

in Harvard Style

Tsakalos V. and Henriques R. (2018). Sentiment Classification using N-ary Tree-Structured Gated Recurrent Unit Networks. In Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR; ISBN 978-989-758-330-8, SciTePress, pages 149-154. DOI: 10.5220/0006894201490154

in Bibtex Style

@conference{kdir18,
author={Vasileios Tsakalos and Roberto Henriques},
title={Sentiment Classification using N-ary Tree-Structured Gated Recurrent Unit Networks},
booktitle={Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR},
year={2018},
pages={149-154},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006894201490154},
isbn={978-989-758-330-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR
TI - Sentiment Classification using N-ary Tree-Structured Gated Recurrent Unit Networks
SN - 978-989-758-330-8
AU - Tsakalos V.
AU - Henriques R.
PY - 2018
SP - 149
EP - 154
DO - 10.5220/0006894201490154
PB - SciTePress