Cross-domain & In-domain Sentiment Analysis with Memory-based Deep Neural Networks

Gianluca Moro, Andrea Pagliarani, Roberto Pasolini, Claudio Sartori

2018

Abstract

Cross-domain sentiment classifiers aim to predict the polarity, namely the sentiment orientation of target text documents, by reusing a knowledge model learned from a different source domain. Distinct domains are typically heterogeneous in language, so that transfer learning techniques are advisable to support knowledge transfer from source to target. Distributed word representations are able to capture hidden word relationships without supervision, even across domains. Deep neural networks with memory (MemDNN) have recently achieved the state-of-the-art performance in several NLP tasks, including cross-domain sentiment classification of large-scale data. The contribution of this work is the massive experimentations of novel outstanding MemDNN architectures, such as Gated Recurrent Unit (GRU) and Differentiable Neural Computer (DNC) both in cross-domain and in-domain sentiment classification by using the GloVe word embeddings. As far as we know, only GRU neural networks have been applied in cross-domain sentiment classification. Sentiment classifiers based on these deep learning architectures are also assessed from the viewpoint of scalability and accuracy by gradually increasing the training set size, and showing also the effect of fine-tuning, an explicit transfer learning mechanism, on cross-domain tasks. This work shows that MemDNN based classifiers improve the state-of-the-art on Amazon Reviews corpus with reference to document-level cross-domain sentiment classification. On the same corpus, DNC outperforms previous approaches in the analysis of a very large in-domain configuration in both binary and fine-grained document sentiment classification. Finally, DNC achieves accuracy comparable with the state-of-the-art approaches on the Stanford Sentiment Treebank dataset in both binary and fine-grained single-sentence sentiment classification.

Paper Citation

in Harvard Style

Moro G., Pagliarani A., Pasolini R. and Sartori C. (2018). Cross-domain & In-domain Sentiment Analysis with Memory-based Deep Neural Networks. In Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR; ISBN 978-989-758-330-8, SciTePress, pages 127-138. DOI: 10.5220/0007239101270138

in Bibtex Style

@conference{kdir18,
author={Gianluca Moro and Andrea Pagliarani and Roberto Pasolini and Claudio Sartori},
title={Cross-domain & In-domain Sentiment Analysis with Memory-based Deep Neural Networks},
booktitle={Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR},
year={2018},
pages={127-138},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007239101270138},
isbn={978-989-758-330-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 10th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2018) - Volume 1: KDIR
TI - Cross-domain & In-domain Sentiment Analysis with Memory-based Deep Neural Networks
SN - 978-989-758-330-8
AU - Moro G.
AU - Pagliarani A.
AU - Pasolini R.
AU - Sartori C.
PY - 2018
SP - 127
EP - 138
DO - 10.5220/0007239101270138
PB - SciTePress