Context-Specific Sentiment Lexicon Expansion via Minimal User Interaction

Raheleh Makki, Stephen Brooks, Evangelos E. Milios

Abstract

One of the important factors in the performance of sentiment analysis methods is having a comprehensive sentiment lexicon. However, since sentiment words have different polarities not only in different domains, but also in different contexts within the same domain, constructing such context-specific sentiment lexicons is not an easy task. The high costs of manually constructing such lexicons motivate researchers to create automatic methods for finding sentiment words and assigning their polarities. However, existing methods may encounter ambiguous cases with contradictory evidence which are hard to automatically resolve. To address this problem, we aim to engage the user in the process of polarity assignment and improve the quality of the generated lexicon via minimal user effort. A novel visualization is employed to present the results of the automatic algorithm, i.e., the extracted sentiment pairs along with their polarities. User interactions are provided to facilitate the supervision process. The results of our user study demonstrate (1) involving the user in the polarity assignment process improves the quality of the generated lexicon significantly, and (2) participants in the study preferred our visual interface and conveyed that it is easier to use compared to a text-based interface.

References

  1. Annett, M. and Kondrak, G. (2008). A Comparison of Sentiment Analysis Techniques: Polarizing Movie Blogs. In Proceedings of the CSCSI, pages 25-35.
  2. Choi, Y. and Cardie, C. (2009). Adapting a Polarity Lexicon Using Integer Linear Programming for DomainSpecific Sentiment Classification. In Proceedings of the 2009 Conf. on EMNLP: Volume 2, pages 590-598.
  3. Ding, X., Liu, B., and Yu, P. S. (2008). A Holistic LexiconBased Approach to Opinion Mining. In Proceedings of the 2008 WSDM, pages 231-240. ACM.
  4. Esuli, A. and Sebastiani, F. (2006). Sentiwordnet: A Publicly Available Lexical Resource for Opinion Mining. In In Proceedings of LREC, pages 417-422.
  5. Gambette, P. and Veronis, J. (2010). Visualizing a Text with a Tree Cloud. Studies in Classification, Data Analysis, and Knowledge Organization, Part 3, pages 561-569.
  6. Gregory, M. L., Chinchor, N., Whitney, P., Carter, R., Hetzler, E., and Turner, A. (2006). User-Directed Sentiment Analysis: Visualizing the Affective Content of Documents. In Proceedings of the Workshop on Sentiment and Subjectivity in Text, pages 23-30. ACL.
  7. Hu, M. and Liu, B. (2004). Mining and Summarizing Customer Reviews. In Proceedings of the Tenth ACM SIGKDD Int. Conf. on KDD, pages 168-177.
  8. Husaini, M., Koc¸yig?it, A., Tapucu, D., Yanikoglu, B., and Saygin, Y. (2012). An Aspect-Lexicon Creation and Evaluation Tool for Sentiment Analysis Researchers. In Proceedings of the 2012 ECML, pages 804-807.
  9. Islam, A., Milios, E., and Kes?elj, V. (2012). Text Similarity Using Google Tri-Grams. In Proceedings of Canadian AI'12, pages 312-317.
  10. Li, F., Pan, S. J., Jin, O., Yang, Q., and Zhu, X. (2012). Cross-Domain Co-Extraction of Sentiment and Topic Lexicons. In Proceedings of the ACL, pages 410-419.
  11. Lu, Y., Castellanos, M., Dayal, U., and Zhai, C. (2011). Automatic Construction of a Context-Aware Sentiment Lexicon: An Optimization Approach. In Proceedings of the 20th Int.l Conf. on WWW, pages 347-356.
  12. Marneffe, M. D., Maccartney, B., and Manning, C. D. (2006). Generating Typed Dependency Parses from Phrase Structure Parses. In LREC, pages 449-454.
  13. Qiu, G., Liu, B., Bu, J., and Chen, C. (2009). Expanding Domain Sentiment Lexicon Through Double Propagation. In Proceedings of IJCAI, pages 1199-1204.
  14. Qiu, G., Liu, B., Bu, J., and Chen, C. (2011). Opinion Word Expansion and Target Extraction Through Double Propagation. Comput. Linguist., 37(1):9-27.
  15. Rao, D. and Ravichandran, D. (2009). Semi-Supervised Polarity Lexicon Induction. In Proceedings of the 12th Conference of the EACL, pages 675-682. ACL.
  16. Rohrdantz, C., Hao, M. C., Dayal, U., Haug, L.-E., and Keim, D. A. (2012). Feature-Based Visual Sentiment Analysis of Text Document Streams. ACM Trans. Intell. Syst. Technol., 3(2):26:1-26:25.
  17. Saitou, N. and Nei, M. (1987). The Neighbor-Joining Method: a New Method for Reconstructing Phylogenetic Trees. Molecular Biology and Evolution, 4:406- 425.
Download


Paper Citation


in Harvard Style

Makki R., Brooks S. and Milios E. (2014). Context-Specific Sentiment Lexicon Expansion via Minimal User Interaction . In Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014) ISBN 978-989-758-005-5, pages 178-186. DOI: 10.5220/0004745301780186


in Bibtex Style

@conference{ivapp14,
author={Raheleh Makki and Stephen Brooks and Evangelos E. Milios},
title={Context-Specific Sentiment Lexicon Expansion via Minimal User Interaction},
booktitle={Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014)},
year={2014},
pages={178-186},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004745301780186},
isbn={978-989-758-005-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2014)
TI - Context-Specific Sentiment Lexicon Expansion via Minimal User Interaction
SN - 978-989-758-005-5
AU - Makki R.
AU - Brooks S.
AU - Milios E.
PY - 2014
SP - 178
EP - 186
DO - 10.5220/0004745301780186