Verification of Fact Statements with Multiple Truthful Alternatives

Xian Li, Weiyi Meng, Clement Yu

2016

Abstract

When people are not sure about certain facts, they tend to use theWeb to find the answers. Two problems make finding correct answers from the Web challenging. First, the Web contains a significant amount of untruthful information. Second, currently there is a lack of systems/tools that can verify the truthfulness or untruthfulness of a random fact statement and also provide alternative answers. In this paper, we propose a method that aims to determine whether a given statement is truthful and to identify alternative truthful statements that are highly relevant to the given statement. Existing solutions consider only statements with a single expected correct answer. In this paper, we focus on statements that may have multiple relevant alternative answers. We first present a straightforward extension to the previous method to solve such type of statements and show that such a simple extension is inadequate. We then present solutions to two types of such statements. Our evaluation indicates that our proposed solutions are very effective.

References

  1. Brin, S. and Page, L. (1998). The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30(1-7):107-117.
  2. Ferrucci, D. A., Brown, E. W., Chu-Carroll, J., Fan, J., Gondek, D., Kalyanpur, A., Lally, A., Murdock, J. W., Nyberg, E., Prager, J. M., Schlaefer, N., and Welty, C. A. (2010). Building watson: An overview of the deepqa project. volume 31, pages 59-79.
  3. Jijkoun, V., Hofmann, K., Ahn, D., Khalid, M. A., van Rantwijk, J., de Rijke, M., and Sang, E. F. T. K. (2007). The university of amsterdam's question answering system at qa@clef 2007. In CLEF, pages 344-351.
  4. Ko, J., Si, L., and Nyberg, E. (2007). A probabilistic framework for answer selection in question answering. In Proceedings of HLT-NAACL, pages 524-531.
  5. Li, X., Meng, W., and Yu, C. (2011). T-verifier: Verifying truthfulness of fact statements. In Proc. of ICDE, pages 63-74.
  6. Magnini, B., Negri, M., Prevete, R., and Tanev, H. (2002). Is it the right answer? exploiting web redundancy for answer validation. In Proc. of ACL, pages 425-432.
  7. Prager, J. M. (2006). Open-domain question-answering. Foundations and Trends in Information Retrieval, 1(2):91-231.
  8. Razmara, M. (2008). Answering list and other questions.
  9. Voorhees, E. M. (2001). Overview of the TREC 2001 question answering track. In Proceedings of The Tenth Text REtrieval Conference.
  10. Wang, R. C., Schlaefer, N., Cohen, W. W., and Nyberg, E. (2008). Automatic set expansion for list question answering. In Proceedings of Conference on Empirical Methods in Natural Language Processing, EMNLP, pages 947-954.
  11. Yamamoto, Y., Tezuka, T., Jatowt, A., and Tanaka, K. (2007). Honto? search: Estimating trustworthiness of web information by search results aggregation and temporal analysis. In APWeb & WAIM, pages 253- 264.
  12. Yamamoto, Y., Tezuka, T., Jatowt, A., and Tanaka, K. (2008). Supporting judgment of fact trustworthiness considering temporal and sentimental aspects. In WISE, pages 206-220.
Download


Paper Citation


in Harvard Style

Li X., Meng W. and Yu C. (2016). Verification of Fact Statements with Multiple Truthful Alternatives . In Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST, ISBN 978-989-758-186-1, pages 87-97. DOI: 10.5220/0005781800870097


in Bibtex Style

@conference{webist16,
author={Xian Li and Weiyi Meng and Clement Yu},
title={Verification of Fact Statements with Multiple Truthful Alternatives},
booktitle={Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,},
year={2016},
pages={87-97},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005781800870097},
isbn={978-989-758-186-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Web Information Systems and Technologies - Volume 2: WEBIST,
TI - Verification of Fact Statements with Multiple Truthful Alternatives
SN - 978-989-758-186-1
AU - Li X.
AU - Meng W.
AU - Yu C.
PY - 2016
SP - 87
EP - 97
DO - 10.5220/0005781800870097