CATI: An Active Learning System for Event Detection on Mibroblogs’ Large Datasets

Gabriela Bosetti, Előd Egyed-Zsigmond, Lucas Ono

2019

Abstract

Today, there are plenty of tools and techniques to perform text- or image-based classification of large datasets, targeting different levels of user expertise and abstraction. Specialists usually collaborate in projects by creating ground truth datasets and do not always have deep knowledge in Information Retrieval. This article presents a full platform for assisted binary classification of very large textual and text and image composed documents. Our goal is to enable human users to classify collections of several hundred thousand documents in an assisted way, within a humanly acceptable number of clicks. We propose a graphical user interface, based on several classification assistants: text- and image-based event detection, Active Learning (AL), search engine and rich visual metaphors to visualize the results. We also propose a novel query strategy in the context of Active Learning, considering the top unlabeled bi-grams and duplicated (e.g. re-tweeted) content in the target corpus to classify. These contributions are supported not only by a tool whose code is freely accessible but also by an evaluation of the impact of using the aforementioned methods on the number of clicks needed to reach a stable level of accuracy.

Paper Citation

in Harvard Style

Bosetti G., Egyed-Zsigmond E. and Ono L. (2019). CATI: An Active Learning System for Event Detection on Mibroblogs’ Large Datasets.In Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-386-5, pages 151-160. DOI: 10.5220/0008355301510160

in Bibtex Style

@conference{webist19,
author={Gabriela Bosetti and Előd Egyed-Zsigmond and Lucas Ono},
title={CATI: An Active Learning System for Event Detection on Mibroblogs’ Large Datasets},
booktitle={Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2019},
pages={151-160},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008355301510160},
isbn={978-989-758-386-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - CATI: An Active Learning System for Event Detection on Mibroblogs’ Large Datasets
SN - 978-989-758-386-5
AU - Bosetti G.
AU - Egyed-Zsigmond E.
AU - Ono L.
PY - 2019
SP - 151
EP - 160
DO - 10.5220/0008355301510160