Predicting Headline Effectiveness in Online News Media using Transfer Learning with BERT

Jaakko Tervonen, Tuomas Sormunen, Arttu Lämsä, Johannes Peltola, Heidi Kananen, Sari Järvinen

2021

Abstract

The decision to read an article in online news media or social networks is often based on the headline, and thus writing effective headlines is an important but difficult task for the journalists and content creators. Even defining an effective headline is a challenge, since the objective is to avoid click-bait headlines and be sure that the article contents fulfill the expectations set by the headline. Once defined and measured, headline effectiveness can be used for content filtering or recommending articles with effective headlines. In this paper, a metric based on received clicks and reading time is proposed to classify news media content into four classes describing headline effectiveness. A deep neural network model using the Bidirectional Encoder Representations from Transformers (BERT) is employed to classify the headlines into the four classes, and its performance is compared to that of journalists. The proposed model achieves an accuracy of 59% on the four-class classification, and 72-78% on corresponding binary classification tasks. The model outperforms the journalists being almost twice as accurate on a random sample of headlines.

Paper Citation

in Harvard Style

Tervonen J., Sormunen T., Lämsä A., Peltola J., Kananen H. and Järvinen S. (2021). Predicting Headline Effectiveness in Online News Media using Transfer Learning with BERT. In Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - Volume 1: DeLTA, ISBN 978-989-758-526-5, pages 29-37. DOI: 10.5220/0010543000290037

in Bibtex Style

@conference{delta21,
author={Jaakko Tervonen and Tuomas Sormunen and Arttu Lämsä and Johannes Peltola and Heidi Kananen and Sari Järvinen},
title={Predicting Headline Effectiveness in Online News Media using Transfer Learning with BERT},
booktitle={Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - Volume 1: DeLTA,},
year={2021},
pages={29-37},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010543000290037},
isbn={978-989-758-526-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Deep Learning Theory and Applications - Volume 1: DeLTA,
TI - Predicting Headline Effectiveness in Online News Media using Transfer Learning with BERT
SN - 978-989-758-526-5
AU - Tervonen J.
AU - Sormunen T.
AU - Lämsä A.
AU - Peltola J.
AU - Kananen H.
AU - Järvinen S.
PY - 2021
SP - 29
EP - 37
DO - 10.5220/0010543000290037