Who Did It? Identifying Foul Subjects and Objects in Broadcast Soccer Videos

Chunbo Song, Christopher Rasmussen

2022

Abstract

We present a deep learning approach to sports video understanding as part of the development of an automated refereeing system for broadcast soccer games. The task of identifying which players are involved in a foul at a given moment is one of spatiotemporal action recognition in a cluttered visual environment. We describe how to employ multi-object tracking to generate a base set of candidate image sequences which are post-processed to mitigate common mistracking scenarios and then classified according to several two-person interaction types. For this work we created a large soccer foul dataset with a significant video component for training relevant networks. Our system can differentiate foul participants from bystanders with high accuracy and localize them over a wide range of game situations. We also report reasonable accuracy for distinguishing the player who committed the foul, or subject, from the object of the infraction, despite very low-resolution images.

Paper Citation

in Harvard Style

Song C. and Rasmussen C. (2022). Who Did It? Identifying Foul Subjects and Objects in Broadcast Soccer Videos. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 48-54. DOI: 10.5220/0010770600003124

in Bibtex Style

@conference{visapp22,
author={Chunbo Song and Christopher Rasmussen},
title={Who Did It? Identifying Foul Subjects and Objects in Broadcast Soccer Videos},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP},
year={2022},
pages={48-54},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010770600003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 5: VISAPP
TI - Who Did It? Identifying Foul Subjects and Objects in Broadcast Soccer Videos
SN - 978-989-758-555-5
AU - Song C.
AU - Rasmussen C.
PY - 2022
SP - 48
EP - 54
DO - 10.5220/0010770600003124
PB - SciTePress