Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms

Qinghua Guo, Yue Sun, Lan Min, Arjen van Putten, Egbert Frank Knol, Bram Visser, T. Bas Rodenburg, J. Elizabeth Bolhuis, Piter Bijma, Peter H. N. de With

2022

Abstract

It is important to detect negative behavior of animals for breeding in order to improve their health and welfare. In this work, AI is employed to assist individual animal detection and tracking, which enables the future analysis of behavior for individual animals. The study involves animal groups of pigs and laying hens. First, two state-of-the-art deep learning-based Multi-Object Tracking (MOT) methods are investigated, namely Joint Detection and Embedding (JDE) and FairMOT. Both models detect and track individual animals automatically and continuously. Second, a weighted association algorithm is proposed, which is feasible for both MOT methods to optimize the object re-identification (re-ID), thereby improving the tracking performance. The proposed methods are evaluated on manually annotated datasets. The best tracking performance on pigs is obtained by FairMOT with the weighted association, resulting in an IDF1 of 90.3%, MOTA of 90.8%, MOTP of 83.7%, number of identity switches of 14, and an execution rate of 20.48 fps. For the laying hens, FairMOT with the weighted association also achieves the best tracking performance, with an IDF1 of 88.8%, MOTA of 86.8%, MOTP of 72.8%, number of identity switches of 2, and an execution rate of 21.01 fps. These results show a promising high accuracy and robustness for the individual animal tracking.

Paper Citation

in Harvard Style

Guo Q., Sun Y., Min L., van Putten A., Knol E., Visser B., Rodenburg T., Bolhuis J., Bijma P. and N. de With P. (2022). Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 69-78. DOI: 10.5220/0010788100003124

in Bibtex Style

@conference{visapp22,
author={Qinghua Guo and Yue Sun and Lan Min and Arjen van Putten and Egbert Frank Knol and Bram Visser and T. Bas Rodenburg and J. Elizabeth Bolhuis and Piter Bijma and Peter H. N. de With},
title={Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={69-78},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010788100003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - Video-based Detection and Tracking with Improved Re-Identification Association for Pigs and Laying Hens in Farms
SN - 978-989-758-555-5
AU - Guo Q.
AU - Sun Y.
AU - Min L.
AU - van Putten A.
AU - Knol E.
AU - Visser B.
AU - Rodenburg T.
AU - Bolhuis J.
AU - Bijma P.
AU - N. de With P.
PY - 2022
SP - 69
EP - 78
DO - 10.5220/0010788100003124
PB - SciTePress