MULTIPLE TARGET TRACKING AND IDENTITY LINKING UNDER SPLIT, MERGE AND OCCLUSION OF TARGETS AND OBSERVATIONS
José C. Rubio, Joan Serrat, Antonio M. López
2012
Abstract
Multiple object tracking in video sequences is a difficult problem when one has to simultaneously deal with the following realistic conditions: 1) all or most objects share an identical or very similar appearance, 2) objects are imaged at close positions so there is a data association problem which becomes worse when the number of targets is high, 3) the objects to be tracked may lack observations for a short or long interval, for instance because they are not well detected or are being temporally occluded by another non-target object, and 4) their observations may overlap in the images because the objects are very near or the image results from a 2D projection from the 3D scene, giving rise to the merging and subsequently splitting of tracks. This later condition poses the additional problem of maintaining the objects identity when their observations undergo a merge and split. We pose the tracking and identity linking problem as one of inference on a two-layer probabilistic graphical model and show how can it be efficiently solved. Results are assessed on three very different types of video sequences, showing a turbulent flow of particles, bacteria growth and on-coming traffic headlights.
References
- Benfold, B. and Reid, I. (2011). Stable multi-target tracking in real-time surveillance video. In CVPR, pages 3457- 3464.
- Bernardin, K. and Stiefelhagen, R. (2008). Evaluating multiple object tracking performance: the clear mot metrics. J. Image Video Process., 2008:1:1-1:10.
- Khan, Z., Balch, T., and Dellaert, F. (2003). An mcmcbased particle filter for tracking multiple interacting targets. In in Proc. ECCV, pages 279-290.
- Kuhn, H. W. (1955). The Hungarian method for the assignment problem. Naval Research Logistic Quarterly, 2:83-97.
- Laet, T. D., Bruyninckx, H., and Schutter, J. D. (2011). Shape-based online multitarget tracking and detection for targets causing multiple measurements: Variational bayesian clustering and lossless data association. IEEE Transactions on Pattern Analysis and Machine Intelligence, 99.
- Li, K., Chen, M., and Kanade, T. (2007). Cell population tracking and lineage construction with spatiotemporal context. In Proceedings of the 10th International Conference on Medical Image Computing and ComputerAssisted Intervention (MICCAI), pages 295 - 302.
- Liu, M., Roy Chowdhury, A., and Reddy, G. (2009). Robust estimation of stem cell lineages using local graph matching. In MMBIA09, pages 194-201.
- Mooij, J. M. (2010). libDAI: A free and open source C++ library for discrete approximate inference in graphical models. Journal of Machine Learning Research, pages 2169-2173.
- Nillius, P., Sullivan, J., and Carlsson, S. (2006). Multi-target tracking - linking identities using bayesian network inference. In In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pages 2187-2194.
- Reid, D. B. (1979). An algorithm for tracking multiple targets. IEEE Transactions on Automatic Control, 24:843-854.
- Rubio, J. C., A. L. D. P. and Serrat., J. (2010). Multiple target tracking for intelligent headlights control. In Intelligent Transportation Systems Conference, 2010. ITSC 2010. IEEE.
- T.Fortmann, Bar-Shalom, Y., and Scheffe, M. (1983). Sonar tracking of multiple targets using joint probabilistic data association. IEEE Journal of Oceanic Engineering, 8:173-184.
- Zheng Wu, T. H. K. and Betke, M. (2011). Efficient track linking methods for track graphs using network-flow and set-cover thechniques. in CVPR.
Paper Citation
in Harvard Style
Rubio J., Serrat J. and López A. (2012). MULTIPLE TARGET TRACKING AND IDENTITY LINKING UNDER SPLIT, MERGE AND OCCLUSION OF TARGETS AND OBSERVATIONS . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-8425-99-7, pages 15-24. DOI: 10.5220/0003710600150024
in Bibtex Style
@conference{icpram12,
author={José C. Rubio and Joan Serrat and Antonio M. López},
title={MULTIPLE TARGET TRACKING AND IDENTITY LINKING UNDER SPLIT, MERGE AND OCCLUSION OF TARGETS AND OBSERVATIONS},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2012},
pages={15-24},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003710600150024},
isbn={978-989-8425-99-7},
}
in EndNote Style
TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - MULTIPLE TARGET TRACKING AND IDENTITY LINKING UNDER SPLIT, MERGE AND OCCLUSION OF TARGETS AND OBSERVATIONS
SN - 978-989-8425-99-7
AU - Rubio J.
AU - Serrat J.
AU - López A.
PY - 2012
SP - 15
EP - 24
DO - 10.5220/0003710600150024