ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION

Dan Mikami, Kazuhiro Otsuka, Shiro Kumano, Junji Yamato

2012

Abstract

A novel enhancement for the memory-based particle filter is proposed for visual pose tracking under severe occlusions. The enhancement is the addition of a detection-based memory acquisition mechanism. The memorybased particle filter, M-PF, is a particle filter that predicts prior distributions from past history of target state, which achieved high robustness against complex dynamics of a tracking target. Such high performance requires sufficient history stored in memory. Conventionally, M-PF conducts online memory acquisition which assumes simple target’s dynamics without occlusions for guaranteeing high quality histories. The requirement of memory acquisition narrows the coverage of M-PF in practice. In this paper, we propose a new memory acquisition mechanism for M-PF. The key idea is to use a target detector that can produce additional prior distribution of the target state. We call it M-PFDMA for M-PF with detection-based memory acquisition. The detection-based prior distribution well predicts possible target position/pose even in limited visibility conditions caused by occlusions. Such better prior distributions contribute to stable estimation of target state, which is then added to memorized data. As a result, M-PFDMA can start with no memory entries but soon achieve stable tracking even under severe occlusions. Experiments confirm M-PFDMA’s good performance in such conditions.

References

  1. Andriluka, M., Roth, S., and Schiele, B. (2010). Monocular 3D pose estimation and tracking by detection. In CVPR 2010, pages 623-630.
  2. Andriluka, M., Roth, S., and Schiele, B. (2010). Monocular 3D pose estimation and tracking by detection. In CVPR 2010, pages 623-630.
  3. Ba, S. and Odobez, J.-M. (2008). Probabilistic head pose tracking evaluation in single and multiple camera. Multimodal Technologies for Perception of Humans, 4625/2008:276-286.
  4. Ba, S. and Odobez, J.-M. (2008). Probabilistic head pose tracking evaluation in single and multiple camera. Multimodal Technologies for Perception of Humans, 4625/2008:276-286.
  5. Bradski, G. R. (1998). Computer vision face tracking for use in a perceptual user interface. In Proc. IEEE Workshop Applications of Computer Vision, pages 214- 219.
  6. Bradski, G. R. (1998). Computer vision face tracking for use in a perceptual user interface. In Proc. IEEE Workshop Applications of Computer Vision, pages 214- 219.
  7. Comaniciu, D., Ramesh, V., and Meer, P. (2003). Kernelbased object tracking. IEEE Trans. PAMI, 25:564- 577.
  8. Comaniciu, D., Ramesh, V., and Meer, P. (2003). Kernelbased object tracking. IEEE Trans. PAMI, 25:564- 577.
  9. Gordon, N., Salmond, D., and Smith, A. F. M. (1993). Novel approach to non-linear and non-gaussian bayesian state estimeation. lEE Proc.F:Communications Rader and Signal Processing, 140(2):107-113.
  10. Gordon, N., Salmond, D., and Smith, A. F. M. (1993). Novel approach to non-linear and non-gaussian bayesian state estimeation. lEE Proc.F:Communications Rader and Signal Processing, 140(2):107-113.
  11. Isard, M. and Blake, A. (1998). Condensation - conditional density propagation for visual tracking. IJCV, 29(1):5-28.
  12. Isard, M. and Blake, A. (1998). Condensation - conditional density propagation for visual tracking. IJCV, 29(1):5-28.
  13. Kobayashi, Y., Sugimura, D., Sato, Y., Hirasawa, K., Suzuki, N., Kage, H., and Sugimoto, A. (2006). 3D head tracking using the particle filter with cascaded classifiers. In BMVC.
  14. Kobayashi, Y., Sugimura, D., Sato, Y., Hirasawa, K., Suzuki, N., Kage, H., and Sugimoto, A. (2006). 3D head tracking using the particle filter with cascaded classifiers. In BMVC.
  15. Lozano, O. M. and Otsuka, K. (2008). Real-time visual tracker by stream processing. Journal of VLSI Signal Processing Systems.
  16. Lozano, O. M. and Otsuka, K. (2008). Real-time visual tracker by stream processing. Journal of VLSI Signal Processing Systems.
  17. Mikami, D., Otsuka, K., and Yamato, J. (2009). Memorybased particle filter for face pose tracking robust under complex dynamics. In Proc. CVPR, pages 999-1006.
  18. Mikami, D., Otsuka, K., and Yamato, J. (2009). Memorybased particle filter for face pose tracking robust under complex dynamics. In Proc. CVPR, pages 999-1006.
  19. Murphy-Chutorian, E. and Trivedi, M. M. (2008). Head pose estimation in computer vision: A survey. IEEE Trans. PAMI.
  20. Murphy-Chutorian, E. and Trivedi, M. M. (2008). Head pose estimation in computer vision: A survey. IEEE Trans. PAMI.
  21. Otsuka, K., Araki, S., Ishizuka, K., Fujimoto, M., Heinrich, M., and Yamato, J. (2008). A realtime multimodal system for analyzing group meeting by combining face pose tracking and speaker diarization. In Proc. ACM ICMI, pages 257-264.
  22. Otsuka, K., Araki, S., Ishizuka, K., Fujimoto, M., Heinrich, M., and Yamato, J. (2008). A realtime multimodal system for analyzing group meeting by combining face pose tracking and speaker diarization. In Proc. ACM ICMI, pages 257-264.
  23. Ozuysal, M., Lepetit, V., Fleuret, F., and Fua, P. (2006). Feature harvesting for tracking-by-detection. In LNCS 3953(ECCV2006), pages 592-605.
  24. Ozuysal, M., Lepetit, V., Fleuret, F., and Fua, P. (2006). Feature harvesting for tracking-by-detection. In LNCS 3953(ECCV2006), pages 592-605.
  25. Tua, J., Taob, H., and Huang, T. (2007). Face as mouse through visual face tracking. CVIU, 108(1-2):35-40.
  26. Tua, J., Taob, H., and Huang, T. (2007). Face as mouse through visual face tracking. CVIU, 108(1-2):35-40.
Download


Paper Citation


in Harvard Style

Mikami D., Otsuka K., Kumano S. and Yamato J. (2012). ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 208-215. DOI: 10.5220/0003808302080215


in Harvard Style

Mikami D., Otsuka K., Kumano S. and Yamato J. (2012). ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 208-215. DOI: 10.5220/0003808302080215


in Bibtex Style

@conference{visapp12,
author={Dan Mikami and Kazuhiro Otsuka and Shiro Kumano and Junji Yamato},
title={ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={208-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003808302080215},
isbn={978-989-8565-04-4},
}


in Bibtex Style

@conference{visapp12,
author={Dan Mikami and Kazuhiro Otsuka and Shiro Kumano and Junji Yamato},
title={ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={208-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003808302080215},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION
SN - 978-989-8565-04-4
AU - Mikami D.
AU - Otsuka K.
AU - Kumano S.
AU - Yamato J.
PY - 2012
SP - 208
EP - 215
DO - 10.5220/0003808302080215


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - ENHANCING MEMORY-BASED PARTICLE FILTER WITH DETECTION-BASED MEMORY ACQUISITION FOR ROBUSTNESS UNDER SEVERE OCCLUSION
SN - 978-989-8565-04-4
AU - Mikami D.
AU - Otsuka K.
AU - Kumano S.
AU - Yamato J.
PY - 2012
SP - 208
EP - 215
DO - 10.5220/0003808302080215