Continuous Pre-Calculation of Human Tracking with Time-delayed Ground-truth - A Hybrid Approach to Minimizing Tracking Latency by Combination of Different 3D Cameras

Philip Nicolai, Jörg Raczkowsky, Heinz Wörn

2015

Abstract

We present an approach to track a point cloud with a 3D camera system with low latency and/or high frame rate, based on ground truth provided by a second 3D camera system with higher latency and/or lower frame rate. In particular, we employ human tracking based on Kinect cameras and combine it with higher frame-rate/ lower latency of Time-of-Flight (ToF) cameras. We present the system setup, methods used and evaluation results showing a very high accuracy in combination with a latency reduction of up to factor 30.

References

  1. Beyl, T. et al., 2013. Multi Kinect People Detection for Intuitive and Safe Human Robot Cooperation in the Operating Room. In ICAR 7813, International Conference on Advanced Robotics, pp. 1 - 6.
  2. Bradski, G. R., Pisarevsky, V., 2000. Intel's Computer Vision Library: Applications in calibration, stereo, segmentation, tracking, gesture, face and object recognition. In CVPR'00, IEEE International conference on Computer Vision and Pattern Recognition, vol. 2, pp. 796 - 797.
  3. Józków, G., et al., 2014. Combined Matching of 2D and 3D Kinect ™ Data to support Indoor Mapping and Navigation. In Proceedings of Annual Conference of American Society for Photogrammetry and Remote Sensing.
  4. Klappstein, J. et al., 2009. Moving Object Segmentation Using Optical Flow and Depth Information. In Lecture Notes in Computer Science: Advances in Image and Video Technology, vol. 5414, pp. 611 - 623.
  5. Moennich, H. et al., 2011. A supervision system for the intuitive usage of a telemanipulated surgical robotic setup. In ROBIO 7811, IEEE International conference on Robotics and Biomimetics, pp. 449 - 454.
  6. Okada, R., Shirai, Y., Miura, J., 2000. Tracking a person with 3-D Motion by Integrating Optical Flow and Depth. In Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 336- 341.
  7. Quigley, M. et al., 2009. ROS: an open source Robot Operating System. In ICRA 7809, International Conference on Robotics and Automation Workshop on Open Source Software.
  8. Rusu, R. B., Cousins, S., 2011. 3D is here: Point Cloud Library (PCL). In ICRA 7811, International Conference on Robotics and Automation, pp. 1 - 4.
  9. Sanchéz, J., Meinhardt-Llopis, E., Facciolo, G., 2013. TVL1 Optical Flow Estimation. In: Image Processing On Line, vol. 3, pp. 137-150.
  10. Sobral, A., Vacavant, A., 2014. A comprehensive review of background subtraction algorithms evaluated with synthetic and real video. In Computer Vision and Understanding, vol. 122, pp. 4 - 21. Elsevier.
  11. Tsutsui, H., Miura, J., Shirai, Y., 2001. Optical FlowBased Person Tracking by Multiple Cameras. In International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 91 - 96.
  12. Zivkovic, Z., Heijden, F., 2005. Efficient adaptive density estimation per image pixel for the task of background subtraction. In Pattern Recognition Letters, vol. 27, pp. 773 - 780.
Download


Paper Citation


in Harvard Style

Nicolai P., Raczkowsky J. and Wörn H. (2015). Continuous Pre-Calculation of Human Tracking with Time-delayed Ground-truth - A Hybrid Approach to Minimizing Tracking Latency by Combination of Different 3D Cameras . In Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-123-6, pages 121-130. DOI: 10.5220/0005548901210130


in Bibtex Style

@conference{icinco15,
author={Philip Nicolai and Jörg Raczkowsky and Heinz Wörn},
title={Continuous Pre-Calculation of Human Tracking with Time-delayed Ground-truth - A Hybrid Approach to Minimizing Tracking Latency by Combination of Different 3D Cameras},
booktitle={Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2015},
pages={121-130},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005548901210130},
isbn={978-989-758-123-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Continuous Pre-Calculation of Human Tracking with Time-delayed Ground-truth - A Hybrid Approach to Minimizing Tracking Latency by Combination of Different 3D Cameras
SN - 978-989-758-123-6
AU - Nicolai P.
AU - Raczkowsky J.
AU - Wörn H.
PY - 2015
SP - 121
EP - 130
DO - 10.5220/0005548901210130