KinFu MOT: KinectFusion with Moving Objects Tracking

Michael Korn, Josef Pauli

2015

Abstract

Using a depth camera, the KinectFusion algorithm permits tracking the camera poses and building a dense 3D reconstruction of the environment simultaneously in real-time. We present an extension to this algorithm that allows additionally the concurrent tracking and reconstruction of several moving objects within the perceived environment. This is achieved through an expansion of the GPU processing pipeline by several new functionalities. Our system detects moving objects from the registration results and it creates a separate storing volume for such objects. Each object and the background are tracked and reconstructed individually. Since the size of an object is uncertain at the moment of detection the storing volume grows dynamically. Moreover, a sliding reduction method stabilizes the tracking of objects with ambiguous registrations. We provide experimental results showing the effects of our modified matching strategy. Furthermore, we demonstrate the system’s ability to deal with three different challenging situations containing a moving robot.

References

  1. Curless, B. and Levoy, M. (1996). A volumetric method for building complex models from range images. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, SIGGRAPH 7896, pages 303-312, New York, NY, USA. ACM.
  2. Endres, F., Hess, J., Engelhard, N., Sturm, J., Cremers, D., and Burgard, W. (2012). An evaluation of the RGBD SLAM system. In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), St. Paul, MA, USA.
  3. Gelfand, N., Ikemoto, L., Rusinkiewicz, S., and Levoy, M. (2003). Geometrically stable sampling for the ICP algorithm. In Fourth International Conference on 3D Digital Imaging and Modeling (3DIM).
  4. Heredia, F. and Favie, R. (2012). Kinfu Large Scale in PCL. http://www.pointclouds.org/blog/srcs/fheredia/.
  5. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. (2011). Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera. ACM Symposium on User Interface Software and Technology.
  6. Klein, G. and Murray, D. (2007). Parallel tracking and mapping for small AR workspaces. In Proc. Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'07), Nara, Japan.
  7. Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohli, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011). KinectFusion: RealTime Dense Surface Mapping and Tracking. In IEEE ISMAR. IEEE.
  8. Rusu, R. B. and Cousins, S. (2011). 3D is here: Point Cloud Library (PCL). In International Conference on Robotics and Automation, Shanghai, China.
  9. Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012). A benchmark for the evaluation of rgb-d slam systems. In Proc. of the International Conference on Intelligent Robot Systems (IROS).
  10. Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. (2012). Kintinuous: Spatially extended KinectFusion. In RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia.
Download


Paper Citation


in Harvard Style

Korn M. and Pauli J. (2015). KinFu MOT: KinectFusion with Moving Objects Tracking . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 648-657. DOI: 10.5220/0005362106480657


in Bibtex Style

@conference{visapp15,
author={Michael Korn and Josef Pauli},
title={KinFu MOT: KinectFusion with Moving Objects Tracking},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={648-657},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005362106480657},
isbn={978-989-758-091-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - KinFu MOT: KinectFusion with Moving Objects Tracking
SN - 978-989-758-091-8
AU - Korn M.
AU - Pauli J.
PY - 2015
SP - 648
EP - 657
DO - 10.5220/0005362106480657