Authors:
Babette Dellen
;
Farzad Husain
and
Carme Torras
Affiliation:
Institut de Robòtica i Informàtica Industrial and CSIC-UPC, Spain
Keyword(s):
Range Data, Segmentation, Motion, Shape, Surface Fitting.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Computer Vision, Visualization and Computer Graphics
;
Image and Video Analysis
;
Motion, Tracking and Stereo Vision
;
Pattern Recognition
;
Robotics
;
Segmentation and Grouping
;
Software Engineering
;
Tracking and Visual Navigation
Abstract:
A novel framework for joint segmentation and tracking in depth videos of object surfaces is presented. Initially, the 3D colored point cloud obtained using the Kinect camera is used to segment the scene into surface patches, defined by quadratic functions. The computed segments together with their functional descriptions are then used to partition the depth image of the subsequent frame in a consistent manner with respect to the precedent frame. This way, solutions established in previous frames can be reused which improves the efficiency of the algorithm and the coherency of the segmentations along the movie. The algorithm is tested for scenes showing human and robot manipulations of objects. We demonstrate that the method can successfully segment and track the human/robot arm and object surfaces along the manipulations. The performance is evaluated quantitatively by measuring the temporal coherency of the segmentations and the segmentation covering using ground truth. The method pr
ovides a visual front-end designed for robotic applications, and can potentially be used in the context of manipulation recognition, visual servoing, and robot-grasping tasks.
(More)