Authors:
Luis Almeida
1
;
Paulo Menezes
2
and
Jorge Dias
2
Affiliations:
1
University of Coimbra and Institute Polytechnic of Tomar, Portugal
;
2
University of Coimbra, Portugal
Keyword(s):
Augmented Reality, 3D Reconstruction, Tele-presence, Virtual View Synthesis.
Related
Ontology
Subjects/Areas/Topics:
Augmented, Mixed and Virtual Environments
;
Computer Vision, Visualization and Computer Graphics
;
Geometry and Modeling
;
Interactive Environments
;
Modeling and Algorithms
;
Scene and Object Modeling
Abstract:
Building 3D body models is an important task for virtual and augmented reality applications in telerehabilitation, education, 3DTV, entertainment and tele-presence. We propose a real-time full 3D reconstruction system that combines visual features and shape-based alignment using low cost depth sensor and video cameras targeting three-dimensional conferencing applications. With this approach we overcome the classic video based reconstruction problem in low-texture or repeated pattern regions. Alignment between successive
frames is computed by jointly optimizing over both appearances and shape matching. Appearance-based alignment is done over 2D SURF features annotated with 3D position. Shape-based alignment is performed using the motion transformation estimation between consecutive annotated 3D point clouds through a linear method. A solution to avoid wrong annotated 3D matched points is proposed. 3D mesh model representation is used to lower the processed data and create a 3D represe
ntation that is independent of view-point.
(More)