loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Nicholas Beato ; Remo Pillat and Charles E. Hughes

Affiliation: University of Central Florida, United States

Keyword(s): Mixed Reality, Image Matting, Natural Image Matting, Real-time, Depth Sensor, Chroma-keying, Trimap Generation.

Related Ontology Subjects/Areas/Topics: Augmented, Mixed and Virtual Environments ; Computer Vision, Visualization and Computer Graphics ; Hardware Technologies for Augmented, Mixed and Virtual Environments ; Interactive Environments ; Real-Time Graphics ; Real-Time Rendering ; Rendering

Abstract: In Mixed Reality scenarios, background replacement is a common way to immerse a user in a synthetic environment. Properly identifying the background pixels in an image or video is a difficult problem known as matting. Proper alpha mattes usually come from human guidance, special hardware setups, or color dependent algorithms. This is a consequence of the under-constrained nature of the per pixel alpha blending equation. While the field of natural image matting has made progress finding a least squares solution for an alpha matte, the generation of trimaps, indicating regions of known foreground and background pixels, normally requires human interaction or offline computation. We overcome these limitations by combining a low fidelity depth image that segments the original video signal with a real-time parallel natural image matting technique that favors objects with similar colors in the foreground and background. This allows us to provide real-time alpha mattes for Mixed Reality scen arios that take place in relatively controlled environments. As a consequence, while monochromatic backdrops (such as green screens or retro-reflective material) aid the algorithm’s accuracy, they are not an explicit requirement. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.237.75.165

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Beato, N.; Pillat, R. and E. Hughes, C. (2012). REAL-TIME VIDEO MATTING FOR MIXED REALITY USING DEPTH GENERATED TRIMAPS. In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications (VISIGRAPP 2012) - GRAPP; ISBN 978-989-8565-02-0; ISSN 2184-4321, SciTePress, pages 280-288. DOI: 10.5220/0003870402800288

@conference{grapp12,
author={Nicholas Beato. and Remo Pillat. and Charles {E. Hughes}.},
title={REAL-TIME VIDEO MATTING FOR MIXED REALITY USING DEPTH GENERATED TRIMAPS},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications (VISIGRAPP 2012) - GRAPP},
year={2012},
pages={280-288},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003870402800288},
isbn={978-989-8565-02-0},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications (VISIGRAPP 2012) - GRAPP
TI - REAL-TIME VIDEO MATTING FOR MIXED REALITY USING DEPTH GENERATED TRIMAPS
SN - 978-989-8565-02-0
IS - 2184-4321
AU - Beato, N.
AU - Pillat, R.
AU - E. Hughes, C.
PY - 2012
SP - 280
EP - 288
DO - 10.5220/0003870402800288
PB - SciTePress