Material Recognition for Mixed Reality Scene including Objects’ Physical Characteristics

Kenzaburo Miyawaki, Soichi Okabe

2019

Abstract

Mixed Reality (MR) is a technique to represent scenes which make virtual objects exist in the real world. MR is different from Augmented Reality (AR) and Virtual Reality (VR). For example, in MR scenes, a user can put a virtual Computer Graphics (CG) object on a desk of the real world. The virtual object can interact with the real desk physically, and the user can see the virtual object from every direction. However, MR only uses position and shape information of real world objects. Therefore, we present a new MR scene generator considering real world objects’ physical characteristics such as friction, repulsion and so on, by using material recognition based on a deep neural network.

Paper Citation

in Harvard Style

Miyawaki K. and Okabe S. (2019). Material Recognition for Mixed Reality Scene including Objects’ Physical Characteristics. In Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 3: KMIS; ISBN 978-989-758-382-7, SciTePress, pages 219-224. DOI: 10.5220/0008332502190224

in Bibtex Style

@conference{kmis19,
author={Kenzaburo Miyawaki and Soichi Okabe},
title={Material Recognition for Mixed Reality Scene including Objects’ Physical Characteristics},
booktitle={Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 3: KMIS},
year={2019},
pages={219-224},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008332502190224},
isbn={978-989-758-382-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2019) - Volume 3: KMIS
TI - Material Recognition for Mixed Reality Scene including Objects’ Physical Characteristics
SN - 978-989-758-382-7
AU - Miyawaki K.
AU - Okabe S.
PY - 2019
SP - 219
EP - 224
DO - 10.5220/0008332502190224
PB - SciTePress