Multi-View Inversion for 3D-aware Generative Adversarial Networks

Florian Barthel; Florian Barthel; Anna Hilsmann; Peter Eisert; Peter Eisert

Research.Publish.Connect.

*Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search *Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search *Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search *Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

Multi-View Inversion for 3D-aware Generative Adversarial Networks

Topics: 3D Deep Learning; Deep Learning for Visual Understanding ; Generative AI; Machine Learning Technologies for Vision

In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4 VISAPP: VISAPP, 194-203, 2024 , Rome, Italy

Authors: Florian Barthel ^{1

;

2} ; Anna Hilsmann ² and Peter Eisert ^{2

;

1}

Affiliations: ¹ Humboldt Universität zu Berlin, Berlin, Germany ; ² Fraunhofer HHI, Berlin, Germany

Keyword(s): 3D GAN Inversion, Multi-View Inversion, Multi-Latent Inversion.

Abstract: Current 3D GAN inversion methods for human heads typically use only one single frontal image to reconstruct the whole 3D head model. This leaves out meaningful information when multi-view data or dynamic videos are available. Our method builds on existing state-of-the-art 3D GAN inversion techniques to allow for consistent and simultaneous inversion of multiple views of the same subject. We employ a multi-latent extension to handle inconsistencies present in dynamic face videos to re-synthesize consistent 3D representations from the sequence. As our method uses additional information about the target subject, we observe significant enhancements in both geometric accuracy and image quality, particularly when rendering from wide viewing angles. Moreover, we demonstrate the editability of our inverted 3D renderings, which distinguishes them from NeRF-based scene reconstructions.

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 3.139.79.187

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Barthel, F. ; Hilsmann, A. and Eisert, P. (2024). Multi-View Inversion for 3D-aware Generative Adversarial Networks. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8; ISSN 2184-4321, SciTePress, pages 194-203. DOI: 10.5220/0012371000003660

@conference{visapp24,
author={Florian Barthel and Anna Hilsmann and Peter Eisert},
title={Multi-View Inversion for 3D-aware Generative Adversarial Networks},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={194-203},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012371000003660},
isbn={978-989-758-679-8},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - Multi-View Inversion for 3D-aware Generative Adversarial Networks
SN - 978-989-758-679-8
IS - 2184-4321
AU - Barthel, F.
AU - Hilsmann, A.
AU - Eisert, P.
PY - 2024
SP - 194
EP - 203
DO - 10.5220/0012371000003660
PB - SciTePress