English
Related papers

Related papers: Cycle-Consistent Generative Rendering for 2D-3D Mo…

200 papers

In recent years, 3D models have been utilized in many applications, such as auto-driver, 3D reconstruction, VR, and AR. However, the scarcity of 3D model data does not meet its practical demands. Thus, generating high-quality 3D models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Weizhi Nie , Ruidong Chen , Weijie Wang , Bruno Lepri , Nicu Sebe

We present the first image-based generative model of people in clothing for the full body. We sidestep the commonly used complex graphics rendering pipeline and the need for high-quality 3D scans of dressed people. Instead, we learn…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Christoph Lassner , Gerard Pons-Moll , Peter V. Gehler

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

We propose a novel method for learning representations of poses for 3D deformable objects, which specializes in 1) disentangling pose information from the object's identity, 2) facilitating the learning of pose variations, and 3)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Seungwoo Yoo , Juil Koo , Kyeongmin Yeo , Minhyuk Sung

We propose a new representation for encoding 3D shapes as neural fields. The representation is designed to be compatible with the transformer architecture and to benefit both shape reconstruction and shape generation. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Biao Zhang , Matthias Nießner , Peter Wonka

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance or type of outfit worn by the user. This is a difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xu Chen , Jie Song , Otmar Hilliges

Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scans during training.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ron Slossberg , Ibrahim Jubran , Ron Kimmel

3D shape is a crucial but heavily underutilized cue in today's computer vision systems, mostly due to the lack of a good generic shape representation. With the recent availability of inexpensive 2.5D depth sensors (e.g. Microsoft Kinect),…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Zhirong Wu , Shuran Song , Aditya Khosla , Fisher Yu , Linguang Zhang , Xiaoou Tang , Jianxiong Xiao

Can the latent spaces of modern generative neural rendering models serve as representations for 3D-aware discriminative visual understanding tasks? We use retrieval as a proxy for measuring the metric learning properties of the latent…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Michael Tang , David Shustin

Generative modeling of anatomical structures plays a crucial role in virtual imaging trials, which allow researchers to perform studies without the costs and constraints inherent to in vivo and phantom studies. For clinical relevance,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Bram de Wilde , Max T. Rietberg , Guillaume Lajoinie , Jelmer M. Wolterink

Learning 3D generative models from a dataset of monocular images enables self-supervised 3D reasoning and controllable synthesis. State-of-the-art 3D generative models are GANs which use neural 3D volumetric representations for synthesis.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ayush Tewari , Mallikarjun B R , Xingang Pan , Ohad Fried , Maneesh Agrawala , Christian Theobalt

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

In this paper, we present a framework to represent mock 3D objects and scenes, which are not 3D but appear 3D. In our framework, each mock-3D object is represented using 2D non-conservative vector fields and thickness information that are…

Graphics · Computer Science 2024-01-02 Ergun Akleman , Youyou Wang , Ozgur Gonen

Most deep learning approaches to comprehensive semantic modeling of 3D indoor spaces require costly dense annotations in the 3D domain. In this work, we explore a central 3D scene modeling task, namely, semantic scene reconstruction without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Junwen Huang , Alexey Artemov , Yujin Chen , Shuaifeng Zhi , Kai Xu , Matthias Nießner

Understanding 3D scenes requires flexible combinations of visual reasoning tasks, including depth estimation, novel view synthesis, and object manipulation, all of which are essential for perception and interaction. Existing approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wanhee Lee , Klemen Kotar , Rahul Mysore Venkatesh , Jared Watrous , Honglin Chen , Khai Loong Aw , Daniel L. K. Yamins

The objective of this paper is to learn dense 3D shape correspondence for topology-varying generic objects in an unsupervised manner. Conventional implicit functions estimate the occupancy of a 3D point given a shape latent code. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Feng Liu , Xiaoming Liu

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

We present a technique to synthesize and analyze volume-rendered images using generative models. We use the Generative Adversarial Network (GAN) framework to compute a model from a large collection of volume renderings, conditioned on (1)…

Graphics · Computer Science 2019-07-18 Matthew Berger , Jixian Li , Joshua A. Levine

We present a learning framework for recovering the 3D shape, camera, and texture of an object from a single image. The shape is represented as a deformable 3D mesh model of an object category where a shape is parameterized by a learned mean…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Angjoo Kanazawa , Shubham Tulsiani , Alexei A. Efros , Jitendra Malik