English
Related papers

Related papers: Cycle-Consistent Generative Rendering for 2D-3D Mo…

200 papers

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

Generative models for 3D geometric data arise in many important applications in 3D computer vision and graphics. In this paper, we focus on 3D deformable shapes that share a common topological structure, such as human faces and bodies.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Giorgos Bouritsas , Sergiy Bokhnyak , Stylianos Ploumpis , Michael Bronstein , Stefanos Zafeiriou

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jingxiang Sun , Xuan Wang , Lizhen Wang , Xiaoyu Li , Yong Zhang , Hongwen Zhang , Yebin Liu

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

Generalization remains the central challenge for interactive 3D scene generation. Existing learning-based approaches ground spatial understanding in limited scene dataset, restricting generalization to new layouts. We instead reprogram a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Lu Ling , Yunhao Ge , Yichen Sheng , Aniket Bera

Numerous methods have been proposed for probabilistic generative modelling of 3D objects. However, none of these is able to produce textured objects, which renders them of limited use for practical tasks. In this work, we present the first…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Paul Henderson , Vagia Tsiminaki , Christoph H. Lampert

Object recognition has seen significant progress in the image domain, with focus primarily on 2D perception. We propose to leverage existing large-scale datasets of 3D models to understand the underlying 3D structure of objects seen in an…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Weicheng Kuo , Anelia Angelova , Tsung-Yi Lin , Angela Dai

The convergence of generative artificial intelligence and advanced computer vision technologies introduces a groundbreaking approach to transforming textual descriptions into three-dimensional representations. This research proposes a fully…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Venkat Kumar R , Deepak Saravanan

We present a generative model of images that explicitly reasons over the set of objects they show. Our model learns a structured latent representation that separates objects from each other and from the background; unlike prior works, it…

Machine Learning · Computer Science 2020-04-03 Titas Anciukevicius , Christoph H. Lampert , Paul Henderson

Generative latent-variable models are emerging as promising tools in robotics and reinforcement learning. Yet, even though tasks in these domains typically involve distinct objects, most state-of-the-art generative models do not explicitly…

Machine Learning · Computer Science 2020-11-24 Martin Engelcke , Adam R. Kosiorek , Oiwi Parker Jones , Ingmar Posner

We present a simple yet powerful neural network that implicitly represents and renders 3D objects and scenes only from 2D observations. The network models 3D geometries as a general radiance field, which takes a set of 2D images with camera…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Alex Trevithick , Bo Yang

Generating images with both photorealism and multiview 3D consistency is crucial for 3D-aware GANs, yet existing methods struggle to achieve them simultaneously. Improving the photorealism via CNN-based 2D super-resolution can break the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Xingyu Chen , Yu Deng , Baoyuan Wang

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

Visual semantic correspondence is an important topic in computer vision and could help machine understand objects in our daily life. However, most previous methods directly train on correspondences in 2D images, which is end-to-end but…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Yang You , Chengkun Li , Yujing Lou , Zhoujun Cheng , Lizhuang Ma , Cewu Lu , Weiming Wang

3D open-world classification is a challenging yet essential task in dynamic and unstructured real-world scenarios, requiring both open-category and open-pose recognition. To address these challenges, recent wisdom often takes sophisticated…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Xinzhe Xia , Weiguang Zhao , Yuyao Yan , Guanyu Yang , Rui Zhang , Kaizhu Huang , Xi Yang

Significant strides have been made toward designing better generative models in recent years. Despite this progress, however, state-of-the-art approaches are still largely unable to capture complex global structure in data. For example,…

Machine Learning · Computer Science 2019-01-25 Halley Young , Osbert Bastani , Mayur Naik

Recent advances in visual generative models have highlighted the promise of learning generative world models. However, most existing approaches frame world modeling as novel-view synthesis or future-frame prediction, emphasizing visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yifan Yin , Zehao Wen , Jieneng Chen , Zehan Zheng , Nanru Dai , Haojun Shi , Suyu Ye , Aydan Huang , Zheyuan Zhang , Alan Yuille , Jianwen Xie , Ayush Tewari , Tianmin Shu

Human visual perception offers valuable insights for understanding computational principles of motion-based scene interpretation. Humans robustly detect and segment moving entities that constitute independently moveable chunks of matter,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Eric Li , Arijit Dasgupta , Yoni Friedman , Mathieu Huot , Vikash Mansinghka , Thomas O'Connell , William T. Freeman , Joshua B. Tenenbaum