English
Related papers

Related papers: GENA3D: Generative Amodal 3D Modeling by Bridging …

200 papers

We present MoGA, a novel method to reconstruct high-fidelity 3D Gaussian avatars from a single-view image. The main challenge lies in inferring unseen appearance and geometric details while ensuring 3D consistency and realism. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zijian Dong , Longteng Duan , Jie Song , Michael J. Black , Andreas Geiger

We present a novel alignment-before-generation approach to tackle the challenging task of generating general 3D shapes based on 2D images or texts. Directly learning a conditional generative model from images or texts to 3D shapes is prone…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zibo Zhao , Wen Liu , Xin Chen , Xianfang Zeng , Rui Wang , Pei Cheng , Bin Fu , Tao Chen , Gang Yu , Shenghua Gao

Despite the recent advancement of Generative Adversarial Networks (GANs) in learning 3D-aware image synthesis from 2D data, existing methods fail to model indoor scenes due to the large diversity of room layouts and the objects inside. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Zifan Shi , Yujun Shen , Jiapeng Zhu , Dit-Yan Yeung , Qifeng Chen

Multi-view image generation holds significant application value in computer vision, particularly in domains like 3D reconstruction, virtual reality, and augmented reality. Most existing methods, which rely on extending single images, face…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jiaqi Wu , Yaosen Chen , Shuyuan Zhu

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Minghao Chen , Jianyuan Wang , Roman Shapovalov , Tom Monnier , Hyunyoung Jung , Dilin Wang , Rakesh Ranjan , Iro Laina , Andrea Vedaldi

Generative 3D modeling has advanced rapidly, driven by applications in VR/AR, metaverse, and robotics. However, most methods represent the target object as a closed mesh devoid of any structural information, limiting editing, animation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Omid Bonakdar , Nasser Mozayani

Previous approaches to generate shapes in a 3D setting train a GAN on the latent space of an autoencoder (AE). Even though this produces convincing results, it has two major shortcomings. As the GAN is limited to reproduce the dataset the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Moritz Ibing , Isaak Lim , Leif Kobbelt

Understanding, navigating, and exploring the 3D physical real world has long been a central challenge in the development of artificial intelligence. In this work, we take a step toward this goal by introducing GenEx, a system capable of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Taiming Lu , Tianmin Shu , Junfei Xiao , Luoxin Ye , Jiahao Wang , Cheng Peng , Chen Wei , Daniel Khashabi , Rama Chellappa , Alan Yuille , Jieneng Chen

Understanding the 3D geometry and semantics of driving scenes is critical for safe autonomous driving. Recent advances in 3D occupancy prediction have improved scene representation but often suffer from visual inconsistencies, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Loïck Chambon , Eloi Zablocki , Alexandre Boulch , Mickaël Chen , Matthieu Cord

Recently, multi-view diffusion-based 3D generation methods have gained significant attention. However, these methods often suffer from shape and texture misalignment across generated multi-view images, leading to low-quality 3D generation…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhuojiang Cai , Yiheng Zhang , Meitong Guo , Mingdao Wang , Yuwang Wang

With the growing demand for high-fidelity 3D models from 2D images, existing methods still face significant challenges in accurately reproducing fine-grained geometric details due to limitations in domain gaps and inherent ambiguities in…

Graphics · Computer Science 2025-04-01 Chongjie Ye , Yushuang Wu , Ziteng Lu , Jiahao Chang , Xiaoyang Guo , Jiaqing Zhou , Hao Zhao , Xiaoguang Han

3D scene generation is in high demand across various domains, including virtual reality, gaming, and the film industry. Owing to the powerful generative capabilities of text-to-image diffusion models that provide reliable priors, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haiyang Zhou , Xinhua Cheng , Wangbo Yu , Yonghong Tian , Li Yuan

Current compositional image-to-3D scene generation approaches construct 3D scenes by time-consuming iterative layout optimization or inflexible joint object-layout generation. Moreover, most methods rely on limited field-of-view perspective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zidian Qiu , Ancong Wu

We present GR3D, a spatial vision language model equipped with three complementary grounding capabilities--explicit 2D grounding, implicit 2D grounding, and monocular 3D grounding--within a single framework. GR3D introduces an implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 An-Chieh Cheng , Yang Fu , Yatai Ji , Ligeng Zhu , Guanqi Zhan , Zhuoyang Zhang , Zhaojing Yang , Song Han , Yao Lu , Pavlo Molchanov , Vidya Nariyambut Murali , Jan Kautz , Xiaolong Wang , Hongxu Yin , Sifei Liu

Image-to-3D generation faces inherent semantic ambiguity under occlusion, where partial observation alone is often insufficient to determine object category. In this work, we formalize text-driven amodal 3D generation, where text prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiayin Zhu , Guoji Fu , Xiaolu Liu , Qiyuan He , Yicong Li , Angela Yao

Feed-forward 3D reconstruction has revolutionized 3D vision, providing a powerful baseline for downstream tasks such as novel-view synthesis with 3D Gaussian Splatting. Previous works explore fixing the corrupted rendering results with a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiming Huang , Baixiang Huang , Beilei Cui , Chi Kit Ng , Long Bai , Hongliang Ren

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

Machine Learning · Computer Science 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

Generative models for structure-based molecular design hold significant promise for drug discovery, with the potential to speed up the hit-to-lead development cycle, while improving the quality of drug candidates and reducing costs. Data…

Machine Learning · Statistics 2022-04-25 Lucian Chan , Rajendra Kumar , Marcel Verdonk , Carl Poelking

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy

We propose a probabilistic shape completion method extended to the continuous geometry of large-scale 3D scenes. Real-world scans of 3D scenes suffer from a considerable amount of missing data cluttered with unsegmented objects. The problem…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Dongsu Zhang , Changwoon Choi , Inbum Park , Young Min Kim