English
Related papers

Related papers: Structured 3D Latents for Scalable and Versatile 3…

200 papers

Recent unified 3D generation models have made remarkable progress in producing high-quality 3D assets from a single image. Notably, layout-aware approaches such as SAM3D can reconstruct multiple objects while preserving their spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Baicheng Li , Dong Wu , Jun Li , Shunkai Zhou , Zecui Zeng , Lusong Li , Hongbin Zha

In the field of computer vision, unsupervised learning for 2D object generation has advanced rapidly in the past few years. However, 3D object generation has not garnered the same attention or success as its predecessor. To facilitate novel…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Devendra K. Jangid , Neal R. Brodnik , Amil Khan , McLean P. Echlin , Tresa M. Pollock , Sam Daly , B. S. Manjunath

We present Density-Sampled Gaussians (DeG), a novel 3D representation designed to bridge the gap between adaptive rendering primitives and scalable generative modeling. Unlike existing approaches that constrain 3D Gaussians to fixed voxel…

Graphics · Computer Science 2026-05-19 Runjie Yan , Yan-Pei Cao , Peng Wang , Ding Liang , Yuan-Chen Guo

Language-augmented scene representations hold great promise for large-scale robotics applications such as search-and-rescue, smart cities, and mining. Many of these scenarios are time-sensitive, requiring rapid scene encoding while also…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Laszlo Szilagyi , Francis Engelmann , Jeannette Bohg

Feedforward 3D Gaussian Splatting (3DGS) overcomes the limitations of optimization-based 3DGS by enabling fast and high-quality reconstruction without the need for per-scene optimization. However, existing feedforward approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Anran Wu , Long Peng , Xin Di , Xueyuan Dai , Chen Wu , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

Existing 3D reconstruction methods utilize guidances such as 2D images, 3D point clouds, shape contours and single semantics to recover the 3D surface, which limits the creative exploration of 3D modeling. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Liangchen Li , Caoliwen Wang , Yuqi Zhou , Bailin Deng , Juyong Zhang

The generation of high-quality 3D car assets is essential for various applications, including video games, autonomous driving, and virtual reality. Current 3D generation methods utilizing NeRF or 3D-GS as representations for 3D objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xiaoxue Chen , Jv Zheng , Hao Huang , Haoran Xu , Weihao Gu , Kangliang Chen , He xiang , Huan-ang Gao , Hao Zhao , Guyue Zhou , Yaqin Zhang

Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance. By performing score distillation sampling (SDS) iteratively across different views, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zeyu Li , Ruitong Gan , Chuanchen Luo , Yuxi Wang , Jiaheng Liu , Ziwei Zhu Man Zhang , Qing Li , Xucheng Yin , Zhaoxiang Zhang , Junran Peng

We present RELATE, a model that learns to generate physically plausible scenes and videos of multiple interacting objects. Similar to other generative approaches, RELATE is trained end-to-end on raw, unlabeled data. RELATE combines an…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Sebastien Ehrhardt , Oliver Groth , Aron Monszpart , Martin Engelcke , Ingmar Posner , Niloy Mitra , Andrea Vedaldi

Single-image 3D generation lies at the core of vision-to-graphics models in the real world. However, it remains a fundamental challenge to achieve reliable generalization across diverse semantic categories and highly variable structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bi'an Du , Daizong Liu , Pufan Li , Wei Hu

Large-scale video generative models can synthesize diverse and realistic visual content for dynamic world creation, but they often lack element-wise controllability, hindering their use in editing scenes and training embodied AI agents. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sicheng Mo , Ziyang Leng , Leon Liu , Weizhen Wang , Honglin He , Bolei Zhou

Current methods for 2D and 3D object understanding struggle with severe occlusions in busy urban environments, partly due to the lack of large-scale labeled ground-truth annotations for learning occlusion. In this work, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Khiem Vuong , N. Dinesh Reddy , Robert Tamburo , Srinivasa G. Narasimhan

We present a novel high-resolution face swapping method using the inherent prior knowledge of a pre-trained GAN model. Although previous research can leverage generative priors to produce high-resolution results, their quality can suffer…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yangyang Xu , Bailin Deng , Junle Wang , Yanqing Jing , Jia Pan , Shengfeng He

In text-driven 3D scene generation, object layout serves as a crucial intermediate representation that bridges high-level language instructions with detailed geometric output. It not only provides a structural blueprint for ensuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yiheng Zhang , Zhuojiang Cai , Mingdao Wang , Meitong Guo , Tianxiao Li , Li Lin , Yuwang Wang

We suggest a new multi-modal algorithm for joint inference of paired structurally aligned samples with Rectified Flow models. While some existing methods propose a codependent generation process, they do not view the problem of joint…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Boyi Pang , Savva Ignatyev , Vladimir Ippolitov , Ramil Khafizov , Yurii Melnik , Oleg Voynov , Maksim Nakhodnov , Aibek Alanov , Xiaopeng Fan , Peter Wonka , Evgeny Burnaev

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Prevailing 3D texture generation methods, which often rely on multi-view fusion, are frequently hindered by inter-view inconsistencies and incomplete coverage of complex surfaces, limiting the fidelity and completeness of the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifei Zeng , Yajie Bao , Jiachen Qian , Shuang Wu , Youtian Lin , Hao Zhu , Buyu Li , Feihu Zhang , Xun Cao , Yao Yao

In this paper, we introduce LATO, a novel topology-preserving latent representation that enables scalable, flow matching-based synthesis of explicit 3D meshes. LATO represents a mesh as a Vertex Displacement Field (VDF) anchored on surface,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Tianhao Zhao , Youjia Zhang , Hang Long , Jinshen Zhang , Wenbing Li , Yang Yang , Gongbo Zhang , Jozef Hladký , Matthias Nießner , Wei Yang

With the rapid advancement of diffusion-based generative models, portrait image animation has achieved remarkable results. However, it still faces challenges in temporally consistent video generation and fast sampling due to its iterative…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Taekyung Ki , Dongchan Min , Gyeongsu Chae

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende