English
Related papers

Related papers: Structured 3D Latents for Scalable and Versatile 3…

200 papers

High-quality 3D assets for traffic participants are critical for multi-sensor simulation, which is essential for the safe end-to-end development of autonomy. Building assets from in-the-wild data is key for diversity and realism, but…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Ze Yang , Jingkang Wang , Haowei Zhang , Sivabalan Manivasagam , Yun Chen , Raquel Urtasun

Despite the availability of large-scale 3D datasets and advancements in 3D generative models, the complexity and uneven quality of 3D geometry and texture data continue to hinder the performance of 3D generation techniques. In most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Xin Yang , Jiantao Lin , Yingjie Xu , Haodong Li , Yingcong Chen

Generative modeling of 3D human bodies have been studied extensively in computer vision. The core is to design a compact latent representation that is both expressive and semantically interpretable, yet existing approaches struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Haorui Ji , Rong Wang , Taojun Lin , Hongdong Li

3D Lookup Tables (3D LUTs) are widely used for color mapping, but their grid-based representation requires discretizing the RGB space, leading to a capacity-memory trade-off that becomes prohibitive when storing large numbers of LUTs.…

Graphics · Computer Science 2026-05-20 Danna Xue , David Serrano-Lozano , Shaolin Su , Javier Vazquez-Corral

We present a novel approach to the generation of static and articulated 3D assets that has a 3D autodecoder at its core. The 3D autodecoder framework embeds properties learned from the target dataset in the latent space, which can then be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Evangelos Ntavelis , Aliaksandr Siarohin , Kyle Olszewski , Chaoyang Wang , Luc Van Gool , Sergey Tulyakov

In the realm of digital creativity, our potential to craft intricate 3D worlds from imagination is often hampered by the limitations of existing digital tools, which demand extensive expertise and efforts. To narrow this disparity, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Longwen Zhang , Ziyu Wang , Qixuan Zhang , Qiwei Qiu , Anqi Pang , Haoran Jiang , Wei Yang , Lan Xu , Jingyi Yu

Generating high-quality 3D assets from text and images has long been challenging, primarily due to the absence of scalable 3D representations capable of capturing intricate geometry distributions. In this work, we introduce Direct3D, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shuang Wu , Youtian Lin , Feihu Zhang , Yifei Zeng , Jingxi Xu , Philip Torr , Xun Cao , Yao Yao

We propose LeafFit, a pipeline that converts 3D Gaussian Splatting (3DGS) of individual plants into editable, instanced mesh assets. While 3DGS faithfully captures complex foliage, its high memory footprint and lack of mesh topology make it…

Graphics · Computer Science 2026-02-13 Chang Luo , Nobuyuki Umetani

Recent approaches integrating vision-language models (VLMs) as prompt encoders for generative model conditioning typically rely on expensive end-to-end training or map features to compressed representations, discarding the dense spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Polytimi Anna Gkotsi , Andrii Zadaianchuk , Mohammad Mahdi Derakhshani

Modeling 3D articulated objects with realistic geometry, textures, and kinematics is essential for a wide range of applications. However, existing optimization-based reconstruction methods often require dense multi-view inputs and expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sylvia Yuan , Ruoxi Shi , Xinyue Wei , Xiaoshuai Zhang , Hao Su , Minghua Liu

Recent advancements in 3D content generation from text or a single image struggle with limited high-quality 3D datasets and inconsistency from 2D multi-view generation. We introduce DiffSplat, a novel 3D generative framework that natively…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Chenguo Lin , Panwang Pan , Bangbang Yang , Zeming Li , Yadong Mu

Recent breakthroughs in 3D generation have enabled the synthesis of high-fidelity individual assets. However, generating 3D compositional objects from single images--particularly under occlusions--remains challenging. Existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hui Shan , Keyang Luo , Ming Li , Sizhe Zheng , Yanwei Fu , Zhen Chen , Xiangru Huang

We introduce PartCrafter, the first structured 3D generative model that jointly synthesizes multiple semantically meaningful and geometrically distinct 3D meshes from a single RGB image. Unlike existing methods that either produce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yuchen Lin , Chenguo Lin , Panwang Pan , Honglei Yan , Yiqiang Feng , Yadong Mu , Katerina Fragkiadaki

Recent works on text-to-3d generation show that using only 2D diffusion supervision for 3D generation tends to produce results with inconsistent appearances (e.g., faces on the back view) and inaccurate shapes (e.g., animals with extra…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cheng Chen , Xiaofeng Yang , Fan Yang , Chengzeng Feng , Zhoujie Fu , Chuan-Sheng Foo , Guosheng Lin , Fayao Liu

This paper presents a novel decoder-based approach for generating manufacturable 3D structures optimized for additive manufacturing. We introduce a deep learning framework that decodes latent representations into geometrically valid,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Abhishek Kumar

Millimeter-wave radar offers a promising sensing modality for autonomous systems thanks to its robustness in adverse conditions and low cost. However, its utility is significantly limited by the sparsity and low resolution of radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruijie Zhang , Bixin Zeng , Shengpeng Wang , Fuhui Zhou , Wei Wang

Articulated 3D object generation is fundamental for creating realistic, functional, and interactable virtual assets which are not simply static. We introduce MeshArt, a hierarchical transformer-based approach to generate articulated 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Daoyi Gao , Yawar Siddiqui , Lei Li , Angela Dai

This paper investigates a 2D to 3D image translation method with a straightforward technique, enabling correlated 2D X-ray to 3D CT-like reconstruction. We observe that existing approaches, which integrate information across multiple 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Abril Corona-Figueroa , Hubert P. H. Shum , Chris G. Willcocks

With the onset of diffusion-based generative models and their ability to generate text-conditioned images, content generation has received a massive invigoration. Recently, these models have been shown to provide useful guidance for the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Alexander Vilesov , Pradyumna Chari , Achuta Kadambi

We present LT3SD, a novel latent diffusion model for large-scale 3D scene generation. Recent advances in diffusion models have shown impressive results in 3D object generation, but are limited in spatial extent and quality when extended to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Quan Meng , Lei Li , Matthias Nießner , Angela Dai