English
Related papers

Related papers: Mosaic-SDF for 3D Generative Models

200 papers

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Accurate 3D shape representation is essential in engineering applications such as design, optimization, and simulation. In practice, engineering workflows require structured, part-based representations, as objects are inherently designed as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Nicolas Talabot , Olivier Clerc , Arda Cinar Demirtas , Alexis Goujon , Hieu Le , Doruk Oner , Pascal Fua

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

We present Surf-D, a novel method for generating high-quality 3D shapes as Surfaces with arbitrary topologies using Diffusion models. Previous methods explored shape generation with different representations and they suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Zhengming Yu , Zhiyang Dou , Xiaoxiao Long , Cheng Lin , Zekun Li , Yuan Liu , Norman Müller , Taku Komura , Marc Habermann , Christian Theobalt , Xin Li , Wenping Wang

A main challenge in mechanical design is to efficiently explore the design space while satisfying engineering constraints. This work explores the use of 3D generative models to explore the design space in the context of vehicle development,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Hayata Morita , Kohei Shintani , Chenyang Yuan , Frank Permenter

3D shape generation aims to produce innovative 3D content adhering to specific conditions and constraints. Existing methods often decompose 3D shapes into a sequence of localized components, treating each element in isolation without…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Ruikai Cui , Weizhe Liu , Weixuan Sun , Senbo Wang , Taizhang Shang , Yang Li , Xibin Song , Han Yan , Zhennan Wu , Shenzhou Chen , Hongdong Li , Pan Ji

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

Generative AI has emerged as a transformative paradigm in engineering design, enabling automated synthesis and reconstruction of complex 3D geometries while preserving feasibility and performance relevance. This paper introduces a…

Machine Learning · Computer Science 2026-01-21 Ashish S. Nair , Sandipp Krishnan Ravi , Itzel Salgado , Changjie Sun , Sayan Ghosh , Liping Wang

Reconstructing 3D vehicles from noisy and sparse partial point clouds is of great significance to autonomous driving. Most existing 3D reconstruction methods cannot be directly applied to this problem because they are elaborately designed…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Yibo Liu , Kelly Zhu , Guile Wu , Yuan Ren , Bingbing Liu , Yang Liu , Jinjun Shan

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural network to approximate complex shapes with implicit…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Towaki Takikawa , Joey Litalien , Kangxue Yin , Karsten Kreis , Charles Loop , Derek Nowrouzezahrai , Alec Jacobson , Morgan McGuire , Sanja Fidler

Diffusion models have demonstrated exceptional efficacy in various generative applications. While existing models focus on minimizing a weighted sum of denoising score matching losses for data distribution modeling, their training primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Ling Yang , Haotian Qian , Zhilong Zhang , Jingwei Liu , Bin Cui

Learning robust visuomotor policies that generalize across diverse objects and interaction dynamics remains a central challenge in robotic manipulation. Most existing approaches rely on direct observation-to-action mappings or compress…

Robotics · Computer Science 2025-09-24 Sangjun Noh , Dongwoo Nam , Kangmin Kim , Geonhyup Lee , Yeonguk Yu , Raeyoung Kang , Kyoobin Lee

Dense reconstruction and differentiable rendering are fundamental tightly connected operations in 3D vision and computer graphics. Recent neural implicit representations demonstrate compelling advantages in reconstruction fidelity and…

Robotics · Computer Science 2026-05-25 Zhirui Dai , Hojoon Shin , Yulun Tian , Ki Myung Brian Lee , Nikolay Atanasov

Current Structure-from-Motion (SfM) methods typically follow a two-stage pipeline, combining learned or geometric pairwise reasoning with a subsequent global optimization step. In contrast, we propose a data-driven multi-view reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Qitao Zhao , Amy Lin , Jeff Tan , Jason Y. Zhang , Deva Ramanan , Shubham Tulsiani

Diffusion-based models have shown great promise in molecular generation but often require a large number of sampling steps to generate valid samples. In this paper, we introduce a novel Straight-Line Diffusion Model (SLDM) to tackle this…

Machine Learning · Computer Science 2025-06-10 Yuyan Ni , Shikun Feng , Haohan Chi , Bowen Zheng , Huan-ang Gao , Wei-Ying Ma , Zhi-Ming Ma , Yanyan Lan

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

Diffusion models have shown remarkable results for image generation, editing and inpainting. Recent works explore diffusion models for 3D shape generation with neural implicit functions, i.e., signed distance function and occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Junsheng Zhou , Weiqi Zhang , Baorui Ma , Kanle Shi , Yu-Shen Liu , Zhizhong Han

Presenting a 3D scene from multiview images remains a core and long-standing challenge in computer vision and computer graphics. Two main requirements lie in rendering and reconstruction. Notably, SOTA rendering quality is usually achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Mulin Yu , Tao Lu , Linning Xu , Lihan Jiang , Yuanbo Xiangli , Bo Dai