English
Related papers

Related papers: Repurposing 2D Diffusion Models for 3D Shape Compl…

200 papers

This study introduces a novel point-wise diffusion model that processes spatio-temporal points independently to efficiently predict complex physical systems with shape variations. This methodological contribution lies in applying forward…

Computational Physics · Physics 2025-08-05 Jiyong Kim , Sunwoong Yang , Namwoo Kang

Enhancing AI systems to perform tasks following human instructions can significantly boost productivity. In this paper, we present InstructP2P, an end-to-end framework for 3D shape editing on point clouds, guided by high-level textual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiale Xu , Xintao Wang , Yan-Pei Cao , Weihao Cheng , Ying Shan , Shenghua Gao

Recent years have witnessed the surge of learned representations that directly build upon point clouds. Though becoming increasingly expressive, most existing representations still struggle to generate ordered point sets. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Jiaxin Wei , Lige Liu , Ran Cheng , Wenqing Jiang , Minghao Xu , Xinyu Jiang , Tao Sun , Soren Schwertfeger , Laurent Kneip

Probabilistic diffusion models have achieved state-of-the-art results for image synthesis, inpainting, and text-to-image tasks. However, they are still in the early stages of generating complex 3D shapes. This work proposes Diffusion-SDF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Gene Chou , Yuval Bahat , Felix Heide

The unpaired point cloud completion task aims to complete a partial point cloud by using models trained with no ground truth. Existing unpaired point cloud completion methods are class-aware, i.e., a separate model is needed for each object…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Yixuan Yang , Jinyu Yang , Zixiang Zhao , Victor Sanchez , Feng Zheng

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sander Elias Magnussen Helgesen , Kazuto Nakashima , Jim Tørresen , Ryo Kurazume

Recovering point clouds involves the sequential process of sampling and restoration, yet existing methods struggle to effectively leverage both topological and geometric attributes. To address this, we propose an end-to-end architecture…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaiyue Zhou , Zelong Tan , Hongxiao Wang , Ya-Li Li , Shengjin Wang

We address the problem of learning accurate 3D shape and camera pose from a collection of unlabeled category-specific images. We train a convolutional network to predict both the shape and the pose from a single image by minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Eldar Insafutdinov , Alexey Dosovitskiy

Diffusion models have emerged as the state-of-the-art for image generation, among other tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural fields. Our approach pre-processes training data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 J. Ryan Shue , Eric Ryan Chan , Ryan Po , Zachary Ankner , Jiajun Wu , Gordon Wetzstein

Diffusion Transformers have recently shown remarkable effectiveness in generating high-quality 3D point clouds. However, training voxel-based diffusion models for high-resolution 3D voxels remains prohibitively expensive due to the cubic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Shentong Mo , Enze Xie , Yue Wu , Junsong Chen , Matthias Nießner , Zhenguo Li

In this work, we present a novel framework built to simplify 3D asset generation for amateur users. To enable interactive generation, our method supports a variety of input modalities that can be easily provided by a human, including…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yen-Chi Cheng , Hsin-Ying Lee , Sergey Tulyakov , Alexander Schwing , Liangyan Gui

Diffusion probabilistic models have achieved remarkable success in text guided image generation. However, generating 3D shapes is still challenging due to the lack of sufficient data containing 3D models along with their descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zijie Wu , Yaonan Wang , Mingtao Feng , He Xie , Ajmal Mian

Generating a 3D point cloud from a single 2D image is of great importance for 3D scene understanding applications. To reconstruct the whole 3D shape of the object shown in the image, the existing deep learning based approaches use either…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Wei , George Vosselman , Michael Ying Yang

Scanning real-life scenes with modern registration devices typically give incomplete point cloud representations, mostly due to the limitations of the scanning process and 3D occlusions. Therefore, completing such partial representations…

Computer Vision and Pattern Recognition · Computer Science 2021-02-12 Przemysław Spurek , Artur Kasymov , Marcin Mazur , Diana Janik , Sławomir Tadeja , Łukasz Struski , Jacek Tabor , Tomasz Trzciński

Millimeter-wave radar offers a promising sensing modality for autonomous systems thanks to its robustness in adverse conditions and low cost. However, its utility is significantly limited by the sparsity and low resolution of radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruijie Zhang , Bixin Zeng , Shengpeng Wang , Fuhui Zhou , Wei Wang

In the area of 3D shape analysis, the geometric properties of a shape have long been studied. Instead of directly extracting representative features using expert-designed descriptors or end-to-end deep neural networks, this paper is…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zongji Wang , Yunfei Liu , Feng Lu

3D building generation with low data acquisition costs, such as single image-to-3D, becomes increasingly important. However, most of the existing single image-to-3D building creation works are restricted to those images with specific…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yao Wei , George Vosselman , Michael Ying Yang

Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xuelin Qian , Yu Wang , Simian Luo , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue , Bo Zhao , Tiejun Huang , Yunsheng Wu , Yanwei Fu

As two fundamental representation modalities of 3D objects, 3D point clouds and multi-view 2D images record shape information from different domains of geometric structures and visual appearances. In the current deep learning era,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Qijian Zhang , Junhui Hou , Yue Qian

3D LiDAR scene completion from point clouds is a fundamental component of perception systems in autonomous vehicles. Previous methods have predominantly employed diffusion models for high-fidelity reconstruction. However, their multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Wenzhe He , Xiaojun Chen , Ruiqi Wang , Ruihui Li , Huilong Pi , Jiapeng Zhang , Zhuo Tang , Kenli Li