English
Related papers

Related papers: Repurposing 2D Diffusion Models for 3D Shape Compl…

200 papers

We present a novel 3D shape completion framework that unifies multimodal conditioning, leveraging both 2D images and 3D partial scans through a latent diffusion model. Shapes are represented as Truncated Signed Distance Functions (TSDFs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Simon Schaefer , Juan D. Galvis , Xingxing Zuo , Stefan Leutengger

Reference-driven image completion, which restores missing regions in a target view using additional images, is particularly challenging when the target view differs significantly from the references. Existing generative methods rely solely…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Beibei Lin , Tingting Chen , Robby T. Tan

Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve…

Machine Learning · Computer Science 2020-07-21 Sameera Ramasinghe , Salman Khan , Nick Barnes , Stephen Gould

Point cloud completion, which aims at recovering original shape information from partial point clouds, has attracted attention on 3D vision community. Existing methods usually succeed in completion for standard shape, while failing to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Junshu Tang , Jiachen Xu , Jingyu Gong , Haichuan Song , Yuan Xie , Lizhuang Ma

3D point clouds directly collected from objects through sensors are often incomplete due to self-occlusion. Conventional methods for completing these partial point clouds rely on manually organized training sets and are usually limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Tianxin Huang , Zhiwen Yan , Yuyang Zhao , Gim Hee Lee

Point cloud completion aims to reconstruct complete 3D shapes from partial observations, which is a challenging problem due to severe occlusions and missing geometry. Despite recent advances in multimodal techniques that leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Wang Luo , Di Wu , Hengyuan Na , Yinlin Zhu , Miao Hu , Guocong Quan

Denoising diffusion models have demonstrated outstanding results in 2D image generation, yet it remains a challenge to replicate its success in 3D shape generation. In this paper, we propose leveraging multi-view depth, which represents…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zhen Wang , Qiangeng Xu , Feitong Tan , Menglei Chai , Shichen Liu , Rohit Pandey , Sean Fanello , Achuta Kadambi , Yinda Zhang

Diffusion-based models, widely used in text-to-image generation, have proven effective in 2D representation learning. Recently, this framework has been extended to 3D self-supervised learning by constructing a conditional point generator…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Chen , Shanshan Zhao , Lunhao Duan , Changxing Ding , Dacheng Tao

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

Point-based representations have consistently played a vital role in geometric data structures. Most point cloud learning and processing methods typically leverage the unordered and unconstrained nature to represent the underlying geometry…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Jionghao Wang , Cheng Lin , Yuan Liu , Rui Xu , Zhiyang Dou , Xiao-Xiao Long , Hao-Xiang Guo , Taku Komura , Wenping Wang , Xin Li

We present a novel 3D shape completion method that operates directly on unstructured point clouds, thus avoiding resource-intensive data structures like voxel grids. To this end, we introduce KAPLAN, a 3D point descriptor that aggregates…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Audrey Richard , Ian Cherabier , Martin R. Oswald , Marc Pollefeys , Konrad Schindler

In the realm of 3D computer vision, parametric models have emerged as a ground-breaking methodology for the creation of realistic and expressive 3D avatars. Traditionally, they rely on Principal Component Analysis (PCA), given its ability…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Rolandos Alexandros Potamias , Michail Tarasiou , Stylianos Ploumpis , Stefanos Zafeiriou

In recent years, 3D vision has become a crucial field within computer vision, powering a wide range of applications such as autonomous driving, robotics, augmented reality, and medical imaging. This field relies on accurate perception,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhen Wang , Dongyuan Li , Yaozu Wu , Tianyu He , Jiang Bian , Renhe Jiang

Point cloud completion is the task of predicting complete geometry from partial observations using a point set representation for a 3D shape. Previous approaches propose neural networks to directly estimate the whole point cloud through…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Alexis Mendoza , Alexander Apaza , Ivan Sipiran , Cristian Lopez

We introduce a latent 3D representation that models 3D surfaces as probability density functions in 3D, i.e., p(x,y,z), with flow-matching. Our representation is specifically designed for consumption by machine learning models, offering…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jen-Hao Rick Chang , Yuyang Wang , Miguel Angel Bautista Martin , Jiatao Gu , Xiaoming Zhao , Josh Susskind , Oncel Tuzel

Recent Diffusion Transformers (e.g., DiT) have demonstrated their powerful effectiveness in generating high-quality 2D images. However, it is still being determined whether the Transformer architecture performs equally well in 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Shentong Mo , Enze Xie , Ruihang Chu , Lewei Yao , Lanqing Hong , Matthias Nießner , Zhenguo Li

3D scanning is a complex multistage process that generates a point cloud of an object typically containing damaged parts due to occlusions, reflections, shadows, scanner motion, specific properties of the object surface, imperfect…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Taras Rumezhak , Oles Dobosevych , Rostyslav Hryniv , Vladyslav Selotkin , Volodymyr Karpiv , Mykola Maksymenko

3D point cloud completion, the task of inferring the complete geometric shape from a partial point cloud, has been attracting attention in the community. For acquiring high-fidelity dense point clouds and avoiding uneven distribution,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Minghua Liu , Lu Sheng , Sheng Yang , Jing Shao , Shi-Min Hu

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard