English
Related papers

Related papers: Diffusion-SDF: Conditional Generative Modeling of …

200 papers

Object completion networks typically produce static Signed Distance Fields (SDFs) that faithfully reconstruct geometry but cannot be rescaled or deformed without introducing structural distortions. This limitation restricts their use in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Jelle Vermandere , Maarten Bassier , Maarten Vergauwen

Multi-view shape reconstruction has achieved impressive progresses thanks to the latest advances in neural implicit surface rendering. However, existing methods based on signed distance function (SDF) are limited to closed surfaces, failing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yu-Tao Liu , Li Wang , Jie yang , Weikai Chen , Xiaoxu Meng , Bo Yang , Lin Gao

In this work we study how diffusion-based generative models produce high-dimensional data, such as an image, by implicitly relying on a manifestation of a low-dimensional set of latent abstractions, that guide the generative process. We…

Machine Learning · Computer Science 2024-10-07 Giulio Franzese , Mattia Martini , Giulio Corallo , Paolo Papotti , Pietro Michiardi

In this paper, we present a novel shape reconstruction method leveraging diffusion model to generate 3D sparse point cloud for the object captured in a single RGB image. Recent methods typically leverage global embedding or local…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yan Di , Chenyangguang Zhang , Pengyuan Wang , Guangyao Zhai , Ruida Zhang , Fabian Manhardt , Benjamin Busam , Xiangyang Ji , Federico Tombari

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Roy Or-El , Xuan Luo , Mengyi Shan , Eli Shechtman , Jeong Joon Park , Ira Kemelmacher-Shlizerman

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Diffusion-based generative models represent the current state-of-the-art for image generation. However, standard diffusion models are based on Euclidean geometry and do not translate directly to manifold-valued data. In this work, we…

Machine Learning · Computer Science 2023-12-20 Yesukhei Jagvaral , Francois Lanusse , Rachel Mandelbaum

We introduce a single-view reconstruction technique of volumetric fields in which multiple light scattering effects are omnipresent, such as in clouds. We model the unknown distribution of volumetric fields using an unconditional diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ludwic Leonard , Nils Thuerey , Ruediger Westermann

Fully-supervised category-level pose estimation aims to determine the 6-DoF poses of unseen instances from known categories, requiring expensive mannual labeling costs. Recently, various self-supervised category-level pose estimation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jingtao Sun , Yaonan Wang , Mingtao Feng , Chao Ding , Mike Zheng Shou , Ajmal Saeed Mian

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

In this paper, we learn a diffusion model to generate 3D data on a scene-scale. Specifically, our model crafts a 3D scene consisting of multiple objects, while recent diffusion research has focused on a single object. To realize our goal,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Jumin Lee , Woobin Im , Sebin Lee , Sung-Eui Yoon

In this paper, we introduce a novel 3D-aware image generation method that leverages 2D diffusion models. We formulate the 3D-aware image generation task as multiview 2D image set generation, and further to a sequential…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Jianfeng Xiang , Jiaolong Yang , Binbin Huang , Xin Tong

3D human shape reconstruction under severe occlusion due to human-object or human-human interaction is a challenging problem. Parametric models i.e., SMPL(-X), which are based on the statistics across human shapes, can represent whole human…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Donghwan Kim , Tae-Kyun Kim

Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications…

Machine Learning · Computer Science 2025-11-26 Sifan Wang , Zehao Dou , Siming Shan , Tong-Rui Liu , Lu Lu

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

The neural implicit representation has shown its effectiveness in novel view synthesis and high-quality 3D reconstruction from multi-view images. However, most approaches focus on holistic scene representation yet ignore individual objects…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Qianyi Wu , Xian Liu , Yuedong Chen , Kejie Li , Chuanxia Zheng , Jianfei Cai , Jianmin Zheng

Dense point cloud generation from a sparse or incomplete point cloud is a crucial and challenging problem in 3D computer vision and computer graphics. So far, the existing methods are either computationally too expensive, suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Abol Basher , Jani Boutellier

Neural implicit representation is a promising approach for reconstructing surfaces from point clouds. Existing methods combine various regularization terms, such as the Eikonal and Laplacian energy terms, to enforce the learned neural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Zixiong Wang , Yunxiao Zhang , Rui Xu , Fan Zhang , Pengshuai Wang , Shuangmin Chen , Shiqing Xin , Wenping Wang , Changhe Tu

Generating physically plausible human motion is crucial for applications such as character animation and virtual reality. Existing approaches often incorporate a simulator-based motion projection layer to the diffusion process to enforce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Akihisa Watanabe , Jiawei Ren , Li Siyao , Yichen Peng , Erwin Wu , Edgar Simo-Serra