English
Related papers

Related papers: Deformable 3D Shape Diffusion Model

200 papers

Text-to-3D, known for its efficient generation methods and expansive creative potential, has garnered significant attention in the AIGC domain. However, the pixel-wise rendering of NeRF and its ray marching light sampling constrain the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xinhai Li , Huaibin Wang , Kuo-Kun Tseng

We introduce a new diffusion-based approach for shape completion on 3D range scans. Compared with prior deterministic and probabilistic methods, we strike a balance between realism, multi-modality, and high fidelity. We propose DiffComplete…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ruihang Chu , Enze Xie , Shentong Mo , Zhenguo Li , Matthias Nießner , Chi-Wing Fu , Jiaya Jia

Mesh generation is of great value in various applications involving computer graphics and virtual content, yet designing generative models for meshes is challenging due to their irregular data structure and inconsistent topology of meshes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Zhaoyang Lyu , Jinyi Wang , Yuwei An , Ya Zhang , Dahua Lin , Bo Dai

Adversarial attack methods for 3D point cloud classification reveal the vulnerabilities of point cloud recognition models. This vulnerability could lead to safety risks in critical applications that use deep learning models, such as…

Cryptography and Security · Computer Science 2025-07-30 Ruiyang Zhao , Bingbing Zhu , Chuxuan Tong , Xiaoyi Zhou , Xi Zheng

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph…

Machine Learning · Computer Science 2024-02-07 Chenqing Hua , Sitao Luan , Minkai Xu , Rex Ying , Jie Fu , Stefano Ermon , Doina Precup

Generating a 3D point cloud from a single 2D image is of great importance for 3D scene understanding applications. To reconstruct the whole 3D shape of the object shown in the image, the existing deep learning based approaches use either…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yao Wei , George Vosselman , Michael Ying Yang

This paper presents DiffSurf, a transformer-based denoising diffusion model for generating and reconstructing 3D surfaces. Specifically, we design a diffusion transformer architecture that predicts noise from noisy 3D surface vertices and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Yusuke Yoshiyasu , Leyuan Sun

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Diffusion-based image generators can now produce high-quality and diverse samples, but their success has yet to fully translate to 3D generation: existing diffusion methods can either generate low-resolution but 3D consistent outputs, or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Animesh Karnewar , Niloy J. Mitra , Andrea Vedaldi , David Novotny

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

Representing 3D shape in deep learning frameworks in an accurate, efficient and compact manner still remains an open challenge. Most existing work addresses this issue by employing voxel-based representations. While these approaches benefit…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Dominic Jack , Jhony K. Pontes , Sridha Sridharan , Clinton Fookes , Sareh Shirazi , Frederic Maire , Anders Eriksson

In this paper, we propose a novel approach to 3D deformable object manipulation leveraging a deep neural network called DeformerNet. Controlling the shape of a 3D object requires an effective state representation that can capture the full…

Robotics · Computer Science 2021-07-20 Bao Thach , Alan Kuntz , Tucker Hermans

Diffusion models have made breakthroughs in 3D generation tasks. Current 3D diffusion models focus on reconstructing target shape from images or a set of partial observations. While excelling in global context understanding, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yuanbo Wang , Zhaoxuan Zhang , Jiajin Qiu , Dilong Sun , Zhengyu Meng , Xiaopeng Wei , Xin Yang

Recent generative models can create visually plausible 3D representations of objects. However, the generation process often allows for implicit control signals, such as contextual descriptions, and rarely supports bold geometric distortions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Changwoon Choi , Hyunsoo Lee , Clément Jambon , Yael Vinker , Young Min Kim

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pufan Li , Bi'an Du , Wei Hu

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

In this work, we propose a novel technique to generate shapes from point cloud data. A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape. Point cloud generation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Ruojin Cai , Guandao Yang , Hadar Averbuch-Elor , Zekun Hao , Serge Belongie , Noah Snavely , Bharath Hariharan

Diffusion models have emerged as powerful tools for molecular generation, particularly in the context of 3D molecular structures. Inspired by non-equilibrium statistical physics, these models can generate 3D molecular structures with…

Chemical Physics · Physics 2025-05-16 Amira Alakhdar , Barnabas Poczos , Newell Washburn