English
Related papers

Related papers: UDiFF: Generating Conditional Unsigned Distance Fi…

200 papers

Deep neural representations of 3D shapes as implicit functions have been shown to produce high fidelity models surpassing the resolution-memory trade-off faced by the explicit representations using meshes and point clouds. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Rahul Venkatesh , Tejan Karmali , Sarthak Sharma , Aurobrata Ghosh , R. Venkatesh Babu , László A. Jeni , Maneesh Singh

Diffusion models have emerged as a powerful generative method, capable of producing stunning photo-realistic images from natural language descriptions. However, these models lack explicit control over the 3D structure in the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Wufei Ma , Qihao Liu , Jiahao Wang , Angtian Wang , Xiaoding Yuan , Yi Zhang , Zihao Xiao , Guofeng Zhang , Beijia Lu , Ruxiao Duan , Yongrui Qi , Adam Kortylewski , Yaoyao Liu , Alan Yuille

Implicit fields have recently shown increasing success in representing and learning 3D shapes accurately. Signed distance fields and occupancy fields are decades old and still the preferred representations, both with well-studied…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Edoardo Mello Rella , Ajad Chhatkuli , Ender Konukoglu , Luc Van Gool

Recently, building on the foundation of neural radiance field, various techniques have emerged to learn unsigned distance fields (UDF) to reconstruct 3D non-watertight models from multi-view images. Yet, a central challenge in UDF-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Junkai Deng , Fei Hou , Xuhui Chen , Wencheng Wang , Ying He

Recent development of neural implicit function has shown tremendous success on high-quality 3D shape reconstruction. However, most works divide the space into inside and outside of the shape, which limits their representing power to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Yuntao Chen , Naiyan Wang , Xiaolong Wang

Diffusion models have become a new generative paradigm for text generation. Considering the discrete categorical nature of text, in this paper, we propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image…

Computation and Language · Computer Science 2023-05-09 Junyi Li , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Generative AI has emerged as a transformative paradigm in engineering design, enabling automated synthesis and reconstruction of complex 3D geometries while preserving feasibility and performance relevance. This paper introduces a…

Machine Learning · Computer Science 2026-01-21 Ashish S. Nair , Sandipp Krishnan Ravi , Itzel Salgado , Changjie Sun , Sayan Ghosh , Liping Wang

Transparent image layer generation plays a significant role in digital art and design workflows. Existing methods typically decompose transparent layers from a single RGB image using a set of tools or generate multiple transparent layers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Dingbang Huang , Wenbo Li , Yifei Zhao , Xinyu Pan , Chun Wang , Yanhong Zeng , Bo Dai

Diffusion models have achieved significant success in both natural image and medical image domains, encompassing a wide range of applications. Previous investigations in medical images have often been constrained to specific anatomical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yongrui Yu , Yannian Gu , Shaoting Zhang , Xiaofan Zhang

Molecule generation is a very important practical problem, with uses in drug discovery and material design, and AI methods promise to provide useful solutions. However, existing methods for molecule generation focus either on 2D graph…

Machine Learning · Computer Science 2024-02-07 Chenqing Hua , Sitao Luan , Minkai Xu , Rex Ying , Jie Fu , Stefano Ermon , Doina Precup

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

We present a StyleGAN2-based deep learning approach for 3D shape generation, called SDF-StyleGAN, with the aim of reducing visual and geometric dissimilarity between generated shapes and a shape collection. We extend StyleGAN2 to 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-06-27 Xin-Yang Zheng , Yang Liu , Peng-Shuai Wang , Xin Tong

Surface reconstruction for point clouds is an important task in 3D computer vision. Most of the latest methods resolve this problem by learning signed distance functions from point clouds, which are limited to reconstructing closed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Junsheng Zhou , Baorui Ma , Shujuan Li , Yu-Shen Liu , Yi Fang , Zhizhong Han

Unsigned Distance Fields (UDFs) can be used to represent non-watertight surfaces. However, current approaches to converting them into explicit meshes tend to either be expensive or to degrade the accuracy. Here, we extend the marching cube…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Benoit Guillard , Federico Stella , Pascal Fua

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Shanlin Sun , Kun Han , Deying Kong , Hao Tang , Xiangyi Yan , Xiaohui Xie

We present DiffInDScene, a novel framework for tackling the problem of high-quality 3D indoor scene generation, which is challenging due to the complexity and diversity of the indoor scene geometry. Although diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Ju , Zhaoyang Huang , Yijin Li , Guofeng Zhang , Yu Qiao , Hongsheng Li

Diffusion models, as a class of deep generative models, have recently emerged as powerful tools for robot skills by enabling stable training with reliable convergence. In this paper, we present an end-to-end framework for generating long,…

Implicit neural fields, typically encoded by a multilayer perceptron (MLP) that maps from coordinates (e.g., xyz) to signals (e.g., signed distances), have shown remarkable promise as a high-fidelity and compact representation. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Ziya Erkoç , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

We introduce SceneDiffuser, a conditional generative model for 3D scene understanding. SceneDiffuser provides a unified model for solving scene-conditioned generation, optimization, and planning. In contrast to prior works, SceneDiffuser is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Siyuan Huang , Zan Wang , Puhao Li , Baoxiong Jia , Tengyu Liu , Yixin Zhu , Wei Liang , Song-Chun Zhu