English
Related papers

Related papers: Controllable Mesh Generation Through Sparse Latent…

200 papers

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

We are interested in reconstructing the mesh representation of object surfaces from point clouds. Surface reconstruction is a prerequisite for downstream applications such as rendering, collision avoidance for planning, animation, etc.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Minghua Liu , Xiaoshuai Zhang , Hao Su

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes, with the goal of synthesizing high-quality textures. Our approach is underpinned by two contributions: field latents, a latent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Thomas W. Mitchel , Carlos Esteves , Ameesh Makadia

Generative diffusion models have shown empirical successes in point cloud resampling, generating a denser and more uniform distribution of points from sparse or noisy 3D point clouds by progressively refining noise into structure. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Wenqiang Xu , Wenrui Dai , Duoduo Xue , Ziyang Zheng , Chenglin Li , Junni Zou , Hongkai Xiong

Spatial profiling technologies in biology, such as imaging mass cytometry (IMC) and spatial transcriptomics (ST), generate high-dimensional, multi-channel data with strong spatial alignment and complex inter-channel relationships.…

Machine Learning · Computer Science 2025-07-08 Haoran Zhang , Mingyuan Zhou , Wesley Tansey

Diffusion probabilistic models have achieved remarkable success in text guided image generation. However, generating 3D shapes is still challenging due to the lack of sufficient data containing 3D models along with their descriptions.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zijie Wu , Yaonan Wang , Mingtao Feng , He Xie , Ajmal Mian

Text-to-3D generation has recently garnered significant attention, fueled by 2D diffusion models trained on billions of image-text pairs. Existing methods primarily rely on score distillation to leverage the 2D diffusion priors to supervise…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Chaohui Yu , Qiang Zhou , Jingliang Li , Zhe Zhang , Zhibin Wang , Fan Wang

In this work, we explore the idea that effective generative models for point clouds under the autoencoding framework must acknowledge the relationship between a continuous surface, a discretized mesh, and a set of points sampled from the…

Machine Learning · Computer Science 2019-12-10 Austin Dill , Chun-Liang Li , Songwei Ge , Eunsu Kang

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

We present a probabilistic model for point cloud generation, which is fundamental for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in non-equilibrium…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shitong Luo , Wei Hu

A generative model for high-fidelity point clouds is of great importance in synthesizing 3d environments for applications such as autonomous driving and robotics. Despite the recent success of deep generative models for 2d images, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Cheng Wen , Baosheng Yu , Rao Fu , Dacheng Tao

Existing point cloud modeling datasets primarily express the modeling precision by pose or trajectory precision rather than the point cloud modeling effect itself. Under this demand, we first independently construct a set of LiDAR system…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Changjie Qiu , Zhiyong Wang , Xiuhong Lin , Yu Zang , Cheng Wang , Weiquan Liu

In this work, we propose a novel technique to generate shapes from point cloud data. A point cloud can be viewed as samples from a distribution of 3D points whose density is concentrated near the surface of the shape. Point cloud generation…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Ruojin Cai , Guandao Yang , Hadar Averbuch-Elor , Zekun Hao , Serge Belongie , Noah Snavely , Bharath Hariharan

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Diffusion models (DMs) are a powerful type of generative models that have achieved state-of-the-art results in various image synthesis tasks and have shown potential in other domains, such as natural language processing and temporal data…

Machine Learning · Computer Science 2026-02-05 Inês Cardoso Oliveira , Decebal Constantin Mocanu , Luis A. Leiva

Mesh generation is a crucial step in numerical simulations, significantly impacting simulation accuracy and efficiency. However, generating meshes remains time-consuming and requires expensive computational resources. In this paper, we…

Graphics · Computer Science 2024-07-03 Jiaming Peng , Xinhai Chen , Jie Liu

Diffusion models have shown remarkable success across a wide range of generative tasks. However, they often suffer from spatially inconsistent generation, arguably due to the inherent locality of their denoising mechanisms. This can yield…

Machine Learning · Computer Science 2026-02-04 Wenshuai Zhao , Zhiyuan Li , Yi Zhao , Mohammad Hassan Vali , Martin Trapp , Joni Pajarinen , Juho Kannala , Arno Solin

Efficiently generating energetically stable crystal structures has long been a challenge in material design, primarily due to the immense arrangement of atoms in a crystal lattice. To facilitate the discovery of stable material, we present…

Artificial Intelligence · Computer Science 2025-09-30 Zhelin Li , Rami Mrad , Runxian Jiao , Guan Huang , Jun Shan , Shibing Chu , Yuanping Chen

Although the recent rapid evolution of 3D generative neural networks greatly improves 3D shape generation, it is still not convenient for ordinary users to create 3D shapes and control the local geometry of generated shapes. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Xin-Yang Zheng , Hao Pan , Peng-Shuai Wang , Xin Tong , Yang Liu , Heung-Yeung Shum