English
Related papers

Related papers: Controlled Latent Diffusion Models for 3D Porous M…

200 papers

Diffusion-based voxel prior modelling is challenging for the reconstruction of large-scale 3D porous microstructures. Due to the demanding requirements for simultaneously modelling both the continuous pore morphology and the discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yue Shi , Peng Wang , Mingzhe Yu , Yunlong Zhao , Li Liu , Gareth D Hatton , Yan Lyu , Liangxiu Han

Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in generative modeling. Fueled by its flexibility in the formulation and strong modeling power of the latent space, recent works built…

Machine Learning · Computer Science 2023-10-06 Peiyu Yu , Sirui Xie , Xiaojian Ma , Baoxiong Jia , Bo Pang , Ruiqi Gao , Yixin Zhu , Song-Chun Zhu , Ying Nian Wu

Reconstructing high-quality point clouds from images remains challenging in computer vision. Existing generative-model-based approaches, particularly diffusion-model approaches that directly learn the posterior, may suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Seunghyeok Shin , Dabin Kim , Hongki Lim

With recent text-to-image models, anyone can generate deceptively realistic images with arbitrary contents, fueling the growing threat of visual disinformation. A key enabler for generating high-resolution images with low computational cost…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jonas Ricker , Denis Lukovnikov , Asja Fischer

3D molecule generation is crucial for drug discovery and material science, requiring models to process complex multi-modalities, including atom types, chemical bonds, and 3D coordinates. A key challenge is integrating these modalities of…

Machine Learning · Computer Science 2025-10-14 Yanchen Luo , Zhiyuan Liu , Yi Zhao , Sihang Li , Hengxing Cai , Kenji Kawaguchi , Tat-Seng Chua , Yang Zhang , Xiang Wang

Microstructure reconstruction serves as a crucial foundation for establishing Process-Structure-Property (PSP) relationship in material design. Confronting the limitations of variational autoencoder and generative adversarial network within…

Computational Engineering, Finance, and Science · Computer Science 2023-11-30 Xianrui Lyu , Xiaodan Ren

The inverse design of metasurfaces faces inherent challenges due to the nonlinear and highly complex relationship between geometric configurations and their electromagnetic behavior. Traditional optimization approaches often suffer from…

Understanding and representing the structure of 3D objects in an unsupervised manner remains a core challenge in computer vision and graphics. Most existing unsupervised keypoint methods are not designed for unconditional generative…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Rhys Newbury , Juyan Zhang , Tin Tran , Hanna Kurniawati , Dana Kulić

The tremendous progress in neural image generation, coupled with the emergence of seemingly omnipotent vision-language models has finally enabled text-based interfaces for creating and editing images. Handling generic images requires a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Omri Avrahami , Ohad Fried , Dani Lischinski

Recent advances in fast sampling methods for diffusion models have demonstrated significant potential to accelerate generation on image modalities. We apply these methods to 3-dimensional molecular conformations by building on the recently…

Quantitative Methods · Quantitative Biology 2024-04-23 Romain Lacombe , Neal Vaidya

As a class of fruitful approaches, diffusion probabilistic models (DPMs) have shown excellent advantages in high-resolution image reconstruction. On the other hand, masked autoencoders (MAEs), as popular self-supervised vision learners,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zhiyuan Ma , zhihuan yu , Jianjun Li , Bowen Zhou

Latent diffusion models (LDMs) achieve state-of-the-art performance across various tasks, including image generation and video synthesis. However, they generally lack robustness, a limitation that remains not fully explored in current…

Machine Learning · Computer Science 2025-06-10 Boris Martirosyan , Alexey Karmanov

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Diffusion Models (DMs) have demonstrated state-of-the-art performance in content generation without requiring adversarial training. These models are trained using a two-step process. First, a forward - diffusion - process gradually adds…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Anwaar Ulhaq , Naveed Akhtar

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Boah Kim , Jong Chul Ye

Latest diffusion-based methods for many image restoration tasks outperform traditional models, but they encounter the long-time inference problem. To tackle it, this paper proposes a Wavelet-Based Diffusion Model (WaveDM). WaveDM learns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Yi Huang , Jiancheng Huang , Jianzhuang Liu , Mingfu Yan , Yu Dong , Jiaxi Lv , Chaoqi Chen , Shifeng Chen

Geological parameterization procedures entail the mapping of a high-dimensional geomodel to a low-dimensional latent variable. These parameterizations can be very useful for history matching because the number of variables to be calibrated…

Geophysics · Physics 2026-01-19 Guido Di Federico , Louis J. Durlofsky

Diffusion models have achieved great success in image generation tasks. However, the lengthy denoising process and complex neural networks hinder their low-latency applications in real-world scenarios. Quantization can effectively reduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xuewen Liu , Zhikai Li , Junrui Xiao , Mengjuan Chen , Jianquan Li , Qingyi Gu

This paper delves into the study of 3D point cloud reconstruction from a single image. Our objective is to develop the Consistency Diffusion Model, exploring synergistic 2D and 3D priors in the Bayesian framework to ensure superior…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Chenru Jiang , Chengrui Zhang , Xi Yang , Jie Sun , Yifei Zhang , Bin Dong , Kaizhu Huang