English
Related papers

Related papers: Unified framework for diffusion generative models …

200 papers

Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for…

Machine Learning · Computer Science 2025-04-08 Gen Li , Changxiao Cai , Yuting Wei

Text-to-image generation models have achieved remarkable capabilities in synthesizing images, but often struggle to provide fine-grained control over the output. Existing guidance approaches, such as segmentation maps and depth maps,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Sangmin Jung , Utkarsh Nath , Yezhou Yang , Giulia Pedrielli , Joydeep Biswas , Amy Zhang , Hassan Ghasemzadeh , Pavan Turaga

This Letter introduces an approach for precisely designing surface friction properties using a conditional generative machine learning model, specifically a diffusion denoising probabilistic model (DDPM). We created a dataset of synthetic…

Computational Physics · Physics 2024-01-11 Even Marius Nordhagen , Henrik Andersen Sveinsson , Anders Malthe-Sørenssen

Self-supervised learning (SSL) has revolutionized representation learning in Remote Sensing (RS), advancing Geospatial Foundation Models (GFMs) to leverage vast unlabeled satellite imagery for diverse downstream tasks. Currently, GFMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuru Jia , Valerio Marsocci , Ziyang Gong , Xue Yang , Maarten Vergauwen , Andrea Nascetti

Denoising diffusion models (DDMs) have recently attracted increasing attention by showing impressive synthesis quality. DDMs are built on a diffusion process that pushes data to the noise distribution and the models learn to denoise. In…

Machine Learning · Computer Science 2023-05-16 Jaemoo Choi , Yesom Park , Myungjoo Kang

Generative AI presents chemists with novel ideas for drug design and facilitates the exploration of vast chemical spaces. Diffusion models (DMs), an emerging tool, have recently attracted great attention in drug R\&D. This paper…

Biomolecules · Quantitative Biology 2025-07-14 Peining Zhang , Daniel Baker , Minghu Song , Jinbo Bi

Designing new molecules is essential for drug discovery and material science. Recently, deep generative models that aim to model molecule distribution have made promising progress in narrowing down the chemical research space and generating…

Biomolecules · Quantitative Biology 2023-06-06 Han Huang , Leilei Sun , Bowen Du , Weifeng Lv

Diffusion models (DMs) represent state-of-the-art generative models for continuous inputs. DMs work by constructing a Stochastic Differential Equation (SDE) in the input space (ie, position space), and using a neural network to reverse it.…

Machine Learning · Computer Science 2024-05-14 Tianrong Chen , Jiatao Gu , Laurent Dinh , Evangelos A. Theodorou , Joshua Susskind , Shuangfei Zhai

Deep generative diffusion models are a promising avenue for 3D de novo molecular design in materials science and drug discovery. However, their utility is still limited by suboptimal performance on large molecular structures and limited…

Machine Learning · Computer Science 2023-11-27 Tuan Le , Julian Cremer , Frank Noé , Djork-Arné Clevert , Kristof Schütt

We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising diffusion probabilistic models. While existing diffusion-based methods operate on images, latent codes, or point cloud data, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Norman Müller , Yawar Siddiqui , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

Machine Learning · Computer Science 2021-02-22 Alex Nichol , Prafulla Dhariwal

Learning representations through deep generative modeling is a powerful approach for dynamical modeling to discover the most simplified and compressed underlying description of the data, to then use it for other tasks such as prediction.…

Machine Learning · Computer Science 2022-03-01 Bahar Azari , Deniz Erdoğmuş

Free-form inpainting is the task of adding new content to an image in the regions specified by an arbitrary binary mask. Most existing approaches train for a certain distribution of masks, which limits their generalization capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Andreas Lugmayr , Martin Danelljan , Andres Romero , Fisher Yu , Radu Timofte , Luc Van Gool

As one of the most popular and sought-after generative models in the recent years, diffusion models have sparked the interests of many researchers and steadily shown excellent advantage in various generative tasks such as image synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Zhiyuan Ma , Yuzhu Zhang , Guoli Jia , Liangliang Zhao , Yichao Ma , Mingjie Ma , Gaofeng Liu , Kaiyan Zhang , Jianjun Li , Bowen Zhou

Latent diffusion models (LDMs) dominate high-quality image generation, yet integrating representation learning with generative modeling remains a challenge. We introduce a novel generative image modeling framework that seamlessly bridges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Theodoros Kouzelis , Efstathios Karypidis , Ioannis Kakogeorgiou , Spyros Gidaris , Nikos Komodakis

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

The reconstruction of X-rays CT images from sparse or limited-angle geometries is a highly challenging task. The lack of data typically results in artifacts in the reconstructed image and may even lead to object distortions. For this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Davide Evangelista , Pasquale Cascarano , Elena Loli Piccolomini

Generative models cover various application areas, including image, video and music synthesis, natural language processing, and molecular design, among many others. As digital generative models become larger, scalable inference in a fast…

Neural and Evolutionary Computing · Computer Science 2025-08-28 Shiqi Chen , Yuhang Li , Hanlong Chen , Aydogan Ozcan

A core capability for robot manipulation is reasoning over where and how to stably place objects in cluttered environments. Traditionally, robots have relied on object-specific, hand-crafted heuristics in order to perform such reasoning,…

Robotics · Computer Science 2023-10-27 Takuma Yoneda , Tianchong Jiang , Gregory Shakhnarovich , Matthew R. Walter

Diffusion models have shown impressive performance for image generation, often times outperforming other generative models. Since their introduction, researchers have extended the powerful noise-to-image denoising pipeline to discriminative…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu