中文
相关论文

相关论文: Risk-Sensitive Diffusion: Robustly Optimizing Diff…

200 篇论文

A potent class of generative models known as Diffusion Probabilistic Models (DPMs) has become prominent. A forward diffusion process adds gradually noise to data, while a model learns to gradually denoise. Sampling from pre-trained DPMs is…

机器学习 · 计算机科学 2023-10-27 Martin Gonzalez , Nelson Fernandez , Thuy Tran , Elies Gherbi , Hatem Hajri , Nader Masmoudi

Medical Visual Question Answering (Med-VQA) systems benefit the interpretation of medical images containing critical clinical information. However, the challenge of noisy labels and limited high-quality datasets remains underexplored. To…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Erjian Guo , Zhen Zhao , Zicheng Wang , Tong Chen , Yunyi Liu , Luping Zhou

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

机器学习 · 计算机科学 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

机器学习 · 计算机科学 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

Diffusion models generate samples by reversing a fixed forward diffusion process. Despite already providing impressive empirical results, these diffusion models algorithms can be further improved by reducing the variance of the training…

机器学习 · 计算机科学 2023-02-20 Yilun Xu , Shangyuan Tong , Tommi Jaakkola

The optimization of the latents and parameters of diffusion models with respect to some differentiable metric defined on the output of the model is a challenging and complex problem. The sampling for diffusion models is done by solving…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Zander W. Blasingame , Chen Liu

Anomaly detection in tabular data remains challenging due to complex feature interactions and the scarcity of anomalous examples. Denoising autoencoders rely on fixed-magnitude noise, limiting adaptability to diverse data distributions.…

机器学习 · 计算机科学 2025-08-04 Timur Sattarov , Marco Schreyer , Damian Borth

Practical diffusion sampling is a numerical approximation problem: under a fixed inference budget, one must simulate a reverse-time ODE or SDE using only a limited number of denoising steps, so discretization error is often the dominant…

机器学习 · 计算机科学 2026-05-12 Samuel Hurault , Thomas Moreau , Gabriel Peyré

Diffusion models with continuous stochastic differential equations (SDEs) have shown superior performances in image generation. It can serve as a deep generative prior to solving the inverse problem in magnetic resonance (MR)…

图像与视频处理 · 电气工程与系统科学 2024-01-23 Chentao Cao , Zhuo-Xu Cui , Yue Wang , Shaonan Liu , Taijin Chen , Hairong Zheng , Dong Liang , Yanjie Zhu

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

机器学习 · 计算机科学 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

Progressively applying Gaussian noise transforms complex data distributions to approximately Gaussian. Reversing this dynamic defines a generative model. When the forward noising process is given by a Stochastic Differential Equation (SDE),…

机器学习 · 统计学 2023-04-06 Valentin De Bortoli , James Thornton , Jeremy Heng , Arnaud Doucet

This paper investigates how models of spatiotemporal dynamics in the form of nonlinear partial differential equations can be identified directly from noisy data using a combination of sparse regression and weak formulation. Using the…

动力系统 · 数学 2020-01-08 Daniel R. Gurevich , Patrick A. K. Reinbold , Roman O. Grigoriev

Denoising diffusion models have recently shown impressive results in generative tasks. By learning powerful priors from huge collections of training images, such models are able to gradually modify complete noise to a clean natural image…

计算机视觉与模式识别 · 计算机科学 2023-06-29 Naama Pearl , Yaron Brodsky , Dana Berman , Assaf Zomet , Alex Rav Acha , Daniel Cohen-Or , Dani Lischinski

We propose robust methods to identify underlying Partial Differential Equation (PDE) from a given set of noisy time dependent data. We assume that the governing equation is a linear combination of a few linear and nonlinear differential…

数值分析 · 数学 2023-03-03 Yuchen He , Sung Ha Kang , Wenjing Liao , Hao Liu , Yingjie Liu

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

机器学习 · 计算机科学 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Generative models have attracted considerable attention for speech separation tasks, and among these, diffusion-based methods are being explored. Despite the notable success of diffusion techniques in generation tasks, their adaptation to…

音频与语音处理 · 电气工程与系统科学 2025-01-28 Jinwei Dong , Xinsheng Wang , Qirong Mao

We investigate the use of diffusion models as neural density estimators. The current approach to this problem involves converting the generative process to a smooth flow, known as the Probability Flow ODE. The log density at a given sample…

机器学习 · 计算机科学 2024-10-10 Akhil Premkumar

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

机器学习 · 计算机科学 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

Diffusion models have emerged as powerful tools for generative tasks, producing high-quality outputs across diverse domains. However, how the generated data responds to the initial noise perturbation in diffusion models remains…

机器学习 · 计算机科学 2025-02-10 Bowen Song , Zecheng Zhang , Zhaoxu Luo , Jason Hu , Wei Yuan , Jing Jia , Zhengxu Tang , Guanyang Wang , Liyue Shen

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE…