English
Related papers

Related papers: Diffusion-based Denoising Beats Vanilla Score Matc…

200 papers

Most leading implementations of black-box variational inference (BBVI) are based on optimizing a stochastic evidence lower bound (ELBO). But such approaches to BBVI often converge slowly due to the high variance of their gradient estimates…

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

Machine Learning · Statistics 2025-02-10 Yifeng Yu , Lu Yu

One of the most common methods for statistical inference is the maximum likelihood estimator (MLE). The MLE needs to compute the normalization constant in statistical models, and it is often intractable. Using unnormalized statistical…

Statistics Theory · Mathematics 2016-04-26 Takafumi Kanamori , Takashi Takenouchi

The choice of prior is central to solving ill-posed imaging inverse problems, making it essential to select one consistent with the measurements $y$ to avoid severe bias. In Bayesian inverse problems, this could be achieved by evaluating…

Machine Learning · Computer Science 2026-05-01 Frederic Wang , Katherine L. Bouman

Diffusion models, typically formulated as discretizations of stochastic differential equations (SDEs), have achieved state-of-the-art performance in generative tasks. However, their theoretical analysis often involves complex proofs. In…

Machine Learning · Computer Science 2026-02-02 Juhyeok Choi , Chenglin Fan

Denoising is intuitively related to projection. Indeed, under the manifold hypothesis, adding random noise is approximately equivalent to orthogonal perturbation. Hence, learning to denoise is approximately learning to project. In this…

Machine Learning · Computer Science 2024-06-04 Frank Permenter , Chenyang Yuan

Denoising diffusion models (DDMs) offer a promising generative approach for combinatorial optimization, yet they often lack the robust exploration capabilities of traditional metaheuristics like evolutionary algorithms (EAs). We propose a…

Neural and Evolutionary Computing · Computer Science 2025-10-13 Joan Salvà Soler , Günther R. Raidl

We introduce Delta Denoising Score (DDS), a novel scoring function for text-based image editing that guides minimal modifications of an input image towards the content described in a target prompt. DDS leverages the rich generative prior of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Amir Hertz , Kfir Aberman , Daniel Cohen-Or

We propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central…

Computation · Statistics 2025-08-12 Toan Huynh , Ruth Lopez Fajardo , Guannan Zhang , Lili Ju , Feng Bao

In modern radar systems, target detection and parameter estimation face significant challenges when confronted with mainlobe jamming. This paper presents a Diffusion-based Model and Data Dual-driven (DMDD) approach to estimate and detect…

Signal Processing · Electrical Eng. & Systems 2025-12-01 Ruohai Guo , Jiang Zhu , Chengjie Yu , Zhigang Wang , Ning Zhang , Fengzhong Qu , Min Gong

In diffusion-based communication, as for molecular systems, the achievable data rate is low due to the stochastic nature of diffusion which exhibits a severe inter-symbol-interference (ISI). Multiple-Input Multiple-Output (MIMO)…

Information Theory · Computer Science 2019-04-26 S. M. Reza Rouzegar , Umberto Spagnolini

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently…

Machine Learning · Statistics 2025-09-30 Dennis Elbrächter , Giovanni S. Alberti , Matteo Santacesaria

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

Machine Learning · Computer Science 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

Score-based diffusion models generate new samples by learning the score function associated with a diffusion process. While the effectiveness of these models can be theoretically explained using differential equations related to the…

Machine Learning · Computer Science 2026-01-21 Doheon Kim

Diffusion-based trajectory optimization has emerged as a powerful planning paradigm, but existing methods require either learned score networks trained on large datasets or analytical dynamics models for score computation. We introduce…

Robotics · Computer Science 2026-04-02 Shihao Li , Jiachen Li , Jiamin Xu , Dongmei Chen

Accelerated diffusion models hold the potential to significantly enhance the efficiency of standard diffusion processes. Theoretically, these models have been shown to achieve faster convergence rates than the standard $\mathcal…

Machine Learning · Computer Science 2025-03-28 Yuchen Liang , Peizhong Ju , Yingbin Liang , Ness Shroff

Diffusion models have found valuable applications in anomaly detection by capturing the nominal data distribution and identifying anomalies via reconstruction. Despite their merits, they struggle to localize anomalies of varying scales,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Justin Tebbe , Jawad Tayyub

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

The diffusion model has shown remarkable performance in modeling data distributions and synthesizing data. However, the vanilla diffusion model requires complete or fully observed data for training. Incomplete data is a common issue in…

Machine Learning · Computer Science 2023-07-04 Yidong Ouyang , Liyan Xie , Chongxuan Li , Guang Cheng

Diffusion models are often introduced from multiple perspectives, such as VAEs, score matching, or flow matching, accompanied by dense and technically demanding mathematics that can be difficult for beginners to grasp. One classic question…

Machine Learning · Computer Science 2026-04-14 Candi Zheng , Yuan Lan