English
Related papers

Related papers: Variance-Reduced Diffusion Sampling via Target Sco…

200 papers

Denoising Score Matching estimates the score of a noised version of a target distribution by minimizing a regression loss and is widely used to train the popular class of Denoising Diffusion Models. A well known limitation of Denoising…

Machine Learning · Computer Science 2024-02-14 Valentin De Bortoli , Michael Hutchinson , Peter Wirnsberger , Arnaud Doucet

Diffusion models, which convert noise into new data instances by learning to reverse a Markov diffusion process, have become a cornerstone in contemporary generative modeling. While their practical power has now been widely recognized, the…

Machine Learning · Statistics 2024-03-08 Gen Li , Yuting Wei , Yuxin Chen , Yuejie Chi

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

Machine Learning · Computer Science 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

Common target sound extraction (TSE) approaches primarily relied on discriminative approaches in order to separate the target sound while minimizing interference from the unwanted sources, with varying success in separating the target from…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Jiarui Hai , Helin Wang , Dongchao Yang , Karan Thakkar , Najim Dehak , Mounya Elhilali

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently…

Machine Learning · Statistics 2025-09-30 Dennis Elbrächter , Giovanni S. Alberti , Matteo Santacesaria

We provide new convergence guarantees in Wasserstein distance for diffusion-based generative models, covering both stochastic (DDPM-like) and deterministic (DDIM-like) sampling methods. We introduce a simple framework to analyze…

Machine Learning · Computer Science 2025-11-14 Eliot Beyler , Francis Bach

Diffusion distillation has emerged as a promising strategy for accelerating text-to-image (T2I) diffusion models by distilling a pretrained score network into a one- or few-step generator. While existing methods have made notable progress,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingyuan Zhou , Yi Gu , Zhendong Wang

Existing diffusion-based methods for inverse problems sample from the posterior using score functions and accept the generated random samples as solutions. In applications that posterior mean is preferred, we have to generate multiple…

Machine Learning · Computer Science 2024-10-10 Zhipeng Xue , Penghao Cai , Xiaojun Yuan , Xiqi Gao

Score-based diffusion models, while achieving remarkable empirical performance, often suffer from low sampling speed, due to extensive function evaluations needed during the sampling phase. Despite a flurry of recent activities towards…

Machine Learning · Computer Science 2024-03-07 Gen Li , Yu Huang , Timofey Efimov , Yuting Wei , Yuejie Chi , Yuxin Chen

Diffusion tensor imaging (DTI) is a prevalent neuroimaging tool in analyzing the anatomical structure. The distinguishing feature of DTI is that the voxel-wise variable is a 3x3 positive definite matrix other than a scalar, describing the…

Methodology · Statistics 2021-03-30 Zhou Lan

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Diffusion models (DMs) have made significant progress in the fields of image, audio, and video generation. One downside of DMs is their slow iterative process. Recent algorithms for fast sampling are designed from the perspective of…

Machine Learning · Statistics 2023-09-12 Shigui Li , Wei Chen , Delu Zeng

Multi-target detection (MTD) is the problem of estimating an image from a large, noisy measurement that contains randomly translated and rotated copies of the image. Motivated by the single-particle cryo-electron microscopy technology, we…

Signal Processing · Electrical Eng. & Systems 2023-12-15 Alon Zabatani , Shay Kreymer , Tamir Bendory

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

We study a discrete denoising diffusion framework that integrates a sample-efficient estimator of single-site conditionals with round-robin noising and denoising dynamics for generative modeling over discrete state spaces. Rather than…

Machine Learning · Computer Science 2026-03-02 Karthik Elamvazhuthi , Abhijith Jayakumar , Andrey Y. Lokhov

This paper proposes a novel joint channel-estimation and source-detection algorithm using successive interference cancellation (SIC)-aided generative score-based diffusion models. Prior work in this area focuses on massive MIMO scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Sagnik Bhattacharya , Muhammad Ahmed Mohsin , Kamyar Rajabalifardi , John M. Cioffi

Adapting pretrained diffusion models to downstream objectives such as inverse problems often requires expensive test-time guidance or optimization. We propose a principled framework for generating high-quality reward-aligned samples at…

Machine Learning · Computer Science 2026-05-22 Kushagra Pandey , Farrin Marouf Sofian , Jan Niklas Groeneveld , Felix Draxler , Stephan Mandt

Score-based diffusion models have demonstrated outstanding empirical performance in machine learning and artificial intelligence, particularly in generating high-quality new samples from complex probability distributions. Improving the…

Machine Learning · Statistics 2025-05-30 Yuchen Jiao , Gen Li

We introduce a score-based generative sampling method for solving the nonlinear filtering problem with robust accuracy. A major drawback of existing nonlinear filtering methods, e.g., particle filters, is the low stability. To overcome this…

Optimization and Control · Mathematics 2023-06-16 Feng Bao , Zezhong Zhang , Guannan Zhang

We propose a new method for separating superimposed sources using diffusion-based generative models. Our method relies only on separately trained statistical priors of independent sources to establish a new objective function guided by…

Machine Learning · Computer Science 2024-01-18 Tejas Jayashankar , Gary C. F. Lee , Alejandro Lancho , Amir Weiss , Yury Polyanskiy , Gregory W. Wornell