中文
相关论文

相关论文: Diffusion Models Are Statistically Optimal for Lea…

200 篇论文

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the…

机器学习 · 计算机科学 2019-05-31 Mauro Maggioni , James M. Murphy

Score-based diffusion models have emerged as powerful tools in generative modeling, yet their theoretical foundations remain underexplored. In this work, we focus on the Wasserstein convergence analysis of score-based diffusion models.…

机器学习 · 统计学 2025-02-10 Yifeng Yu , Lu Yu

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

统计方法学 · 统计学 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

We study counterfactual distribution learning for high-dimensional outcomes whose counterfactual law may concentrate near lower-dimensional structure. Standard isotropic smoothing treats all ambient directions equally, leading to…

统计方法学 · 统计学 2026-05-26 Kwangho Kim

Training neural samplers directly from unnormalized densities without access to target distribution samples presents a significant challenge. A critical desideratum in these settings is achieving comprehensive mode coverage, ensuring the…

机器学习 · 计算机科学 2025-05-27 Chenguang Wang , Xiaoyu Zhang , Kaiyuan Cui , Weichen Zhao , Yongtao Guan , Tianshu Yu

In recent years, diffusion models, and more generally score-based deep generative models, have achieved remarkable success in various applications, including image and audio generation. In this paper, we view diffusion models as an implicit…

统计理论 · 数学 2026-02-12 Hyeok Kyu Kwon , Dongha Kim , Ilsang Ohn , Minwoo Chae

Denoising diffusions are a powerful method to generate approximate samples from high-dimensional data distributions. Recent results provide polynomial bounds on their convergence rate, assuming $L^2$-accurate scores. Until now, the tightest…

机器学习 · 统计学 2024-03-07 Joe Benton , Valentin De Bortoli , Arnaud Doucet , George Deligiannidis

Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their…

机器学习 · 计算机科学 2025-01-23 Gen Li , Yuling Yan

Diffusion models have attained prominence for their ability to synthesize a probability distribution for a given dataset via a diffusion process, enabling the generation of new data points with high fidelity. However, diffusion processes…

机器学习 · 计算机科学 2024-11-25 Shervin Khalafi , Dongsheng Ding , Alejandro Ribeiro

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

图像与视频处理 · 电气工程与系统科学 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

Discrete diffusion models are increasingly competitive for language modeling, yet it remains unclear how their denoising objectives organize learning. Although these objectives target the full data distribution, we show that the exact…

机器学习 · 计算机科学 2026-05-15 Adrian Müller , Antoine Gonon , Zebang Shen , Ya-Ping Hsieh , Niao He

Diffusion models have demonstrated state-of-the-art performance across vision, language, and scientific domains. Despite their empirical success, prior theoretical analyses of the sample complexity suffer from poor scaling with input data…

机器学习 · 计算机科学 2026-04-14 Mudit Gaur , Prashant Trivedi , Sasidhar Kunapuli , Amrit Singh Bedi , Vaneet Aggarwal

Probabilistic diffusion models enjoy increasing popularity in the deep learning community. They generate convincing samples from a learned distribution of input images with a wide field of practical applications. Originally, these…

图像与视频处理 · 电气工程与系统科学 2023-09-19 Pascal Peter

Data-dependent metrics are powerful tools for learning the underlying structure of high-dimensional data. This article develops and analyzes a data-dependent metric known as diffusion state distance (DSD), which compares points using a…

机器学习 · 统计学 2020-03-10 Lenore Cowen , Kapil Devkota , Xiaozhe Hu , James M. Murphy , Kaiyi Wu

Sampling from an unknown distribution, accessible only through discrete samples, is a fundamental problem at the core of generative AI. The current state-of-the-art methods follow a two-step process: first, estimating the score function…

机器学习 · 计算机科学 2026-05-20 Samuel Hurault , Matthieu Terris , Thomas Moreau , Gabriel Peyré

Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization with finite data remains less clear. Classical learning theory…

机器学习 · 统计学 2026-02-02 Claudia Merger , Sebastian Goldt

Diffusion models are widely used in applications ranging from image generation to inverse problems. However, training diffusion models typically requires clean ground-truth images, which are unavailable in many applications. We introduce…

图像与视频处理 · 电气工程与系统科学 2025-05-20 Chicago Y. Park , Shirin Shoushtari , Hongyu An , Ulugbek S. Kamilov

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

机器学习 · 统计学 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

机器学习 · 计算机科学 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in…

统计计算 · 统计学 2025-10-24 Adrien Vacher , Omar Chehab , Anna Korba