中文
相关论文

相关论文: Diffusion Models Are Statistically Optimal for Lea…

200 篇论文

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

机器学习 · 统计学 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

机器学习 · 计算机科学 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

Recent empirical studies have demonstrated that diffusion models can effectively learn the image distribution and generate new samples. Remarkably, these models can achieve this even with a small number of training samples despite a large…

机器学习 · 计算机科学 2025-07-08 Peng Wang , Huijie Zhang , Zekai Zhang , Siyi Chen , Yi Ma , Qing Qu

While efficient distribution learning is no doubt behind the groundbreaking success of diffusion modeling, its theoretical guarantees are quite limited. In this paper, we provide the first rigorous analysis on approximation and…

机器学习 · 统计学 2023-03-06 Kazusato Oko , Shunta Akiyama , Taiji Suzuki

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

机器学习 · 计算机科学 2025-01-03 Gen Li , Yuling Yan

Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for…

机器学习 · 计算机科学 2025-04-08 Gen Li , Changxiao Cai , Yuting Wei

Diffusion models have demonstrated remarkable performance in generating high-dimensional samples across domains such as vision, language, and the sciences. Although continuous-state diffusion models have been extensively studied both…

机器学习 · 计算机科学 2026-02-17 Aadithya Srikanth , Mudit Gaur , Vaneet Aggarwal

Curse of Dimensionality is an unavoidable challenge in statistical probability models, yet diffusion models seem to overcome this limitation, achieving impressive results in high-dimensional data generation. Diffusion models assume that…

机器学习 · 统计学 2025-10-01 Zhenxin Zheng , Zhenjie Zheng

Denoising Diffusion Probabilistic Models (DDPM) are powerful state-of-the-art methods used to generate synthetic data from high-dimensional data distributions and are widely used for image, audio, and video generation as well as many more…

机器学习 · 统计学 2025-04-25 Iskander Azangulov , George Deligiannidis , Judith Rousseau

While the mathematical foundations of score-based generative models are increasingly well understood for unconstrained Euclidean spaces, many practical applications involve data restricted to bounded domains. This paper provides a…

统计理论 · 数学 2026-03-26 Asbjørn Holk , Claudia Strauch , Lukas Trottner

Diffusion models have become a leading framework in generative modeling, yet their theoretical understanding -- especially for high-dimensional data concentrated on low-dimensional structures -- remains incomplete. This paper investigates…

机器学习 · 计算机科学 2026-04-29 Zixuan Zhang , Kaixuan Huang , Tuo Zhao , Mengdi Wang , Minshuo Chen

Diffusion-based generative models provide a powerful framework for learning to sample from a complex target distribution. The remarkable empirical success of these models applied to high-dimensional signals, including images and video,…

机器学习 · 计算机科学 2024-10-16 Nicholas M. Boffi , Arthur Jacot , Stephen Tu , Ingvar Ziemann

Score-based diffusion models are a powerful class of generative models, but their practical use often depends on training neural networks to approximate the score function. Training-free diffusion models provide an attractive alternative by…

数值分析 · 数学 2026-01-28 Pengjun Wang , Zezhong Zhang , Minglei Yang , Feng Bao , Yanzhao Cao , Guannan Zhang

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

机器学习 · 计算机科学 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee

This paper investigates the score-based diffusion models for density estimation when the target density admits a factorizable low-dimensional nonparametric structure. To be specific, we show that when the log density admits a $d^*$-way…

统计理论 · 数学 2025-10-07 Jianqing Fan , Yihong Gu , Ximing Li

Score-based generative models, which transform noise into data by learning to reverse a diffusion process, have become a cornerstone of modern generative AI. This paper contributes to establishing theoretical guarantees for the probability…

机器学习 · 统计学 2025-02-03 Jiaqi Tang , Yuling Yan

Score-based diffusion models have demonstrated outstanding empirical performance in machine learning and artificial intelligence, particularly in generating high-quality new samples from complex probability distributions. Improving the…

机器学习 · 统计学 2025-05-30 Yuchen Jiao , Gen Li

This paper investigates how diffusion generative models leverage (unknown) low-dimensional structure to accelerate sampling. Focusing on two mainstream samplers -- the denoising diffusion implicit model (DDIM) and the denoising diffusion…

机器学习 · 统计学 2025-06-18 Jiadong Liang , Zhihan Huang , Yuxin Chen

Score-based methods, such as diffusion models and Bayesian inverse problems, are often interpreted as learning the data distribution in the low-noise limit ($\sigma \to 0$). In this work, we propose an alternative perspective: their success…

机器学习 · 统计学 2026-03-17 Xiang Li , Zebang Shen , Ya-Ping Hsieh , Niao He

Diffusion models have become the most popular approach to deep generative modeling of images, largely due to their empirical performance and reliability. From a theoretical standpoint, a number of recent works have studied the iteration…

机器学习 · 计算机科学 2025-11-19 Shivam Gupta , Aditya Parulekar , Eric Price , Zhiyang Xun
‹ 上一页 1 2 3 10 下一页 ›