中文
相关论文

相关论文: Noise Schedule Design for Diffusion Models: An Opt…

200 篇论文

Conditional Diffusion Models are powerful surrogates for emulating complex spatiotemporal dynamics, yet they often fail to match the accuracy of deterministic neural emulators for high-precision tasks. In this work, we address two critical…

机器学习 · 计算机科学 2026-04-13 Constantin Le Cleï , Nils Thuerey , Xiaoxiang Zhu

We consider the existence and first order conditions of optimality for a stochastic optimal control problem inspired by the celebrated FitzHugh-Nagumo model, with nonlinear diffusion term, perturbed by a linear multiplicative Brownian-type…

最优化与控制 · 数学 2019-12-03 Francesco Cordoni , Luca Di Persio

Diffusion models generate samples by iteratively querying learned score estimates. A rapidly growing literature focuses on accelerating sampling by minimizing the number of score evaluations, yet the information-theoretic limits of such…

机器学习 · 计算机科学 2026-04-14 Zhiyang Xun , Eric Price

We consider an optimal control problem that entails the minimization of a nondifferentiable cost functional, fractional diffusion as state equation and constraints on the control variable. We provide existence, uniqueness and regularity…

数值分析 · 数学 2017-04-05 Enrique Otárola , Abner J. Salgado

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

机器学习 · 计算机科学 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

This paper introduces a novel approach to the optimal control of linear discrete-time systems subject to bounded disturbances. Our approach is based on the newly established duality between ellipsoidal approximations of reachable and hardly…

系统与控制 · 电气工程与系统科学 2024-09-20 Egor Dogadin , Alexey Peregudin , Dmitriy Shirokih

A major bottleneck of standard auto-regressive large language models is that their inference process is inherently sequential, resulting in very long and costly inference times. To circumvent this, practitioners proposed a class of language…

机器学习 · 计算机科学 2025-11-11 Sitan Chen , Kevin Cong , Jerry Li

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

Diffusion models have emerged as powerful tools for generative tasks, producing high-quality outputs across diverse domains. However, how the generated data responds to the initial noise perturbation in diffusion models remains…

机器学习 · 计算机科学 2025-02-10 Bowen Song , Zecheng Zhang , Zhaoxu Luo , Jason Hu , Wei Yuan , Jing Jia , Zhengxu Tang , Guanyang Wang , Liyue Shen

Inference-time controllable generation is essential for real-world applications of unconditional diffusion models. However, most existing techniques focus on individual samples, struggling in applications that require the sample population…

机器学习 · 计算机科学 2026-05-11 Hao Luan , See-Kiong Ng , Chun Kai Ling

Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate…

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

机器学习 · 计算机科学 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Diffusion models that can generate high-quality data from randomly sampled Gaussian noises have become the mainstream generative method in both academia and industry. Are randomly sampled Gaussian noises equally good for diffusion models?…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Zipeng Qi , Lichen Bai , Haoyi Xiong , Zeke Xie

Inspired by the notion that environmental noise is in principle observable, whilst fundamental noise due to spontaneous localisation would not be, we study the estimation of the diffusion parameter induced by wave function collapse models…

量子物理 · 物理学 2016-10-27 Marco G. Genoni , O. S. Duarte , A. Serafini

Diffusion models (DMs) create samples from a data distribution by starting from random noise and iteratively solving a reverse-time ordinary differential equation (ODE). Because each step in the iterative solution requires an expensive…

机器学习 · 计算机科学 2025-02-25 Eric Frankel , Sitan Chen , Jerry Li , Pang Wei Koh , Lillian J. Ratliff , Sewoong Oh

This paper investigates the optimal control problem for a class of parabolic equations where the diffusion coefficient is influenced by a control function acting nonlocally. Specifically, we consider the optimization of a cost functional…

最优化与控制 · 数学 2025-03-11 Stefana-Lucia Anita , Luca Di Persio

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

机器学习 · 计算机科学 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

We establish a connection between stochastic optimal control and generative models based on stochastic differential equations (SDEs), such as recently developed diffusion probabilistic models. In particular, we derive a…

机器学习 · 计算机科学 2024-03-27 Julius Berner , Lorenz Richter , Karen Ullrich

We consider optimal control problems for diffusion processes, where the objective functional is defined by a time-consistent dynamic risk measure. We focus on coherent risk measures defined by $g$-evaluations. For such problems, we…

最优化与控制 · 数学 2016-08-22 Andrzej Ruszczynski , Jianing Yao