English
Related papers

Related papers: Noise Schedule Design for Diffusion Models: An Opt…

200 papers

This work introduces a novel approach to modeling temporal point processes using diffusion models with an asynchronous noise schedule. At each step of the diffusion process, the noise schedule injects noise of varying scales into different…

Machine Learning · Computer Science 2025-04-30 Amartya Mukherjee , Ruizhi Deng , He Zhao , Yuzhen Mao , Leonid Sigal , Frederick Tung

Continuous normalizing flows (CNFs) and diffusion models (DMs) generate high-quality data from a noise distribution. However, their sampling process demands multiple iterations to solve an ordinary differential equation (ODE) with high…

Machine Learning · Computer Science 2025-11-19 Denis Gudovskiy , Wenzhao Zheng , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer

Pretrained diffusion models have demonstrated strong capabilities in zero-shot inverse problem solving by incorporating observation information into the generation process of the diffusion models. However, this presents an inherent dilemma:…

Machine Learning · Computer Science 2026-05-05 Xun Su , Hiroyuki Kasai

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

Machine Learning · Statistics 2025-12-18 Hugo Lavenant , Giacomo Zanella

We present discrete-time approximation of optimal control policies for infinite horizon discounted/ergodic control problems for controlled diffusions in $\Rd$\,. In particular, our objective is to show near optimality of optimal policies…

Optimization and Control · Mathematics 2025-02-11 Somnath Pradhan , Serdar Yuksel

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang

Diffusion models have achieved remarkable success in imaging inverse problems owing to their powerful generative capabilities. However, existing approaches typically rely on models trained for specific degradation types, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Zhen Wang , Hongyi Liu , Zhihui Wei

Achieving global optimality in nonlinear model predictive control (NMPC) is challenging due to the non-convex nature of the underlying optimization problem. Since commonly employed local optimization techniques depend on carefully chosen…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Tzu-Yuan Huang , Armin Lederer , Nicolas Hoischen , Jan Brüdigam , Xuehua Xiao , Stefan Sosnowski , Sandra Hirche

Disturbance noises are always bounded in a practical system, while fusion estimation is to best utilize multiple sensor data containing noises for the purpose of estimating a quantity--a parameter or process. However, few results are…

Systems and Control · Computer Science 2018-07-20 Bo Chen , Guoqiang Hu , Daniel W. C. Ho , Li Yu

We study optimal control of diffusions with slow and fast variables and address a question raised by practitioners: is it possible to first eliminate the fast variables before solving the optimal control problem and then use the optimal…

Optimization and Control · Mathematics 2014-06-16 Wei Zhang , Juan C. Latorre , Grigorios A. Pavliotis , Carsten Hartmann

Control of continuous time dynamics with multiplicative noise is a classic topic in stochastic optimal control. This work addresses the problem of designing infinite horizon optimal controls with stability guarantees for \textit{a single…

Optimization and Control · Mathematics 2020-10-02 Kaivalya Bakshi , Evangelos A. Theodorou , Piyush Grover

With the great success of diffusion models in image generation, diffusion-based image compression is attracting increasing interests. However, due to the random noise introduced in the diffusion learning, they usually produce…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Zhenyu Du , Yanbo Gao , Shuai Li , Yiyang Li , Hui Yuan , Mao Ye

Diffusion probabilistic models have set a new standard for generative fidelity but are hindered by a slow iterative sampling process. A powerful training-free strategy to accelerate this process is Schedule Optimization, which aims to find…

Machine Learning · Computer Science 2026-05-20 Aihua Zhu , Rui Su , Qinglin Zhao , Li Feng , Meng Shen , Shibo He

In many real-world dynamical systems, obtaining precise models of system uncertainty remains a challenge. It may be difficult to estimate noise distributions or robustness bounds, especially when the distributions/robustness bounds vary…

Systems and Control · Electrical Eng. & Systems 2024-03-05 Heling Zhang , Lillian J. Ratliff , Roy Dong

Diffusion models (DMs) have emerged as powerful tools for modeling complex data distributions and generating realistic new samples. Over the years, advanced architectures and sampling methods have been developed to make these models…

Machine Learning · Computer Science 2025-12-11 Roi Benita , Michael Elad , Joseph Keshet

Diffusion models have achieved state-of-the-art synthesis quality on both visual and audio tasks, and recent works further adapt them to textual data by diffusing on the embedding space. In this paper, we conduct systematic studies of the…

Computation and Language · Computer Science 2024-04-23 Zhujin Gao , Junliang Guo , Xu Tan , Yongxin Zhu , Fang Zhang , Jiang Bian , Linli Xu

Diffusion modeling (DM) has high-quality generative performance, and the sampling problem is an important part of the DM performance. Thanks to efficient differential equation solvers, the sampling speed can be reduced while higher sampling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Zitong Cheng

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

Diffusion models have emerged as a powerful framework in generative modeling, typically relying on optimizing neural networks to estimate the score function via forward SDE simulations. In this work, we propose an alternative method that is…

Numerical Analysis · Mathematics 2025-06-17 Yuehaw Khoo , Mathias Oster , Yifan Peng

This paper considers optimal input design when the intended use of the identified model is to construct a feed-forward controller based on measurable disturbances. The objective is to find a minimum power excitation signal to be used in…

Systems and Control · Computer Science 2013-03-14 Per Hägg , Bo Wahlberg