English
Related papers

Related papers: An optimal control perspective on diffusion-based …

200 papers

Guidance is a cornerstone of modern diffusion models, playing a pivotal role in conditional generation and enhancing the quality of unconditional samples. However, current approaches to guidance scheduling--determining the appropriate…

We provide theoretical convergence guarantees for score-based generative models (SGMs) such as denoising diffusion probabilistic models (DDPMs), which constitute the backbone of large-scale real-world generative models such as DALL$\cdot$E…

Machine Learning · Computer Science 2023-04-18 Sitan Chen , Sinho Chewi , Jerry Li , Yuanzhi Li , Adil Salim , Anru R. Zhang

The purpose of this paper is to study optimal control of conditional McKean-Vlasov (mean-field) stochastic differential equations with jumps (conditional McKean-Vlasov jump diffusions, for short). To this end, we first prove a stochastic…

Probability · Mathematics 2023-01-10 Nacira Agram , Bernt Oksendal

In this paper we consider non convex control problems of stochastic differential equations driven by relaxed controls. We present existence of optimal controls and then develop necessary conditions of optimality. We cover both continuous…

Optimization and Control · Mathematics 2013-02-15 Nasir U. Ahmed , Charalambos D. Charalambous

Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score -- the gradient of the…

Machine Learning · Computer Science 2025-12-01 Zhenghan Fang , Mateo Díaz , Sam Buchanan , Jeremias Sulam

Discrete diffusion models have recently emerged as a promising alternative to the autoregressive approach for generating discrete sequences. Sample generation via gradual denoising or demasking processes allows them to capture hierarchical…

We tackle a nonlinear optimal control problem for a stochastic differential equation in Euclidean space and its state-linear counterpart for the Fokker-Planck-Kolmogorov equation in the space of probabilities. Our approach is founded on a…

Optimization and Control · Mathematics 2024-09-23 Roman Chertovskih , Nikolay Pogodaev , Maxim Staritsyn , A. Pedro Aguiar

Stochastic maximum principle of nonlinear controlled forward-backward systems, where the set of strict (classical) controls need not be convex and the diffusion coefficient depends explicitly on the variable control, is an open problem…

Probability · Mathematics 2008-12-20 Seid Bahlali

The path-integral control, which stems from the stochastic Hamilton-Jacobi-Bellman equation, is one of the methods to control stochastic nonlinear systems. This paper gives a new insight into nonlinear stochastic optimal control problems…

Optimization and Control · Mathematics 2021-09-14 Jun Ohkubo

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

This paper develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. For such systems, the evolution of the moments of the state can be described via a system…

Optimization and Control · Mathematics 2017-02-03 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh

Existing approaches to diffusion-based inverse problem solvers frame the signal recovery task as a probabilistic sampling episode, where the solution is drawn from the desired posterior distribution. This framework suffers from several…

Machine Learning · Computer Science 2024-12-24 Henry Li , Marcus Pereira

We approach the development of models and control strategies of susceptible-infected-susceptible (SIS) epidemic processes from the perspective of marked temporal point processes and stochastic optimal control of stochastic differential…

Optimization and Control · Mathematics 2018-12-04 Lars Lorch , Abir De , Samir Bhatt , William Trouleau , Utkarsh Upadhyay , Manuel Gomez-Rodriguez

This work is devoted to the study of optimal control of stochastic functional differential equations (SFDEs) and its application to mathematical finance. By using the Dynkin formula and solution of the Dirichlet-Poisson problem, the…

Optimization and Control · Mathematics 2014-04-04 Edson A. Coayla-Teran , Anatoly Swishchuk

We consider a classical stochastic control problem in which a diffusion process is controlled by a withdrawal process up to a termination time. The objective is to maximize the expected discounted value of the withdrawals until the…

Probability · Mathematics 2024-06-19 Hélène Guérin , Dante Mata , Jean-François Renaud , Alexandre Roch

We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform…

Machine Learning · Computer Science 2021-10-15 Qinsheng Zhang , Yongxin Chen

This paper investigates the robustness of stochastic optimal control for controlled regime switching diffusions. We consider systems driven by both continuous fluctuations and discrete regime changes, allowing for model misspecification in…

Optimization and Control · Mathematics 2025-11-24 Somnath Pradhan , Dinesh Rathia

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal