English
Related papers

Related papers: Lyapunov Stability of Stochastic Vector Optimizati…

200 papers

We study a stochastic optimal control problem for jump-diffusion systems whose drift coefficient is piecewise Lipschitz continuous and exhibits threshold-induced discontinuities. Such dynamics naturally arise in applications with…

Optimization and Control · Mathematics 2026-05-08 Antoine-Marie Bogso , Edward Fuituh Kameh , Olivier Menoukeu-Pamen , Felix Shu

Generative diffusion models for end-to-end autonomous driving often suffer from mode collapse, tending to generate conservative and homogeneous behaviors. While DiffusionDrive employs predefined anchors representing different driving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jialv Zou , Shaoyu Chen , Bencheng Liao , Zhiyu Zheng , Yuehao Song , Lefei Zhang , Qian Zhang , Wenyu Liu , Xinggang Wang

We propose new continuous-time formulations for first-order stochastic optimization algorithms such as mini-batch gradient descent and variance-reduced methods. We exploit these continuous-time models, together with simple Lyapunov analysis…

Optimization and Control · Mathematics 2020-03-12 Antonio Orvieto , Aurelien Lucchi

Langevin Dynamics has been extensively employed in global non-convex optimization due to the concentration of its stationary distribution around the global minimum of the potential function at low temperatures. In this paper, we propose to…

Optimization and Control · Mathematics 2023-05-22 Ryo Fujino

Time-varying stochastic optimization problems frequently arise in machine learning practice (e.g. gradual domain shift, object tracking, strategic classification). Although most problems are solved in discrete time, the underlying process…

Machine Learning · Computer Science 2023-02-24 Subha Maity , Debarghya Mukherjee , Moulinath Banerjee , Yuekai Sun

We study the estimation of the value function for continuous-time Markov diffusion processes using a single, discretely observed ergodic trajectory. Our work provides non-asymptotic statistical guarantees for the least-squares…

Machine Learning · Computer Science 2025-02-07 Wenlong Mou

Reinforcement learning with stochastic optimal control offers a promising framework for diffusion fine-tuning, where a pre-trained diffusion model is optimized to generate paths that lead to a reward-tilted distribution. While these…

Machine Learning · Computer Science 2025-09-30 Sophia Tang , Yuchen Zhu , Molei Tao , Pranam Chatterjee

Stochastic differential equations of Langevin-diffusion form have received significant attention, thanks to their foundational role in both Bayesian sampling algorithms and optimization in machine learning. In the latter, they serve as a…

Optimization and Control · Mathematics 2024-05-14 Fabio V. Difonzo , Vyacheslav Kungurtsev , Jakub Marecek

Graphical continuous Lyapunov models offer a new perspective on modeling causally interpretable dependence structure in multivariate data by treating each independent observation as a one-time cross-sectional snapshot of a temporal process.…

Statistics Theory · Mathematics 2023-11-16 Philipp Dettling , Mathias Drton , Mladen Kolar

Over the recent past data-driven algorithms for solving stochastic optimal control problems in face of model uncertainty have become an increasingly active area of research. However, for singular controls and underlying diffusion dynamics…

Optimization and Control · Mathematics 2024-10-15 Sören Christensen , Asbjørn Holk Thomsen , Lukas Trottner

A subdiffusion problem in which the diffusion term is related to a stable stochastic process is introduced. Linear models of these systems have been studied in a general way, but non-linear models require a more specific analysis. The model…

Probability · Mathematics 2021-11-05 Soveny Solís , Vicente Vergara

Discrete diffusion models have recently gained significant prominence in applications involving natural language and graph data. A key factor influencing their effectiveness is the efficiency of discretized samplers. Among these,…

Machine Learning · Computer Science 2025-11-03 Yuchen Liang , Yingbin Liang , Lifeng Lai , Ness Shroff

This paper develops methods for proving Lyapunov stability of dynamical systems subject to disturbances with an unknown distribution. We assume only a finite set of disturbance samples is available and that the true online disturbance…

Optimization and Control · Mathematics 2024-07-15 Kehan Long , Yinzhuang Yi , Jorge Cortes , Nikolay Atanasov

In this article, we introduce Lyapunov-type results to investigate the stability of the trivial solution of a Stieltjes dynamical system. We utilize prolongation results to establish the global existence of the maximal solution. Using…

Classical Analysis and ODEs · Mathematics 2024-09-06 Lamiae Maia , Noha El Khattabi , Marlène Frigon

We construct and analyze generative diffusions that transport a point mass to a prescribed target distribution over a finite time horizon using the stochastic interpolant framework. The drift is expressed as a conditional expectation that…

Statistics Theory · Mathematics 2026-05-21 Yifan Chen , Eric Vanden-Eijnden

It is shown how Adler's trace dynamics can be applied to stochastic mechanics and other complex classical dynamical systems. Emergent non-commutivity due to the fractal nature of sample trajectories is closely related to the fact that the…

Quantum Physics · Physics 2007-05-23 Mark Davidson

First-order methods are often analyzed via their continuous-time models, where their worst-case convergence properties are usually approached via Lyapunov functions. In this work, we provide a systematic and principled approach to find and…

Numerical Analysis · Mathematics 2024-03-12 Céline Moucer , Adrien Taylor , Francis Bach

We consider the task of generating discrete-time realisations of a nonlinear multivariate diffusion process satisfying an It\^o stochastic differential equation conditional on an observation taken at a fixed future time-point. Such…

Computation · Statistics 2016-04-26 Gavin A. Whitaker , Andrew Golightly , Richard J. Boys , Chris Sherlock

Direct Preference Optimization (DPO) aligns text-to-image (T2I) generation models with human preferences using pairwise preference data. Although substantial resources are expended in collecting and labeling datasets, a critical aspect is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yunhong Lu , Qichao Wang , Hengyuan Cao , Xiaoyin Xu , Min Zhang

Diffusion in a multidimensional energy surface with minima and barriers is a problem of importance in statistical mechanics and also has wide applications, such as protein folding. To understand it in such a system, we carry out theory and…

Statistical Mechanics · Physics 2022-06-29 Subhajit Acharya , Biman Bagchi