English
Related papers

Related papers: Lyapunov Stability of Stochastic Vector Optimizati…

200 papers

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

Diffusion models have emerged as powerful tools for generative modeling, demonstrating exceptional capability in capturing target data distributions from large datasets. However, fine-tuning these massive models for specific downstream…

Machine Learning · Computer Science 2025-09-01 Yinbin Han , Meisam Razaviyayn , Renyuan Xu

Differentially private distributed stochastic optimization has become a hot topic due to the urgent need of privacy protection in distributed stochastic optimization. In this paper, two-time scale stochastic approximation-type algorithms…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Jimin Wang , Ji-Feng Zhang

Mathematically modelling diffusive and advective transport of particles in heterogeneous layered media is important to many applications in computational, biological and medical physics. While deterministic continuum models of such…

Computational Physics · Physics 2024-09-16 Elliot J. Carr

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

Machine Learning · Statistics 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

Solving statistical learning problems often involves nonconvex optimization. Despite the empirical success of nonconvex statistical optimization methods, their global dynamics, especially convergence to the desirable local minima, remain…

Machine Learning · Statistics 2018-08-30 Chris Junchi Li , Zhaoran Wang , Han Liu

Stochastic dynamical systems are fundamental in state estimation, system identification and control. System models are often provided in continuous time, while a major part of the applied theory is developed for discrete-time systems.…

Dynamical Systems · Mathematics 2014-02-07 Niklas Wahlström , Patrix Axelsson , Fredrik Gustafsson

Using the method of Krylov's estimates, we prove the existence of weak solutions of stochastic differential equations driven by purely discontinuous Levy processes satisfying an additional assumption. The diffusion coefficient is assumed to…

Probability · Mathematics 2007-05-23 V. P. Kurenok

To solve convex optimization problems with a noisy gradient input, we analyze the global behavior of subgradient-like flows under stochastic errors. The objective function is composite, being equal to the sum of two convex functions, one…

Optimization and Control · Mathematics 2025-06-05 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch

We prove optimality principles for semicontinuous bounded viscosity solutions of Hamilton-Jacobi-Bellman equations. In particular we provide a representation formula for viscosity supersolutions as value functions of suitable obstacle…

Optimization and Control · Mathematics 2007-05-23 Annalisa Cesaroni

Pathwise uniqueness for multi-dimensional stochastic McKean--Vlasov equation is established under moderate regularity conditions on the drift and diffusion coefficients. Both drift and diffusion depend on the marginal measure of the…

Probability · Mathematics 2023-01-02 Alexander Veretennikov

We develop a finite-dimensional sensitivity framework for studying stability in learning systems whose states include representations, parameters, and update variables. The central object is the \emph{Learning Stability Profile}, a…

Machine Learning · Computer Science 2026-05-26 Ronald Katende

Discrete diffusion models have gained increasing attention for their ability to model complex distributions with tractable sampling and inference. However, the error analysis for discrete diffusion models remains less well-understood. In…

Machine Learning · Computer Science 2025-03-04 Yinuo Ren , Haoxuan Chen , Grant M. Rotskoff , Lexing Ying

Techniques from numerical bifurcation theory are very useful to study transitions between steady fluid flow patterns and the instabilities involved. Here, we provide computational methodology to use parameter continuation in determining…

Numerical Analysis · Mathematics 2020-11-12 S. Baars , J. P. Viebahn , T. E. Mulder , C. Kuehn , F. W. Wubs , H. A. Dijkstra

We obtain new transport-entropy inequalities and, as a by-product, new deviation estimates for the laws of two kinds of discrete stochastic approximation schemes. The first one refers to the law of an Euler like discretization scheme of a…

Probability · Mathematics 2013-02-01 Max Fathi , Noufel Frikha

We consider a discrete-time model of continuous-time distributed optimization over dynamic directed-graphs (digraphs) with applications to distributed learning. Our optimization algorithm works over general strongly connected dynamic…

Optimization and Control · Mathematics 2024-03-27 Mohammadreza Doostmohammadian , Wei Jiang , Muwahida Liaquat , Alireza Aghasi , Houman Zarrabi

This paper tackles the problem of discretizing accelerated optimization flows while retaining their convergence properties. Inspired by the success of resource-aware control in developing efficient closed-loop feedback implementations on…

Optimization and Control · Mathematics 2020-09-22 Miguel Vaquero , Pol Mestres , Jorge Cortés

Diffusion models have achieved state-of-the-art performance across multiple domains, with recent advancements extending their applicability to discrete data. However, aligning discrete diffusion models with task-specific preferences remains…

Machine Learning · Computer Science 2025-04-10 Umberto Borso , Davide Paglieri , Jude Wells , Tim Rocktäschel

We are interested in the Euler-Maruyama discretization of a stochastic differential equation in dimension $d$ with constant diffusion coefficient and bounded measurable drift coefficient. In the scheme, a randomization of the time variable…

Probability · Mathematics 2020-11-13 Oumaima Bencheikh , Benjamin Jourdain

Cross-sectional observations from a dynamical system can be modeled via steady-state distributions of Markov processes. The major challenge is then to determine whether the process parameters can be identified and estimated from the…

Statistics Theory · Mathematics 2026-03-19 Cecilie Olesen Recke , Niels Richard Hansen