Related papers: Lyapunov Stability of Stochastic Vector Optimizati…
Heavy traffic analysis for load balancing policies has relied heavily on the condition of state-space collapse onto a single-dimensional line in previous works. In this paper, via Lyapunov-drift analysis, we rigorously prove that even under…
We develop a unified and easy to use framework to study robust fully discrete numerical methods for nonlinear degenerate diffusion equations $$ \partial_t u-\mathfrak{L}^{\sigma,\mu}[\varphi(u)]=f \quad\quad\text{in}\quad\quad…
Macroscopic traffic flow is stochastic, but the physics-informed deep learning methods currently used in transportation literature embed deterministic PDEs and produce point-valued outputs; the stochasticity of the governing dynamics plays…
We study episodic reinforcement learning (RL) in non-stationary linear kernel Markov decision processes (MDPs). In this setting, both the reward function and the transition kernel are linear with respect to the given feature maps and are…
In this paper we study properties of solutions to stochastic differential equations with Sobolev diffusion coefficients and singular drifts. The properties we study include stability with respect to the coefficients, weak differentiability…
We propose a flexible gradient tracking approach with adjustable computation and communication steps for solving distributed stochastic optimization problem over networks. The proposed method allows each node to perform multiple local…
Systems with predetermined Lyapunov functions play an important role in many areas of applied mathematics, physics and engineering: dynamic optimization methods (objective functions and their modifications), machine learning (loss…
This paper explores the reconstruction of drift or diffusion coefficients of a scalar stochastic diffusion processes as it starts from an initial value and reaches, for the first time, a threshold value. We show that the distribution…
We investigate the strong approximation of stochastic differential equations whose drift is square-integrable in time and Dini continuous in space, while the diffusion coefficient is non-constant and uniformly elliptic. Using a refined…
We study the convergence properties of the original and away-step Frank-Wolfe algorithms for linearly constrained stochastic optimization assuming the availability of unbiased objective function gradient estimates. The objective function is…
We revisit an algorithm for distributed consensus optimization proposed in 2010 by J. Wang and N. Elia. By means of a Lyapunov-based analysis, we prove input-to-state stability of the algorithm relative to a closed invariant set composed of…
The main purpose of this work is to characterize the almost sure local structure stability of solutions to a class of linear stochastic partial functional differential equations (SPFDEs) by investigating the Lyapunov exponents and invariant…
The general theory of Lyapunov's stability of first-order differential inclusions in Hilbert spaces has been studied by the authors in a previous work. This new contribution focuses on the natural case when the maximally monotone operator…
We introduce a novel adaptive damping technique for an inertial gradient system which finds application as a gradient descent algorithm for unconstrained optimisation. In an example using the non-convex Rosenbrock's function, we show an…
Distributionally Robust Optimization (DRO), as a popular method to train robust models against distribution shift between training and test sets, has received tremendous attention in recent years. In this paper, we propose and analyze…
This work focuses on stability of regime-switching diffusions consisting of continuous and discrete components, in which the discrete component switches in a countably infinite set and its switching rates at current time depend on the…
Stochastic evolution equations with compensated Poisson noise are considered in the variational approach with monotone and coercive coefficients. Here the Poisson noise is assumed to be time-homogeneous with $\sigma$-finite intensity…
Recent advances in diffusion models show promising potential to accelerate nonconvex problem solving by leveraging their multimodality. However, most existing diffusion-based optimization approaches rely on supervised learning and lack a…
The canonical model of stochastic search tracks a randomly diffusing "searcher" until it finds a "target." Owing to its many applications across science and engineering, this perennially popular problem has been thoroughly investigated in a…
This paper considers a wide class of smooth continuous dynamic nonlinear systems (control objects) with a measurable vector of state. The problem is to find a special function (Lyapunov function), which in the framework of the second…