English
Related papers

Related papers: Stochastic dynamical low-rank approximation method

200 papers

Low-rank plus diagonal (LRPD) decompositions provide a powerful structural model for large covariance matrices, simultaneously capturing global shared factors and localized corrections that arise in covariance estimation, factor analysis,…

Numerical Analysis · Mathematics 2025-12-22 Kingsley Yeon , Mihai Anitescu

We develop in this work a numerical method for stochastic differential equations (SDEs) with weak second order accuracy based on Gaussian mixture. Unlike the conventional higher order schemes for SDEs based on It\^o-Taylor expansion and…

Numerical Analysis · Mathematics 2021-08-12 Lei Li , Jianfeng Lu , Jonathan Mattingly , Lihan Wang

We put forward a new method for obtaining quantitative lower bounds on the top Lyapunov exponent of stochastic differential equations (SDEs). Our method combines (i) an (apparently new) identity connecting the top Lyapunov exponent to a…

Dynamical Systems · Mathematics 2022-08-04 Jacob Bedrossian , Alex Blumenthal , Sam Punshon-Smith

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

Optimization and Control · Mathematics 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

It is increasingly realized that taking stochastic effects into account is important in order to study biological cells. However, the corresponding mathematical formulation, the chemical master equation (CME), suffers from the curse of…

Numerical Analysis · Mathematics 2023-09-18 Lukas Einkemmer , Julian Mangott , Martina Prugger

This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical…

Numerical Analysis · Mathematics 2024-04-18 Daniel Kressner , Hei Yin Lam

In this article, we analyse the domain mapping method approach to approximate statistical moments of solutions to linear elliptic partial differential equations posed over random geometries including smooth surfaces and bulk-surface…

Numerical Analysis · Mathematics 2019-03-18 Lewis Church , Ana Djurdjevac , Charles M. Elliott

We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in the high-dimensional regime. We prove limit theorems for the trajectories of summary statistics (i.e., finite-dimensional functions) of SGD as the…

Machine Learning · Statistics 2023-08-21 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

In this paper, we propose a novel adaptive stochastic extended iterative method, which can be viewed as an improved extension of the randomized extended Kaczmarz (REK) method, for finding the unique minimum Euclidean norm least-squares…

Numerical Analysis · Mathematics 2025-09-23 Yun Zeng , Deren Han , Yansheng Su , Jiaxin Xie

The paper deals with the numerical solution of the nonlinear Ito stochastic differential equations (SDEs) appearing in the unravelling of quantum master equations. We first develop an exponential scheme of weak order 1 for general globally…

Probability · Mathematics 2007-05-23 Carlos M. Mora

Neural Stochastic Differential Equations (Neural SDEs) have emerged as powerful mesh-free generative models for continuous stochastic processes, with critical applications in fields such as finance, physics, and biology. Previous…

Machine Learning · Computer Science 2025-03-28 Jianxin Zhang , Josh Viktorov , Doosan Jung , Emily Pitler

This paper investigates the approximation of stochastic delay differential equations (SDDEs) via the backward Euler-Maruyama (BEM) method under generalized monotonicity and Khasminskii-type conditions in the infinite horizon. First, by…

Numerical Analysis · Mathematics 2025-05-20 Yudong Wang , Hongjiong Tian

Stochastic shortest path (SSP) problems arise in a variety of discrete stochastic control contexts. An optimal solutions to such a problem is typically computed using the value function, which can be found by solving the corresponding…

Optimization and Control · Mathematics 2008-02-29 Alexander Vladimirsky

Ecological Momentary Assessment (EMA) studies enable the collection of high-frequency self-reports of suicidal thoughts and behaviors (STBs) via smartphones. Latent stochastic differential equations (SDEs) are a promising model class for…

Machine Learning · Statistics 2026-05-26 Malinda Lu , Yue-Jane Liu , Matthew K. Nock , Yaniv Yacoby

Stochastic learning dynamics based on Langevin or Levy stochastic differential equations (SDEs) in deep neural networks control the variance of noise by varying the size of the mini-batch or directly those of injecting noise. Since the…

Machine Learning · Computer Science 2023-10-05 JInwuk Seok , Changsik Cho

In this paper, we study ordinary differential equations (ODE) coupled with solutions of a stochastic nonsmooth convex optimization problem (SNCOP). We use the regularization approach, the sample average approximation and the time-stepping…

Optimization and Control · Mathematics 2025-02-11 Jianfeng Luo , Xiaojun Chen

Low-rank approximation using time-dependent bases (TDBs) has proven effective for reduced-order modeling of stochastic partial differential equations (SPDEs). In these techniques, the random field is decomposed to a set of deterministic…

Numerical Analysis · Mathematics 2022-11-08 Prerna Patil , Hessam Babaee

We identify effective stochastic differential equations (SDE) for coarse observables of fine-grained particle- or agent-based simulations; these SDE then provide useful coarse surrogate models of the fine scale dynamics. We approximate the…

Our approach is part of the close link between continuous dissipative dynamical systems and optimization algorithms. We aim to solve convex minimization problems by means of stochastic inertial differential equations which are driven by the…

Optimization and Control · Mathematics 2025-06-06 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs