English
Related papers

Related papers: Stochastic dynamical low-rank approximation method

200 papers

This paper proposes a dynamical Variable-separation method for solving parameter-dependent dynamical systems. To achieve this, we establish a dynamical low-rank approximation for the solutions of these dynamical systems by successively…

Numerical Analysis · Mathematics 2025-02-13 Liang Chen , Yaru Chen , Qiuqi Li , Tao Zhou

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

We approximate stochastic processes in finite dimension by dynamical systems. We provide trajectorial estimates which are uniform with respect to the initial condition for a well chosen distance. This relies on some non-expansivity property…

Probability · Mathematics 2017-01-11 Vincent Bansaye

We consider the problem of computing tractable approximations of time-dependent d x d large positive semi-definite (PSD) matrices defined as solutions of a matrix differential equation. We propose to use "low-rank plus diagonal" PSD…

Numerical Analysis · Mathematics 2024-07-08 Silvère Bonnabel , Marc Lambert , Francis Bach

We focus on solving constrained convex optimization problems using mini-batch stochastic gradient descent. Dynamic sample size rules are presented which ensure a descent direction with high probability. Empirical results from two…

Optimization and Control · Mathematics 2017-08-03 Michael R. Metel

Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are…

Numerical Analysis · Mathematics 2020-12-15 Antonio Fazzi , Nicola Guglielmi , Ivan Markovsky

Stochastic differential equations (SDEs) using jump-diffusion processes describe many natural phenomena at the microscopic level. Since they are commonly used to model economic and financial evolutions, the calibration and optimal control…

Optimization and Control · Mathematics 2025-05-08 Jan Bartsch , Alfio Borzi , Gabriele Ciaramella , Jan Reichle

Numerical continuation methods for deterministic dynamical systems have been one of the most successful tools in applied dynamical systems theory. Continuation techniques have been employed in all branches of the natural sciences as well as…

Dynamical Systems · Mathematics 2015-03-19 Christian Kuehn

In this paper we propose and analyze explicit space-time discrete numerical approximations for additive space-time white noise driven stochastic partial differential equations (SPDEs) with non-globally monotone nonlinearities such as the…

Numerical Analysis · Mathematics 2020-06-04 Arnulf Jentzen , Diyora Salimova , Timo Welti

We describe a numerical framework that uses random sampling to efficiently capture low-rank local solution spaces of multiscale PDE problems arising in domain decomposition. In contrast to existing techniques, our method does not rely on…

Numerical Analysis · Mathematics 2020-02-06 Ke Chen , Qin Li , Jianfeng Lu , Stephen J. Wright

In algorithms for solving optimization problems constrained to a smooth manifold, retractions are a well-established tool to ensure that the iterates stay on the manifold. More recently, it has been demonstrated that retractions are a…

Numerical Analysis · Mathematics 2024-03-11 Axel Séguin , Gianluca Ceruti , Daniel Kressner

A novel compressed matrix format is proposed that combines an adaptive hierarchical partitioning of the matrix with low-rank approximation. One typical application is the approximation of discretized functions on rectangular domains; the…

Numerical Analysis · Mathematics 2021-11-05 Stefano Massei , Leonardo Robol , Daniel Kressner

Stochastic gradient methods have been a popular and powerful choice of optimization methods, aimed at minimizing functions. Their advantage lies in the fact that that one approximates the gradient as opposed to using the full Jacobian…

Numerical Analysis · Mathematics 2025-09-26 Neil K. Chada , Philip J. Herbert

We study stochastic delay differential equations (SDDE) where the coefficients depend on the moving averages of the state process. As a first contribution, we provide sufficient conditions under which a linear path functional of the…

Probability · Mathematics 2013-10-17 Salvatore Federico , Peter Tankov

We present a new method based on functional tensor decomposition and dynamic tensor approximation to compute the solution of a high-dimensional time-dependent nonlinear partial differential equation (PDE). The idea of dynamic approximation…

Numerical Analysis · Mathematics 2021-04-14 Alec Dektor , Daniele Venturi

In this thesis, we extend the recently introduced theory of stochastic modified equations (SMEs) for stochastic gradient optimization algorithms. In Ch. 3 we study time-inhomogeneous SDEs driven by Brownian motion. For certain SDEs we prove…

Probability · Mathematics 2025-11-26 Stefan Perko

The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation…

Machine Learning · Statistics 2025-06-27 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

A numerical dynamical low-rank approximation (DLRA) scheme for the solution of the Vlasov-Poisson equation is presented. Based on the formulation of the DLRA equations as Friedrichs' systems in a continuous setting, it combines recently…

Numerical Analysis · Mathematics 2025-08-15 André Uschmajew , Andreas Zeiser

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly