English
Related papers

Related papers: From low-rank retractions to dynamical low-rank ap…

200 papers

The dynamical low-rank (DLR) approximation is an efficient technique to approximate the solution to matrix differential equations. Recently, the DLR method was applied to radiation transport calculations to reduce memory requirements and…

Computational Physics · Physics 2022-11-23 Zhuogang Peng , Ryan G. McClarren

Dynamical low-rank approximation, as has been demonstrated recently, can be extremely efficient in solving kinetic equations. However, a major deficiency is that they do not preserve the structure of the underlying physical problem. For…

Numerical Analysis · Mathematics 2023-04-26 Lukas Einkemmer , Alexander Ostermann , Carmen Scalone

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

Dynamical low-rank approximation (DLRA) is an emerging tool for reducing computational costs and provides memory savings when solving high-dimensional problems. In this work, we propose and analyze a semi-implicit dynamical low-rank…

Numerical Analysis · Mathematics 2023-08-14 Peimeng Yin , Eirik Endeve , Cory D. Hauck , Stefan R. Schnake

Deterministic models for radiation transport describe the density of radiation particles moving through a background material. In radiation therapy applications, the phase space of this density is composed of energy, spatial position and…

Numerical Analysis · Mathematics 2021-11-16 Jonas Kusch , Pia Stammer

In this paper, we set the mathematical foundations of the Dynamical Low-Rank Approximation (DLRA) method for stochastic differential equations (SDEs). DLRA aims at approximating the solution as a linear combination of a small number of…

Numerical Analysis · Mathematics 2024-08-23 Yoshihito Kazashi , Fabio Nobile , Fabio Zoccolan

Computing numerical solutions of the thermal radiative transfer equations on a finely resolved grid can be costly due to high computational and memory requirements. A numerical reduced order method that has recently been applied to a wide…

Numerical Analysis · Mathematics 2026-05-25 Lena Baumann , Lukas Einkemmer , Christian Klingenberg , Jonas Kusch

Computing effective eigenvalues for neutron transport often requires a fine numerical resolution. The main challenge of such computations is the high memory effort of classical solvers, which limits the accuracy of chosen discretizations.…

Numerical Analysis · Mathematics 2022-09-28 Jonas Kusch , Benjamin Whewell , Ryan McClarren , Martin Frank

Dose calculations in proton therapy require the fast and accurate solution of a high-dimensional transport equation for a large number of (pencil) beams with different energies and directions. Deterministically solving this transport…

Numerical Analysis · Mathematics 2025-08-07 Pia Stammer , Niklas Wahl , Jonas Kusch , Danny Lathouwers

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

In continual learning (CL), catastrophic forgetting often arises due to feature drift. This challenge is particularly prominent in the exemplar-free continual learning (EFCL) setting, where samples from previous tasks cannot be retained,…

Machine Learning · Computer Science 2025-04-01 Xuan Liu , Xiaobin Chang

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

The numerical method of dynamical low-rank approximation (DLRA) has recently been applied to various kinetic equations showing a significant reduction of the computational effort. In this paper, we apply this concept to the linear…

Numerical Analysis · Mathematics 2024-11-12 Lena Baumann , Lukas Einkemmer , Christian Klingenberg , Jonas Kusch

The dynamical low-rank approximation of time-dependent matrices is a low-rank factorization updating technique. It leads to differential equations for factors of the matrices, which need to be solved numerically. We propose and analyze a…

Numerical Analysis · Mathematics 2013-01-09 Christian Lubich , Ivan Oseledets

In this paper, we propose first-order feasible methods for difference-of-convex (DC) programs with smooth inequality and simple geometric constraints. Our strategy for maintaining feasibility of the iterates is based on a "retraction" idea…

Optimization and Control · Mathematics 2022-12-05 Yongle Zhang , Guoyin Li , Ting Kei Pong , Shiqi Xu

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

Machine Learning · Computer Science 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

Computing the numerical solution to high-dimensional tensor differential equations can lead to prohibitive computational costs and memory requirements. To reduce the memory and computational footprint, dynamical low-rank approximation…

Numerical Analysis · Mathematics 2024-12-03 Gianluca Ceruti , Jonas Kusch , Christian Lubich , Dominik Sulz

We present a twofold contribution to the numerical simulation of Lindblad equations. First, an adaptive numerical approach to approximate Lindblad equations using low-rank dynamics is described: a deterministic low-rank approximation of the…

Quantum Physics · Physics 2015-12-30 Claude Le Bris , Pierre Rouchon , Julien Roussel

Layer factorization has emerged as a widely used technique for training memory-efficient neural networks. However, layer factorization methods face several challenges, particularly a lack of robustness during the training process. To…

Numerical Analysis · Mathematics 2025-02-06 Jonas Kusch , Steffen Schotthöfer , Alexandra Walter