English
Related papers

Related papers: A low-rank method for time-dependent transport cal…

200 papers

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

In this work, the Parareal algorithm is applied to evolution problems that admit good low-rank approximations and for which the dynamical low-rank approximation (DLRA) can be used as time stepper. Many discrete integrators for DLRA have…

Numerical Analysis · Mathematics 2022-09-14 Benjamin Carrel , Martin J. Gander , Bart Vandereycken

This work proposes and analyzes a new class of numerical integrators for computing low-rank approximations to solutions of matrix differential equation. We combine an explicit Runge-Kutta method with repeated randomized low-rank…

Numerical Analysis · Mathematics 2024-09-11 Hei Yin Lam , Gianluca Ceruti , Daniel Kressner

We develop computational methods for approximating the solution of a linear multi-term matrix equation in low rank. We follow an alternating minimization framework, where the solution is represented as a product of two matrices, and…

Numerical Analysis · Mathematics 2020-06-16 Kookjin Lee , Howard C. Elman , Catherine E. Powell , Dongeun Lee

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

Fractional Ginzburg-Landau equations as the generalization of the classical one have been used to describe various physical phenomena. In this paper, we propose a numerical integration method for solving space fractional Ginzburg-Landau…

Numerical Analysis · Mathematics 2024-03-20 Yong-Liang Zhao , Alexander Ostermann , Xian-Ming Gu

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

This paper considers the completion problem for a tensor (also referred to as a multidimensional array) from limited sampling. Our greedy method is based on extending the low-rank approximation pursuit (LRAP) method for matrix completions…

Numerical Analysis · Mathematics 2020-04-21 An-Bao Xu

In this paper, we propose a dynamical low-rank (DLR) approximation framework for solving the semiclassical Schrodinger equation with uncertainties. The primary numerical challenges arise from the dual nature of the oscillations: the spatial…

Numerical Analysis · Mathematics 2026-02-23 Liu Liu , Limin Xu , Zhenyi Zhu

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

In this paper, we study the problem of low-rank tensor learning, where only a few of training samples are observed and the underlying tensor has a low-rank structure. The existing methods are based on the sum of nuclear norms of unfolding…

Machine Learning · Computer Science 2024-10-25 Sijia Xia , Michael K. Ng , Xiongjun Zhang

We propose a symmetric low-rank representation (SLRR) method for subspace clustering, which assumes that a data set is approximately drawn from the union of multiple subspaces. The proposed technique can reveal the membership of multiple…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Jie Chen , Haixian Zhang , Hua Mao , Yongsheng Sang , Zhang Yi

Weak constraint four-dimensional variational data assimilation is an important method for incorporating data (typically observations) into a model. The linearised system arising within the minimisation process can be formulated as a saddle…

Numerical Analysis · Mathematics 2018-02-14 Melina A. Freitag , Daniel L. H. Green

Learning neural fields has been an active topic in deep learning research, focusing, among other issues, on finding more compact and easy-to-fit representations. In this paper, we introduce a novel low-rank representation termed Tensor…

Machine Learning · Computer Science 2022-10-03 Anton Obukhov , Mikhail Usvyatsov , Christos Sakaridis , Konrad Schindler , Luc Van Gool

In this paper, we focus on developing randomized algorithms for the computation of low multilinear rank approximations of tensors based on the random projection and the singular value decomposition. Following the theory of the singular…

Numerical Analysis · Mathematics 2020-03-20 Maolin Che , Yimin Wei , Hong Yan

The paper is devoted to the solution of a weighted nonlinear least-squares problem for low-rank signal estimation, which is related to Hankel structured low-rank approximation problems. A modified weighted Gauss-Newton method, which uses…

Numerical Analysis · Mathematics 2020-12-01 N. Zvonarev , N. Golyandina

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

We provide evidence that randomized low-rank factorization is a powerful tool for the determination of the ground state properties of low-dimensional lattice Hamiltonians through tensor network techniques. In particular, we show that…

Low-Rank Adaptation (LoRA), which leverages the insight that model updates typically reside in a low-dimensional space, has significantly improved the training efficiency of Large Language Models (LLMs) by updating neural network layers…

Machine Learning · Computer Science 2026-05-01 Han Liu , Shanghao Shi , Yevgeniy Vorobeychik , Chongjie Zhang , Ning Zhang

We present a method for improving a Non Local Means operator by computing its low-rank approximation. The low-rank operator is constructed by applying a filter to the spectrum of the original Non Local Means operator. This results in an…

Computer Vision and Pattern Recognition · Computer Science 2014-12-08 Victor May , Yosi Keller , Nir Sharon , Yoel Shkolnisky