English
Related papers

Related papers: Low rank approximation method for perturbed linear…

200 papers

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

A multilevel adaptive refinement strategy for solving linear elliptic partial differential equations with random data is recalled in this work. The strategy extends the a posteriori error estimation framework introduced by Guignard and…

Numerical Analysis · Mathematics 2022-02-21 Alex Bespalov , David J. Silvester

We study the proximal gradient descent (PGD) method for $\ell^{0}$ sparse approximation problem as well as its accelerated optimization with randomized algorithms in this paper. We first offer theoretical analysis of PGD showing the bounded…

Optimization and Control · Mathematics 2017-09-06 Yingzhen Yang , Jiashi Feng , Nebojsa Jojic , Jianchao Yang , Thomas S. Huang

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

We introduce a dynamical low-rank method to reduce the computational complexity for solving the multi-scale multi-dimensional linear transport equation. The method is based on a macro-micro decomposition of the equation. The proposed…

Numerical Analysis · Mathematics 2021-06-02 Lukas Einkemmer , Jingwei Hu , Yubo Wang

Damped wave equations have been used in many real-world fields. In this paper, we study a low-rank solution of the strongly damped wave equation with the damping term, visco-elastic damping term and mass term. Firstly, a second-order finite…

Numerical Analysis · Mathematics 2023-10-10 Yong-Liang Zhao , Xian-Ming Gu

This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and…

Numerical Analysis · Mathematics 2026-01-12 Fabio Musco , Andrea Barth

Low-rank matrix completion consists of computing a matrix of minimal complexity that recovers a given set of observations as accurately as possible. Unfortunately, existing methods for matrix completion are heuristics that, while highly…

Machine Learning · Computer Science 2026-03-12 Dimitris Bertsimas , Ryan Cory-Wright , Sean Lo , Jean Pauphilet

We introduce novel dynamical low-rank methods for solving large-scale matrix differential equations, motivated by algorithms from randomized numerical linear algebra. In terms of performance (cost and accuracy), our methods overperform…

Numerical Analysis · Mathematics 2025-10-13 Benjamin Carrel

We propose a new algorithm to solve optimization problems of the form $\min f(X)$ for a smooth function $f$ under the constraints that $X$ is positive semidefinite and the diagonal blocks of $X$ are small identity matrices. Such problems…

Optimization and Control · Mathematics 2016-01-07 Nicolas Boumal

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

In this paper, we introduce a numerical solution of a stochastic partial differential equation (SPDE) of elliptic type using polynomial chaos along side with polynomial approximation at Sinc points. These Sinc points are defined by a…

Numerical Analysis · Mathematics 2019-04-08 Maha Youssef , Roland Pulch

We study an iterative low-rank approximation method for the solution of the steady-state stochastic Navier--Stokes equations with uncertain viscosity. The method is based on linearization schemes using Picard and Newton iterations and…

Numerical Analysis · Mathematics 2019-11-04 Kookjin Lee , Howard C. Elman , Bedřich Sousedík

Composite convex optimization problems which include both a nonsmooth term and a low-rank promoting term have important applications in machine learning and signal processing, such as when one wishes to recover an unknown matrix that is…

Machine Learning · Computer Science 2018-09-28 Dan Garber , Atara Kaplan

We propose a stochastic approximation method for approximating the efficient frontier of chance-constrained nonlinear programs. Our approach is based on a bi-objective viewpoint of chance-constrained programs that seeks solutions on the…

Optimization and Control · Mathematics 2020-05-29 Rohit Kannan , James Luedtke

We study the problem of entrywise $\ell_1$ low rank approximation. We give the first polynomial time column subset selection-based $\ell_1$ low rank approximation algorithm sampling $\tilde{O}(k)$ columns and achieving an…

Data Structures and Algorithms · Computer Science 2020-11-17 Arvind V. Mahankali , David P. Woodruff

Recently a deterministic method, frequent directions (FD) is proposed to solve the high dimensional low rank approximation problem. It works well in practice, but experiences high computational cost. In this paper, we establish a fast…

Numerical Analysis · Mathematics 2018-10-09 Dan Teng , Delin Chu

We establish convergence rates for a fully discrete, multi-level, linear collocation method solving parametric elliptic PDEs on bounded polygonal domains with log-normal inputs. The method uses a finite set of function evaluations in the…

Numerical Analysis · Mathematics 2026-03-30 Dinh Dũng

PDE-constrained optimization problems arise in a broad number of applications such as hyperthermia cancer treatment or blood flow simulation. Discretization of the optimization problem and using a Lagrangian approach result in a large-scale…

Numerical Analysis · Mathematics 2020-06-01 Alexandra Bünger , Valeria Simoncini , Martin Stoll