English
Related papers

Related papers: A Quadratically Convergent Algorithm for Structure…

200 papers

Recently a deterministic method, frequent directions (FD) is proposed to solve the high dimensional low rank approximation problem. It works well in practice, but experiences high computational cost. In this paper, we establish a fast…

Numerical Analysis · Mathematics 2018-10-09 Dan Teng , Delin Chu

The goal of this work is to fill a gap in [Yang, SIAM J. Matrix Anal. Appl, 41 (2020), 1797--1825]. In that work, an approximation procedure was proposed for orthogonal low-rank tensor approximation; however, the approximation lower bound…

Optimization and Control · Mathematics 2021-01-01 Yuning Yang

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

Data Structures and Algorithms · Computer Science 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

Matrix rank minimizing subject to affine constraints arises in many application areas, ranging from signal processing to machine learning. Nuclear norm is a convex relaxation for this problem which can recover the rank exactly under some…

Computer Vision and Pattern Recognition · Computer Science 2015-08-20 Zhao Kang , Chong Peng , Qiang Cheng

Randomized algorithms for low-rank approximation of quaternion matrices have gained increasing attention in recent years. However, existing methods overlook pass efficiency, the ability to limit the number of passes over the input…

Numerical Analysis · Mathematics 2026-03-25 Salman Ahmadi-Asl , Malihe Nobakht Kooshkghazi , Valentin Leplat

We propose an algorithm that approximates a given matrix polynomial of degree $d$ by another skew-symmetric matrix polynomial of a specified rank and degree at most $d$. The algorithm is built on recent advances in the theory of generic…

Numerical Analysis · Mathematics 2026-01-26 Andrii Dmytryshyn , Froilán M. Dopico , Rakel Hellberg

In this paper, we derive entrywise error bounds for low-rank approximations of kernel matrices obtained using the truncated eigen-decomposition (or singular value decomposition). While this approximation is well-known to be optimal with…

Statistics Theory · Mathematics 2024-10-31 Alexander Modell

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch

In this paper we develop algorithms for approximating matrix multiplication with respect to the spectral norm. Let A\in{\RR^{n\times m}} and B\in\RR^{n \times p} be two matrices and \eps>0. We approximate the product A^\top B using two…

Data Structures and Algorithms · Computer Science 2010-10-28 Avner Magen , Anastasios Zouzias

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

In this note, we investigate how well we can reconstruct the best rank-$r$ approximation of a large matrix from a small number of its entries. We show that even if a data matrix is of full rank and cannot be approximated well by a low-rank…

Methodology · Statistics 2021-11-12 Shun Xu , Ming Yuan

We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a…

Numerical Analysis · Mathematics 2024-07-02 Paul Breiding , Nick Vannieuwenhoven

We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proximal-type algorithms applied to exact penalty formulations of…

Optimization and Control · Mathematics 2019-03-04 Yu Bai , John Duchi , Song Mei

First, we extend the results of approximate matrix multiplication from the Frobenius norm to the spectral norm. Second, We develop a class of fast approximate generalized linear regression algorithms with respect to the spectral norm.…

Numerical Analysis · Computer Science 2015-11-11 Haishan Ye , Zhihua Zhang

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

We present two algorithms for large-scale low-rank Euclidean distance matrix completion problems, based on semidefinite optimization. Our first method works by relating cliques in the graph of the known distances to faces of the positive…

Optimization and Control · Mathematics 2015-08-27 Dmitriy Drusvyatskiy , Nathan Krislock , Yuen-Lam Voronin , Henry Wolkowicz

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

Matrices are typically considered over fields or rings. Motivated by applications in parametric differential equations and data-driven modeling, we suggest to study matrices with entries from a Hilbert space and present an elementary theory…

Numerical Analysis · Mathematics 2025-05-09 Stanislav Budzinskiy

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

We primarily study a special a weighted low-rank approximation of matrices and then apply it to solve the background modeling problem. We propose two algorithms for this purpose: one operates in the batch mode on the entire data and the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Aritra Dutta , Xin Li , Peter Richtarik
‹ Prev 1 3 4 5 6 7 10 Next ›