English
Related papers

Related papers: Sublinear Time Low-Rank Approximation of Toeplitz …

200 papers

A common data analysis task is the reduced-rank regression problem: $$\min_{\textrm{rank-}k \ X} \|AX-B\|,$$ where $A \in \mathbb{R}^{n \times c}$ and $B \in \mathbb{R}^{n \times d}$ are given large matrices and $\|\cdot\|$ is some norm.…

Data Structures and Algorithms · Computer Science 2021-07-02 Praneeth Kacham , David P. Woodruff

In the classical Subset Sum problem we are given a set $X$ and a target $t$, and the task is to decide whether there exists a subset of $X$ which sums to $t$. A recent line of research has resulted in $\tilde{O}(t)$-time algorithms, which…

Data Structures and Algorithms · Computer Science 2023-04-25 Karl Bringmann , Vasileios Nakos

Structured Low-Rank Approximation is a problem arising in a wide range of applications in Numerical Analysis and Engineering Sciences. Given an input matrix $M$, the goal is to compute a matrix $M'$ of given rank $r$ in a linear or affine…

Numerical Analysis · Computer Science 2014-10-28 Éric Schost , Pierre-Jean Spaenlehauer

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

Data Structures and Algorithms · Computer Science 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

We overcome two major bottlenecks in the study of low rank approximation by assuming the low rank factors themselves are sparse. Specifically, (1) for low rank approximation with spectral norm error, we show how to improve the best known…

Data Structures and Algorithms · Computer Science 2021-11-02 David P. Woodruff , Taisuke Yasuda

We describe a randomized algorithm for producing a near-optimal hierarchical off-diagonal low-rank (HODLR) approximation to an $n\times n$ matrix $\mathbf{A}$, accessible only though matrix-vector products with $\mathbf{A}$ and…

Data Structures and Algorithms · Computer Science 2024-10-25 Tyler Chen , Feyza Duman Keles , Diana Halikias , Cameron Musco , Christopher Musco , David Persson

Given a positive integer n and a positive semidefinite matrix A = (A_{ij}) of size m x m, the positive semidefinite Grothendieck problem with rank-n-constraint (SDP_n) is maximize \sum_{i=1}^m \sum_{j=1}^m A_{ij} x_i \cdot x_j, where x_1,…

Optimization and Control · Mathematics 2010-09-17 Jop Briet , Fernando Mario de Oliveira Filho , Frank Vallentin

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the…

Optimization and Control · Mathematics 2023-10-31 Jintao Xu , Shu-Cherng Fang , Wenxun Xing

We introduce a novel algorithm for approximating the logarithm of the determinant of a symmetric positive definite (SPD) matrix. The algorithm is randomized and approximates the traces of a small number of matrix powers of a specially…

Data Structures and Algorithms · Computer Science 2016-09-01 Christos Boutsidis , Petros Drineas , Prabhanjan Kambadur , Eugenia-Maria Kontopoulou , Anastasios Zouzias

We generalize the monotone local search approach of Fomin, Gaspers, Lokshtanov and Saurabh [J. ACM 2019], by establishing a connection between parameterized approximation and exponential-time approximation algorithms for monotone subset…

Data Structures and Algorithms · Computer Science 2026-01-13 Barış Can Esmer , Ariel Kulik , Dániel Marx , Daniel Neuen , Roohani Sharma

We show how to solve a number of problems in numerical linear algebra, such as least squares regression, $\ell_p$-regression for any $p \geq 1$, low rank approximation, and kernel regression, in time $T(A) \poly(\log(nd))$, where for a…

Machine Learning · Computer Science 2019-12-13 Xiaofei Shi , David P. Woodruff

"Toeplitzification" or "redundancy (spatial) averaging", the well-known routine for deriving the Toeplitz covariance matrix estimate from the standard sample covariance matrix, recently regained new attention due to the important Random…

Signal Processing · Electrical Eng. & Systems 2023-08-21 Yuri Abramovich , Tanit Pongsiri

We study the problem of estimating a low-rank positive semidefinite (PSD) matrix from a set of rank-one measurements using sensing vectors composed of i.i.d. standard Gaussian entries, which are possibly corrupted by arbitrary outliers.…

Information Theory · Computer Science 2016-12-21 Yuanxin Li , Yue Sun , Yuejie Chi

A defect correction formula for quadratic matrix equations of the kind $A_1X^2+A_0X+A_{-1}=0$ is presented. This formula, expressed by means of an invariant subspace of a suitable pencil, allows us to introduce a modification of the…

Numerical Analysis · Mathematics 2022-12-20 Dario Bini , Beatrice Meini

We study the classical scheduling problem on parallel machines %with precedence constraints where the precedence graph has the bounded depth $h$. Our goal is to minimize the maximum completion time. We focus on developing approximation…

Data Structures and Algorithms · Computer Science 2023-02-02 Bin Fu , Yumei Huo , Hairong Zhao

We provide the first nearly-linear time algorithm for approximating $\ell_{q \rightarrow p}$-norms of non-negative matrices, for $q \geq p \geq 1$. Our algorithm returns a $(1-\varepsilon)$-approximation to the matrix norm in time…

Data Structures and Algorithms · Computer Science 2025-03-26 Étienne Objois , Adrian Vladu

In this paper we propose an algorithm for the approximate k-Nearest-Neighbors problem. According to the existing researches, there are two kinds of approximation criterion. One is the distance criteria, and the other is the recall criteria.…

Computational Geometry · Computer Science 2020-08-10 Hengzhao Ma , Jianzhong Li

We present an algorithm for approximating semidefinite programs with running time that is sublinear in the number of entries in the semidefinite instance. We also present lower bounds that show our algorithm to have a nearly optimal running…

Optimization and Control · Mathematics 2012-08-28 Dan Garber , Elad Hazan

We consider covariance estimation under Toeplitz structure. Numerous sophisticated optimization methods have been developed to maximize the Gaussian log-likelihood under Toeplitz constraints. In contrast, recent advances in deep learning…

Machine Learning · Computer Science 2025-11-04 Daniel Busbib , Ami Wiesel