English
Related papers

Related papers: A PTAS for $\ell_0$-Low Rank Approximation: Solvin…

200 papers

We give the first input-sparsity time algorithms for the rank-$k$ low rank approximation problem in every Schatten norm. Specifically, for a given $n\times n$ matrix $A$, our algorithm computes $Y,Z\in \mathbb{R}^{n\times k}$, which, with…

Data Structures and Algorithms · Computer Science 2020-07-01 Yi Li , David Woodruff

Given a matrix $A$, the goal of the entrywise low-rank approximation problem is to find $\operatorname{argmin} \|A-B\|_p$ over all rank-$k$ matrices $B$, where $\| \cdot \|_p$ is the entrywise $\ell_p$ norm. When $p = 2$ this well-studied…

Data Structures and Algorithms · Computer Science 2026-04-28 Prashanti Anderson , Ainesh Bakshi , Samuel B. Hopkins

The subspace approximation problem Subspace($k$,$p$) asks for a $k$-dimensional linear subspace that fits a given set of points optimally, where the error for fitting is a generalization of the least squares fit and uses the $\ell_{p}$ norm…

Data Structures and Algorithms · Computer Science 2011-01-04 Amit Deshpande , Kasturi Varadarajan , Madhur Tulsiani , Nisheeth K. Vishnoi

This paper studies complete $k$-Constraint Satisfaction Problems (CSPs), where an $n$-variable instance has exactly one nontrivial constraint for each subset of $k$ variables, i.e., it has $\binom{n}{k}$ constraints. A recent work started a…

Data Structures and Algorithms · Computer Science 2025-04-29 Aditya Anand , Euiwoong Lee , Davide Mazzali , Amatya Sharma

The classical low rank approximation problem is to find a rank $k$ matrix $UV$ (where $U$ has $k$ columns and $V$ has $k$ rows) that minimizes the Frobenius norm of $A - UV$. Although this problem can be solved efficiently, we study an…

Data Structures and Algorithms · Computer Science 2019-11-20 Frank Ban , David Woodruff , Qiuyi Zhang

Binary quadratic programming problems have attracted much attention in the last few decades due to their potential applications. This type of problems are NP-hard in general, and still considered a challenge in the design of efficient…

Data Structures and Algorithms · Computer Science 2014-11-20 Khaled Elbassioni , Trung Thanh Nguyen

Given an input matrix polynomial whose coefficients are floating point numbers, we consider the problem of finding the nearest matrix polynomial which has rank at most a specified value. This generalizes the problem of finding a nearest…

Symbolic Computation · Computer Science 2017-12-13 Mark Giesbrecht , Joseph Haraldson , George Labahn

The problem of non-monotone $k$-submodular maximization under a knapsack constraint ($\kSMK$) over the ground set size $n$ has been raised in many applications in machine learning, such as data summarization, information propagation, etc.…

Data Structures and Algorithms · Computer Science 2023-09-22 Dung T. K. Ha , Canh V. Pham , Tan D. Tran , Huan X. Hoang

Matrix rank minimization problems are gaining a plenty of recent attention in both mathematical and engineering fields. This class of problems, arising in various and across-discipline applications, is known to be NP-hard in general. In…

Optimization and Control · Mathematics 2010-10-06 Yun-Bin Zhao

Constraint satisfaction problems (CSPs) consist of a set of variables taking values from some finite domain and a set of local constraints on these variables. The objective is to find an assignment to the variables that maximizes the…

Computational Complexity · Computer Science 2026-05-12 Amey Bhangale , Yezhou Zhang

A constraint satisfaction problem (CSP), $\textsf{Max-CSP}(\mathcal{F})$, is specified by a finite set of constraints $\mathcal{F} \subseteq \{[q]^k \to \{0,1\}\}$ for positive integers $q$ and $k$. An instance of the problem on $n$…

Computational Complexity · Computer Science 2024-02-27 Chi-Ning Chou , Alexander Golovnev , Madhu Sudan , Santhoshini Velusamy

Recently, Musco and Woodruff (FOCS, 2017) showed that given an $n \times n$ positive semidefinite (PSD) matrix $A$, it is possible to compute a $(1+\epsilon)$-approximate relative-error low-rank approximation to $A$ by querying…

Data Structures and Algorithms · Computer Science 2021-06-16 Ainesh Bakshi , Nadiia Chepurko , David P. Woodruff

Low rank matrix approximation is an important tool in machine learning. Given a data matrix, low rank approximation helps to find factors, patterns and provides concise representations for the data. Research on low rank approximation…

Computational Complexity · Computer Science 2017-04-21 Chen Dan , Kristoffer Arnsfelt Hansen , He Jiang , Liwei Wang , Yuchen Zhou

In this paper, we present a polynomial-time algorithm that approximates sufficiently high-value Max 2-CSPs on sufficiently dense graphs to within $O(N^{\varepsilon})$ approximation ratio for any constant $\varepsilon > 0$. Using this…

Data Structures and Algorithms · Computer Science 2015-07-31 Pasin Manurangsi , Dana Moshkovitz

It has long been known, since the classical work of (Arora, Karger, Karpinski, JCSS~99), that \MC\ admits a PTAS on dense graphs, and more generally, \kCSP\ admits a PTAS on "dense" instances with $\Omega(n^k)$ constraints. In this paper we…

Computational Complexity · Computer Science 2015-07-17 Dimitris Fotakis , Michael Lampis , Vangelis Th. Paschos

Let $A$ be an $m \times n$ matrix with rank $r$ and spectral decomposition $A = \sum_{i=1}^r \sigma_i u_i v_i^\top,$ where $\sigma_i$ are its singular values, ordered decreasingly, and $u_i, v_i$ are the corresponding left and right…

Numerical Analysis · Mathematics 2026-03-17 Phuc Tran , Van Vu

Given $k$ collections of 2SAT clauses on the same set of variables $V$, can we find one assignment that satisfies a large fraction of clauses from each collection? We consider such simultaneous constraint satisfaction problems, and design…

Data Structures and Algorithms · Computer Science 2014-07-30 Amey Bhangale , Swastik Kopparty , Sushant Sachdeva

A distance matrix $A \in \mathbb R^{n \times m}$ represents all pairwise distances, $A_{ij}=\mathrm{d}(x_i,y_j)$, between two point sets $x_1,...,x_n$ and $y_1,...,y_m$ in an arbitrary metric space $(\mathcal Z, \mathrm{d})$. Such matrices…

Data Structures and Algorithms · Computer Science 2019-06-05 Piotr Indyk , Ali Vakilian , Tal Wagner , David Woodruff

We study distributed low rank approximation in which the matrix to be approximated is only implicitly represented across the different servers. For example, each of $s$ servers may have an $n \times d$ matrix $A^t$, and we may be interested…

Numerical Analysis · Computer Science 2016-01-29 David P. Woodruff , Peilin Zhong

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani