English
Related papers

Related papers: Lower Bounds for Approximate Sign Rank

200 papers

The $\gamma_2$ norm of a real $m\times n$ matrix $A$ is the minimum number $t$ such that the column vectors of $A$ are contained in a $0$-centered ellipsoid $E\subseteq\mathbb{R}^m$ which in turn is contained in the hypercube $[-t, t]^m$.…

Combinatorics · Mathematics 2015-04-13 Jiri Matousek , Aleksandar Nikolov , Kunal Talwar

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Under the action of the general linear group with tensor structure, the ranks of matrices $A$ and $B$ forming an $m \times n$ pencil $A + \lambda B$ can change, but in a restricted manner. Specifically, with every pencil one can associate a…

Numerical Analysis · Mathematics 2018-06-20 José Henrique de Morais Goulart , Pierre Comon

This article explores additive codes with one-rank hull, offering key insights and constructions. The article introduces a novel approach to finding one-rank hull codes over finite fields by establishing a connection between self-orthogonal…

Information Theory · Computer Science 2024-01-03 Astha Agrawal , R. K. Sharma

We prove a characterization of the structural conditions on matrices of sign-rank 3 and unit disk graphs (UDGs) which permit constant-cost public-coin randomized communication protocols. Therefore, under these conditions, these graphs also…

Computational Complexity · Computer Science 2023-07-11 Nathaniel Harms , Viktor Zamaraev

The Planar Graph Metric Compression Problem is to compactly encode the distances among $k$ nodes in a planar graph of size $n$. Two na\"ive solutions are to store the graph using $O(n)$ bits, or to explicitly store the distance matrix with…

Data Structures and Algorithms · Computer Science 2017-03-16 Amir Abboud , Pawel Gawrychowski , Shay Mozes , Oren Weimann

We consider a range of simply stated dynamic data structure problems on strings. An update changes one symbol in the input and a query asks us to compute some function of the pattern of length $m$ and a substring of a longer text. We give…

Data Structures and Algorithms · Computer Science 2018-02-20 Raphael Clifford , Allan Grønlund , Kasper Green Larsen , Tatiana Starikovskaya

We consider structured approximation of measures in Wasserstein space $\mathrm{W}_p(\mathbb{R}^d)$ for $p\in[1,\infty)$ using general measure approximants compactly supported on Voronoi regions derived from a scaled Voronoi partition of…

Machine Learning · Statistics 2024-07-26 Keaton Hamm , Varun Khurana

A set N is called a "weak epsilon-net" (with respect to convex sets) for a finite set X in R^d if N intersects every convex set that contains at least epsilon*|X| points of X. For every fixed d>=2 and every r>=1 we construct sets X in R^d…

Combinatorics · Mathematics 2013-03-25 Boris Bukh , Jiří Matoušek , Gabriel Nivasch

$\newcommand{\MatA}{\mathcal{M}}$ $\newcommand{\eps}{\varepsilon}$ $\newcommand{\NSize}{\mathsf{N}{}}$ $\newcommand{\MatB}{\mathcal{B}}$ $\newcommand{\Fnorm}[1]{\left\| {#1} \right\|_F}$ $\newcommand{\PrcOpt}[2]{\mu_{\mathrm{opt}}\pth{#1,…

Computational Geometry · Computer Science 2014-11-03 Sariel Har-Peled

For a field $\mathbb{F}$ and integers $d, k$ and $\ell$, a set $A \subseteq \mathbb{F}^d$ is called $(k,\ell)$-nearly orthogonal if all vectors in $A$ are non-self-orthogonal and every $k+1$ vectors in $A$ contain $\ell + 1$ pairwise…

Combinatorics · Mathematics 2025-05-30 Rajko Nenadov , Lander Verlinde

Given a matrix $M\in \mathbb{R}^{m\times n}$, the low rank matrix completion problem asks us to find a rank-$k$ approximation of $M$ as $UV^\top$ for $U\in \mathbb{R}^{m\times k}$ and $V\in \mathbb{R}^{n\times k}$ by only observing a few…

Machine Learning · Computer Science 2024-04-03 Yuzhou Gu , Zhao Song , Junze Yin , Lichen Zhang

We study the minimum spanning tree (MST) problem in the massively parallel computation (MPC) model. Our focus is particularly on the *strictly sublinear* regime of MPC where the space per machine is $O(n^\delta)$. Here $n$ is the number of…

Data Structures and Algorithms · Computer Science 2025-10-10 Amir Azarmehr , Soheil Behnezhad , Rajesh Jayaram , Jakub Łącki , Vahab Mirrokni , Peilin Zhong

We show that any $n\times m$ matrix $A$ can be approximated in operator norm by a submatrix with a number of columns of order the stable rank of $A$. This improves on existing results by removing an extra logarithmic factor in the size of…

Functional Analysis · Mathematics 2018-07-19 Omer Friedland , Pierre Youssef

We prove new barrier results in arithmetic complexity theory, showing severe limitations of natural lifting (aka escalation) techniques. For example, we prove that even optimal rank lower bounds on $k$-tensors cannot yield non-trivial lower…

Computational Complexity · Computer Science 2019-04-10 Ankit Garg , Visu Makam , Rafael Oliveira , Avi Wigderson

With the growth of model and data sizes, a broad effort has been made to design pruning techniques that reduce the resource demand of deep learning pipelines, while retaining model performance. In order to reduce both inference and training…

Machine Learning · Computer Science 2026-02-24 Dayana Savostianova , Emanuele Zangrando , Gianluca Ceruti , Francesco Tudisco

In this work we solve, for given bounded operators $B,C$ and Hilbert-Schmidt operator $M$ acting on potentially infinite-dimensional separable Hilbert spaces, the reduced rank approximation problem, $\min\{\lVert M-BXC\rVert_{L_2}:\…

Functional Analysis · Mathematics 2026-05-27 Giuseppe Carere , Han Cheng Lie

In this work, we focus on the high-dimensional trace regression model with a low-rank coefficient matrix. We establish a nearly optimal in-sample prediction risk bound for the rank-constrained least-squares estimator under no assumptions on…

Statistics Theory · Mathematics 2022-04-19 Michael Law , Ya'acov Ritov , Ruixiang Zhang , Ziwei Zhu

The \emph{signed series} problem in the $\ell_2$ norm asks, given set of vectors $v_1,\ldots,v_n\in \mathbf{R}^d$ having at most unit $\ell_2$ norm, does there always exist a series $(\varepsilon_i)_{i\in [n]}$ of $\pm 1$ signs such that…

Discrete Mathematics · Computer Science 2026-01-07 Kunal Dutta

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila