English
Related papers

Related papers: Kronecker Products, Low-Depth Circuits, and Matrix…

200 papers

Very recently, Bai [Linear Algebra Appl., 681:150-186, 2024 \& Appl. Math. Lett., 166:109510, 2025] studied some concrete structures, and obtained essential algebraic and computational properties of the one-dimensional, two-dimensional and…

Rings and Algebras · Mathematics 2025-06-19 Aaisha Be , Nachiketa Mishra , Debasisha Mishra

Let $\Lambda$ be the limit set of a conformal dynamical system, i.e. a Kleinian group acting on either finite- or infinite-dimensional real Hilbert space, a conformal iterated function system, or a rational function. We give an easily…

Dynamical Systems · Mathematics 2018-11-22 Tushar Das , David Simmons , Mariusz Urbański

In the present note, we study a new method of constructing efficient coverings for Kronecker powers of matrices, recently proposed by J. Alman, Y. Guan, A. Padaki [arXiv, 2022]. We provide an alternative proof for the case of symmetric…

Data Structures and Algorithms · Computer Science 2022-12-06 Igor S. Sergeev

Estimating the linear dimensionality of a data set in the presence of noise is a common problem. However, data may also be corrupted by monotone nonlinear distortion that preserves the ordering of matrix entries but causes linear methods…

Combinatorics · Mathematics 2024-01-01 Caitlin Lienkaemper

This article introduces HODLR2D, a new hierarchical low-rank representation for a class of dense matrices arising out of $N$ body problems in two dimensions. Using this new hierarchical framework, we propose a new fast matrix-vector product…

Numerical Analysis · Mathematics 2022-04-13 V A Kandappan , Vaishnavi Gujjula , Sivaram Ambikasaran

We show that for any regular matroid on $m$ elements and any $\alpha \geq 1$, the number of $\alpha$-minimum circuits, or circuits whose size is at most an $\alpha$-multiple of the minimum size of a circuit in the matroid is bounded by…

Data Structures and Algorithms · Computer Science 2018-11-21 Rohit Gurjar , Nisheeth K. Vishnoi

The problem of completing a low-rank matrix from a subset of its entries is often encountered in the analysis of incomplete data sets exhibiting an underlying factor model with applications in collaborative filtering, computer vision and…

Machine Learning · Computer Science 2009-02-24 Amit Singer , Mihai Cucuringu

We establish a connection between problems studied in rigidity theory and matroids arising from linear algebraic constructions like tensor products and symmetric products. A special case of this correspondence identifies the problem of…

Combinatorics · Mathematics 2026-03-04 Joshua Brakensiek , Manik Dhar , Jiyang Gao , Sivakanth Gopi , Matt Larson

We establish new exponential in dimension lower bounds for the Maximum Halfspace Discrepancy problem, which models linear classification. Both are fundamental problems in computational geometry and machine learning in their exact and…

Computational Geometry · Computer Science 2026-03-20 Alexander Munteanu , Simon Omlor , Jeff M. Phillips

In order to formally understand the power of neural computing, we first need to crack the frontier of threshold circuits with two and three layers, a regime that has been surprisingly intractable to analyze. We prove the first super-linear…

Computational Complexity · Computer Science 2018-02-01 Daniel M. Kane , Ryan Williams

The complexity of bilinear maps (equivalently, of $3$-mode tensors) has been studied extensively, most notably in the context of matrix multiplication. While circuit complexity and tensor rank coincide asymptotically for $3$-mode tensors,…

Computational Complexity · Computer Science 2026-02-13 Cornelius Brand , Radu Curticapean , Petteri Kaski , Baitian Li , Ian Orzel , Tim Seppelt , Jiaheng Wang

By a result of Schur [J. Reine Angew. Math. 1911], the entrywise product $M \circ N$ of two positive semidefinite matrices $M,N$ is again positive. Vybiral [Adv. Math. 2020] improved on this by showing the uniform lower bound $M \circ…

Classical Analysis and ODEs · Mathematics 2021-10-19 Apoorva Khare

Existing Rademacher complexity bounds for neural networks rely only on norm control of the weight matrices and depend exponentially on depth via a product of the matrix norms. Lower bounds show that this exponential dependence on depth is…

Machine Learning · Computer Science 2020-04-13 Colin Wei , Tengyu Ma

Proving super-polynomial lower bounds against depth-2 threshold circuits of the form THR of THR is a well-known open problem that represents a frontier of our understanding in boolean circuit complexity. By contrast, exponential lower…

Computational Complexity · Computer Science 2017-05-09 Arkadev Chattopadhyay , Nikhil S. Mande

Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network…

Machine Learning · Statistics 2021-03-15 Hisham Husain , Borja Balle

We prove the Johnson-Lindenstrauss property for matrices $\Phi D_\xi$ where $\Phi$ has the restricted isometry property and $D_\xi$ is a diagonal matrix containing the entries of a Kronecker product $\xi = \xi^{(1)} \otimes \dots \otimes…

Data Structures and Algorithms · Computer Science 2021-06-28 Stefan Bamberger , Felix Krahmer , Rachel Ward

We prove a \emph{query complexity} lower bound for approximating the top $r$ dimensional eigenspace of a matrix. We consider an oracle model where, given a symmetric matrix $\mathbf{M} \in \mathbb{R}^{d \times d}$, an algorithm…

Machine Learning · Computer Science 2020-06-30 Max Simchowitz , Ahmed El Alaoui , Benjamin Recht

A 1965 result of Crapo shows that every elementary lift of a matroid $M$ can be constructed from a linear class of circuits of $M$. In a recent paper, Walsh generalized this construction by defining a rank-$k$ lift of a matroid $M$ given a…

Combinatorics · Mathematics 2025-02-19 Daniel Irving Bernstein , Zach Walsh

In this paper we study the rank of planar rigidity matrix of 4-valent graphs, both in case of generic realizations and configurations in general position, under various connectivity assumptions on the graphs. For each case considered, we…

Combinatorics · Mathematics 2012-07-16 Shisen Luo

The classical branch-and-bound algorithm for the integer feasibility problem has exponential worst case complexity. We prove that it is surprisingly efficient on reformulated problems, in which the columns of the constraint matrix are…

Optimization and Control · Mathematics 2009-08-06 Gabor Pataki , Mustafa Tural