English
Related papers

Related papers: Weights at the Bottom Matter When the Top is Heavy

200 papers

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic

The Strong Exponential Time Hypothesis (SETH) asserts that for every $\varepsilon>0$ there exists $k$ such that $k$-SAT requires time $(2-\varepsilon)^n$. The field of fine-grained complexity has leveraged SETH to prove quite tight…

Computational Complexity · Computer Science 2022-11-30 Tatiana Belova , Alexander Golovnev , Alexander S. Kulikov , Ivan Mihajlin , Denil Sharipov

We show that sharp thresholds for Boolean functions directly imply average-case circuit lower bounds. More formally we show that any Boolean function exhibiting a sharp enough threshold at \emph{arbitrary} critical density cannot be…

Computational Complexity · Computer Science 2024-07-17 David Gamarnik , Elchanan Mossel , Ilias Zadik

We continue the study of the circuit class GC^0, which augments AC^0 with unbounded-fan-in gates that compute arbitrary functions inside a sufficiently small Hamming ball but must be constant outside it. While GC^0 can compute functions…

Quantum Physics · Physics 2025-12-03 Sabee Grewal , Vinayak M. Kumar

The Minimum Circuit Size Problem for Partial Functions ($MCSP^*$) is hard assuming the Exponential Time Hypothesis (ETH) (Ilango, 2020). This breakthrough hardness result leveraged a characterization of the optimal $\{\land, \lor, \neg\}$…

Computational Complexity · Computer Science 2025-11-24 Marco Carmosino , Ngu Dang , Tim Jackman

Exhibiting an explicit Boolean function with a large high-order nonlinearity is an important problem in cryptography, coding theory, and computational complexity. We prove lower bounds on the second-order, third-order, and higher-order…

Cryptography and Security · Computer Science 2023-09-21 Jinjie Gao , Haibin Kan , Yuan Li , Jiahua Xu , Qichun Wang

We prove new barrier results in arithmetic complexity theory, showing severe limitations of natural lifting (aka escalation) techniques. For example, we prove that even optimal rank lower bounds on $k$-tensors cannot yield non-trivial lower…

Computational Complexity · Computer Science 2019-04-10 Ankit Garg , Visu Makam , Rafael Oliveira , Avi Wigderson

We show that computing the minimum rank of a sign pattern matrix is NP hard. Our proof is based on a simple but useful connection between minimum ranks of sign pattern matrices and the stretchability problem for pseudolines arrangements. In…

Computational Complexity · Computer Science 2015-05-18 Amey Bhangale , Swastik Kopparty

The communication class $\mathbf{UPP}^{\text{cc}}$ is a communication analog of the Turing Machine complexity class $\mathbf{PP}$. It is characterized by a matrix-analytic complexity measure called sign-rank (also called dimension…

Computational Complexity · Computer Science 2019-03-05 Mark Bun , Nikhil S. Mande , Justin Thaler

Motivated by the resurgence of neural networks in being able to solve complex learning tasks we undertake a study of high depth networks using ReLU gates which implement the function $x \mapsto \max\{0,x\}$. We try to understand the role of…

Computational Complexity · Computer Science 2017-11-10 Anirbit Mukherjee , Amitabh Basu

We show a new duality between the polynomial margin complexity of $f$ and the discrepancy of the function $f \circ \textsf{XOR}$, called an $\textsf{XOR}$ function. Using this duality, we develop polynomial based techniques for…

Computational Complexity · Computer Science 2017-04-11 Arkadev Chattopadhyay , Nikhil S. Mande

In studying the expressiveness of neural networks, an important question is whether there are functions which can only be approximated by sufficiently deep networks, assuming their size is bounded. However, for constant depths, existing…

Machine Learning · Computer Science 2020-12-29 Gal Vardi , Ohad Shamir

The Schur square of linear codes over a finite field has emerged as a fundamental operation in both classical and quantum coding theory. In this paper, we investigate the Schur square problem of Hyperderivative Reed-Solomon (HRS) codes. By…

Information Theory · Computer Science 2026-04-21 Haojie Gu , Zhihao Zhu , Jun Zhang

We prove super-polynomial lower bounds for low-depth arithmetic circuits using the shifted partials measure [Gupta-Kamath-Kayal-Saptharishi, CCC 2013], [Kayal, ECCC 2012] and the affine projections of partials measure [Garg-Kayal-Saha, FOCS…

Computational Complexity · Computer Science 2022-11-16 Prashanth Amireddy , Ankit Garg , Neeraj Kayal , Chandan Saha , Bhargav Thankey

We say that a circuit $C$ over a field $F$ functionally computes an $n$-variate polynomial $P$ if for every $x \in \{0,1\}^n$ we have that $C(x) = P(x)$. This is in contrast to syntactically computing $P$, when $C \equiv P$ as formal…

Computational Complexity · Computer Science 2016-05-16 Michael A. Forbes , Mrinal Kumar , Ramprasad Saptharishi

The Tensor Isomorphism problem (TI) has recently emerged as having connections to multiple areas of research within complexity and beyond, but the current best upper bound is essentially the brute force algorithm. Being an algebraic…

Computational Complexity · Computer Science 2023-06-01 Nicola Galesi , Joshua A. Grochow , Toniann Pitassi , Adrian She

The best known size lower bounds against unrestricted circuits have remained around $3n$ for several decades. Moreover, the only known technique for proving lower bounds in this model, gate elimination, is inherently limited to proving…

Computational Complexity · Computer Science 2020-12-09 Alexander Golovnev , Alexander S. Kulikov , R. Ryan Williams

In recent years, a very exciting and promising method for proving lower bounds for arithmetic circuits has been proposed. This method combines the method of {\it depth reduction} developed in the works of Agrawal-Vinay [AV08], Koiran…

Computational Complexity · Computer Science 2013-11-27 Mrinal Kumar , Shubhangi Saraf

We introduce a new algebraic proof system, which has tight connections to (algebraic) circuit complexity. In particular, we show that any super-polynomial lower bound on any Boolean tautology in our proof system implies that the permanent…

Computational Complexity · Computer Science 2014-04-16 Joshua A. Grochow , Toniann Pitassi

Treewidth (tw) is an important parameter that, when bounded, yields tractability for many problems. For example, graph problems expressible in Monadic Second Order (MSO) logic and QUANTIFIED SAT or, more generally, QUANTIFIED CSP, are FPT…

Computational Complexity · Computer Science 2025-03-18 Florent Foucaud , Esther Galby , Liana Khazaliya , Shaohua Li , Fionn Mc Inerney , Roohani Sharma , Prafullkumar Tale