English
Related papers

Related papers: Smaller Depth-2 Linear Circuits for Disjointness M…

200 papers

Depth separation results propose a possible theoretical explanation for the benefits of deep neural networks over shallower architectures, establishing that the former possess superior approximation capabilities. However, there are no known…

Machine Learning · Computer Science 2023-02-03 Itay Safran , Jason D. Lee

We analyze recurrent neural networks with diagonal hidden-to-hidden weight matrices, trained with gradient descent in the supervised learning setting, and prove that gradient descent can achieve optimality \emph{without} massive…

Machine Learning · Computer Science 2024-10-11 Semih Cayci , Atilla Eryilmaz

Fermionic ansatz state preparation is a critical subroutine in many quantum algorithms such as Variational Quantum Eigensolver for quantum chemistry and condensed matter applications. The shallowest circuit depth needed to prepare Slater…

Quantum Physics · Physics 2023-08-22 Chong Hian Chee , Daniel Leykam , Adrian M. Mak , Dimitris G. Angelakis

A new density matrix renormalisation group (DMRG) approach is presented for quantum systems of two spatial dimensions. In particular, it is shown that it is possible to create a multi-chain-type 2D DMRG approach which utilises previously…

Strongly Correlated Electrons · Physics 2009-11-10 Damian J. J. Farnell

A model of computation that is widely used in the formal analysis of reactive systems is symbolic algorithms. In this model the access to the input graph is restricted to consist of symbolic operations, which are expensive in comparison to…

Data Structures and Algorithms · Computer Science 2017-11-28 Krishnendu Chatterjee , Wolfgang Dvořák , Monika Henzinger , Veronika Loitzenbauer

In this paper we consider circuit synthesis for n-wire linear reversible circuits using the C-NOT gate library. These circuits are an important class of reversible circuits with applications to quantum computation. Previous algorithms,…

Quantum Physics · Physics 2015-04-21 K. N. Patel , I. L. Markov , J. P. Hayes

Verifying the robustness property of a general Rectified Linear Unit (ReLU) network is an NP-complete problem [Katz, Barrett, Dill, Julian and Kochenderfer CAV17]. Although finding the exact minimum adversarial distortion is hard, giving a…

We explore maximal unitarity for nonplanar two-loop integrals with up to four massive external legs. In this framework, the amplitude is reduced to a basis of master integrals whose coefficients are extracted from maximal cuts. The…

High Energy Physics - Theory · Physics 2016-12-30 Mads Sogaard , Yang Zhang

In recent years, finding new satisfiability algorithms for various circuit classes has been a very active line of research. Despite considerable progress, we are still far away from a definite answer on which circuit classes allow fast…

Computational Complexity · Computer Science 2013-06-19 Stefan Schneider

A tight alignment between the degree vector and the leading eigenvector arises naturally in networks with neutral degree mixing and the absence of local structures. Many real-world networks, however, violate both conditions. We derive…

Social and Information Networks · Computer Science 2026-03-18 Sreerag Puravankara , Vipin P. Veetil

A large fraction of the arithmetic operations required to evaluate deep neural networks (DNNs) consists of matrix multiplications, in both convolution and fully connected layers. We perform end-to-end learning of low-cost approximations of…

Machine Learning · Computer Science 2018-06-11 Michael Tschannen , Aran Khanna , Anima Anandkumar

We develop a new technique for constructing sparse graphs that allow us to prove near-linear lower bounds on the round complexity of computing distances in the CONGEST model. Specifically, we show an $\widetilde{\Omega}(n)$ lower bound for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-18 Amir Abboud , Keren Censor-Hillel , Seri Khoury

We revisit the main result of Carmosino et al \cite{CILM18} which shows that an $\Omega(n^{\omega/2+\epsilon})$ size noncommutative arithmetic circuit size lower bound (where $\omega$ is the matrix multiplication exponent) for a…

Computational Complexity · Computer Science 2023-08-10 V. Arvind , Abhranil Chatterjee

In this paper, we show that for every constant $0 < \epsilon < 1/2$ and for every constant $d \geq 2$, the minimum size of a depth $d$ Boolean circuit that $\epsilon$-approximates Majority function on $n$ variables is…

Computational Complexity · Computer Science 2009-02-03 Kazuyuki Amano

Motivated by the resurgence of neural networks in being able to solve complex learning tasks we undertake a study of high depth networks using ReLU gates which implement the function $x \mapsto \max\{0,x\}$. We try to understand the role of…

Computational Complexity · Computer Science 2017-11-10 Anirbit Mukherjee , Amitabh Basu

We study the following computational problem: for which values of $k$, the majority of $n$ bits $\text{MAJ}_n$ can be computed with a depth two formula whose each gate computes a majority function of at most $k$ bits? The corresponding…

Computational Complexity · Computer Science 2016-10-11 Alexander S. Kulikov , Vladimir V. Podolskii

Recently, Dvir, Golovnev, and Weinstein have shown that sufficiently strong lower bounds for linear data structures would imply new bounds for rigid matrices. However, their result utilizes an algorithm that requires an $NP$ oracle, and…

Computational Complexity · Computer Science 2019-10-29 Sivaramakrishnan Natarajan Ramamoorthy , Cyrus Rashtchian

We study pseudorandomness properties of permutations on $\{0,1\}^n$ computed by random circuits made from reversible $3$-bit gates (permutations on $\{0,1\}^3$). Our main result is that a random circuit of depth $n \cdot \tilde{O}(k^2)$,…

Computational Complexity · Computer Science 2025-02-13 William He , Ryan O'Donnell

Let $G$ be a connected $d$-regular graph of order $n$, where $d\geq3$. Let $\lambda_{2}(G)$ be the second largest eigenvalue of $G$. For even $n$, we show that $G$ contains $\left\lfloor\frac{2}{3}(d-\lambda_{2}(G))\right\rfloor$…

Combinatorics · Mathematics 2024-10-08 Wenqian Zhang

The complexity of bilinear maps (equivalently, of $3$-mode tensors) has been studied extensively, most notably in the context of matrix multiplication. While circuit complexity and tensor rank coincide asymptotically for $3$-mode tensors,…

Computational Complexity · Computer Science 2026-02-13 Cornelius Brand , Radu Curticapean , Petteri Kaski , Baitian Li , Ian Orzel , Tim Seppelt , Jiaheng Wang