English
Related papers

Related papers: Arithmetic Circuits and Neural Networks for Regula…

200 papers

We prove the first, even super-polynomial, lower bounds on the size of tropical (min,+) and (max,+) circuits approximating given optimization problems. Many classical dynamic programming (DP) algorithms for optimization problems are pure in…

Computational Complexity · Computer Science 2020-12-24 Stasys Jukna , Hannes Seiwert

The motivation for this paper is to study the complexity of constant-width arithmetic circuits. Our main results are the following. 1. For every k > 1, we provide an explicit polynomial that can be computed by a linear-sized monotone…

Computational Complexity · Computer Science 2009-08-14 V. Arvind , Pushkar S. Joglekar , Srikanth Srinivasan

Rough set theory is a useful tool to deal with uncertain, granular and incomplete knowledge in information systems. And it is based on equivalence relations or partitions. Matroid theory is a structure that generalizes linear independence…

Artificial Intelligence · Computer Science 2012-10-24 Yanfang Liu , William Zhu

We show that for any regular matroid on $m$ elements and any $\alpha \geq 1$, the number of $\alpha$-minimum circuits, or circuits whose size is at most an $\alpha$-multiple of the minimum size of a circuit in the matroid is bounded by…

Data Structures and Algorithms · Computer Science 2018-11-21 Rohit Gurjar , Nisheeth K. Vishnoi

Sublinear circuits are generalizations of the affine circuits in matroid theory, and they arise as the convex-combinatorial core underlying constrained non-negativity certificates of exponential sums and of polynomials based on the…

Combinatorics · Mathematics 2021-08-31 Helen Naumann , Thorsten Theobald

Sparse polynomial systems with vertical coefficient dependencies arise naturally when describing the critical points of optimization problems and, when augmented with linear forms, the steady states of chemical reaction networks. Moreover,…

Algebraic Geometry · Mathematics 2026-05-11 Elisenda Feliu , Paul Alexander Helminck , Oskar Henriksson , Yue Ren , Benjamin Schröter , Máté L. Telek

In this article we present new results on neural networks with linear threshold activation functions. We precisely characterize the class of functions that are representable by such neural networks and show that 2 hidden layers are…

Machine Learning · Computer Science 2023-10-20 Sammy Khalife , Hongyu Cheng , Amitabh Basu

This paper studies the properties of two kinds of matroids: (a) algebraic matroids and (b) finite and infinite matroids whose ground set have some canonical symmetry, for example row and column symmetry and transposition symmetry. For (a)…

Combinatorics · Mathematics 2013-12-16 Franz J. Király , Zvi Rosen , Louis Theran

We study the problem of constructing explicit families of matrices which cannot be expressed as a product of a few sparse matrices. In addition to being a natural mathematical question on its own, this problem appears in various…

Computational Complexity · Computer Science 2019-04-03 Mrinal Kumar , Ben Lee Volk

We propose new algorithms for computing triangular decompositions of polynomial systems incrementally. With respect to previous works, our improvements are based on a {\em weakened} notion of a polynomial GCD modulo a regular chain, which…

Symbolic Computation · Computer Science 2011-04-06 Changbo Chen , Marc Moreno Maza

We develop exact representations of training two-layer neural networks with rectified linear units (ReLUs) in terms of a single convex program with number of variables polynomial in the number of training samples and the number of hidden…

Machine Learning · Computer Science 2020-08-18 Mert Pilanci , Tolga Ergen

We revisit the main result of Carmosino et al \cite{CILM18} which shows that an $\Omega(n^{\omega/2+\epsilon})$ size noncommutative arithmetic circuit size lower bound (where $\omega$ is the matrix multiplication exponent) for a…

Computational Complexity · Computer Science 2023-08-10 V. Arvind , Abhranil Chatterjee

We present a simple proof of the fact that the base (and independence) polytope of a rank $n$ regular matroid over $m$ elements has an extension complexity $O(mn)$.

Discrete Mathematics · Computer Science 2017-02-08 Rohit Gurjar , Nisheeth K. Vishnoi

Motivated by work in graph theory, we define the fixing number for a matroid. We give upper and lower bounds for fixing numbers for a general matroid in terms of the size and maximum orbit size (under the action of the matroid automorphism…

Combinatorics · Mathematics 2014-05-27 Gary Gordon , Jennifer McNulty , Nancy Ann Neudauer

The classical matrix tree theorem relates the number of spanning trees of a connected graph with the product of the nonzero eigenvalues of its Laplacian matrix. The class of regular matroids generalizes that of graphical matroids, and a…

Combinatorics · Mathematics 2014-05-12 Aaron Dall , Julian Pfeifle

We show new algorithms and constructions over linear delta-matroids. We observe an alternative representation for linear delta-matroids, as a contraction representation over a skew-symmetric matrix. This is equivalent to the more standard…

Data Structures and Algorithms · Computer Science 2024-02-20 Tomohiro Koana , Magnus Wahlström

Recurrent Neural Networks (RNNs) are very successful at solving challenging problems with sequential data. However, this observed efficiency is not yet entirely explained by theory. It is known that a certain class of multiplicative RNNs…

Machine Learning · Computer Science 2019-01-31 Valentin Khrulkov , Oleksii Hrinchuk , Ivan Oseledets

We show that tropicalization of linear series on curves gives rise to two-parameter families of tilings by polymatroids, with one parameter arising from the theory of divisors on tropical curves and the other from the reduction of linear…

Algebraic Geometry · Mathematics 2024-05-08 Omid Amini , Eduardo Esteves

We show how to construct highly symmetric algorithms for matrix multiplication. In particular, we consider algorithms which decompose the matrix multiplication tensor into a sum of rank-1 tensors, where the decomposition itself consists of…

Computational Complexity · Computer Science 2016-12-13 Joshua A. Grochow , Cristopher Moore

We study representations of tropical linear spaces as intersections of tropical hyperplanes of circuits. For several classes of matroids, we describe minimal tropical bases. We also show that every realizable tropical linear space has a…

Combinatorics · Mathematics 2007-05-23 Josephine Yu , Debbie S. Yuster