Related papers: Double framed moduli spaces of quiver representati…
We show how quiver representations and their invariant theory natu- rally arise in the study of some moduli spaces parametrizing bundles dened on an algebraic curve, and how they lead to ne results regarding the geometry of these spaces.
We prove that training neural networks on 1-D data is equivalent to solving convex Lasso problems with discrete, explicitly defined dictionary matrices. We consider neural networks with piecewise linear activations and depths ranging from 2…
We consider the 3-category $2\mathfrak{C}at$ whose objects are 2-categories, 1-morphisms are lax functors, 2-morphisms are lax transformations and 3-morphisms are modifications. The aim is to show that it carries interesting…
Representations learnt through deep neural networks tend to be highly informative, but opaque in terms of what information they learn to encode. We introduce an approach to probabilistic modelling that learns to represent data with two…
We introduce switched linear projections for expressing the activity of a neuron in a deep neural network in terms of a single linear projection in the input space. The method works by isolating the active subnetwork, a series of linear…
We describe weighted projective lines in the sense of Geigle and Lenzing by a moduli problem on the canonical algebra of Ringel. We then go on to study generators of the derived categories of coherent sheaves on the total spaces of their…
We study the expressivity of deep neural networks. Measuring a network's complexity by its number of connections or by its number of neurons, we consider the class of functions for which the error of best approximation with networks of a…
We introduce a certain type of representations for the quantum Teichmuller space of a punctured surface, which we call local representations. We show that, up to finitely many choices, these purely algebraic representations are classified…
This study explores the number of neurons required for a Rectified Linear Unit (ReLU) neural network to approximate multivariate monomials. We establish an exponential lower bound on the complexity of any shallow network approximating the…
How does the mind organize thoughts? The hippocampal-entorhinal complex is thought to support domain-general representation and processing of structural knowledge of arbitrary state, feature and concept spaces. In particular, it enables the…
An introduction to $N=2$ rigid and local supersymmetry is given. The construction of the actions of vector multiplets is reviewed, defining special K\"ahler manifolds. Symplectic transformations lead to either isometries or symplectic…
Linear layers in neural networks (NNs) trained by gradient descent can be expressed as a key-value memory system which stores all training datapoints and the initial weights, and produces outputs using unnormalised dot attention over the…
We study a family of three-dimensional Lie algebras $L_\mu$ that depend on a continuous parameter $\mu$. We introduce certain quivers, which we denote by $Q_{m,n}$ $(m,n \in \mathbb{Z})$ and $Q_{\infty \times \infty}$, and prove that…
Semi-supervised learning algorithms typically construct a weighted graph of data points to represent a manifold. However, an explicit graph representation is problematic for neural networks operating in the online setting. Here, we propose…
In this paper, we develop 2-dimensional algebraic theory which closely follows the classical theory of modules. The main results are giving definitions of 2-module and the representation of 2-ring. Moreover, for a 2-ring $\cR$, we prove…
We study multiview moduli problems that arise in computer vision. We show that these moduli spaces are always smooth and irreducible, in both the calibrated and uncalibrated cases, for any number of views. We also show that these moduli…
We study moduli spaces of twisted quasimaps to a hypertoric variety $X$, arising as the Higgs branch of an abelian supersymmetric gauge theory in three dimensions. These parametrise general quiver representations whose building blocks are…
In this effort, we derive a formula for the integral representation of a shallow neural network with the Rectified Power Unit activation function. Mainly, our first result deals with the univariate case of representation capability of RePU…
We explore the use of a topological manifold, represented as a collection of charts, as the target space of neural network based representation learning tasks. This is achieved by a simple adjustment to the output of an encoder's network…
This paper is to introduce an asynchronous and local learning framework for neural networks, named Modular Learning Framework (MOLE). This framework modularizes neural networks by layers, defines the training objective via mutual…