Related papers: The Classification of Rational Subtangle Replaceme…
Transformer networks have seen great success in natural language processing and machine vision, where task objectives such as next word prediction and image classification benefit from nuanced context sensitivity across high-dimensional…
The emergence of a variety of graph-based meaning representations (MRs) has sparked an important conversation about how to adequately represent semantic structure. These MRs exhibit structural differences that reflect different theoretical…
There is a natural way to associate with a transformation of an isotopy class of rational tangles to another, an element of the modular group. The correspondence between the isotopy classes of rational tangles and rational numbers follows,…
We introduce the concept of Random Sequential Renormalization (RSR) for arbitrary networks. RSR is a graph renormalization procedure that locally aggregates nodes to produce a coarse grained network. It is analogous to the (quasi-)parallel…
Let $C$ be the rational normal curve of degree $e$ in $\mathbb{P}^n$, and let $X\subset \mathbb{P}^n$ be a degree $d\ge 2$ hypersurface containing $C$. In previous work, I. Coskun and E. Riedl showed that the normal bundle $N_{C/X}$ is…
Our understanding of the generalization capabilities of neural networks (NNs) is still incomplete. Prevailing explanations are based on implicit biases of gradient descent (GD) but they cannot account for the capabilities of models from…
This work presents a statistical mechanics characterization of neural networks, motivated by the replica symmetry breaking (RSB) phenomenon in spin glasses. A Hopfield-type spin glass model is constructed from a given feedforward neural…
Field theories in the presence of branes encounter localized divergences that renormalize brane couplings. The sources of these brane-localized divergences are understood as arising either from broken translation invariance, or from short…
Let $X \subset \mathbb{P}^n$ be a general Fano complete intersection of type $(d_1,\dots, d_k)$. If at least one $d_i$ is greater than $2$, we show that $X$ contains rational curves of degree $e \leq n$ with balanced normal bundle. If all…
Recent theoretical work has established connections between over-parametrized neural networks and linearized models governed by he Neural Tangent Kernels (NTKs). NTK theory leads to concrete convergence and generalization results, yet the…
We study the stable pairs theory of local curves in 3-folds with descendent insertions. The rationality of the partition function of descendent invariants is established for the full local curve geometry (equivariant with respect to the…
In this paper, we prove the rationality of the gluing relation of edge replacement systems, which were introduced for studying rearrangement groups of fractals. More precisely, we describe an algorithmic procedure for building a finite…
We present recurrent transformer networks (RTNs) for obtaining dense correspondences between semantically similar images. Our networks accomplish this through an iterative process of estimating spatial transformations between the input…
In recent work, we introduced topological notions of simple normal crossings symplectic divisor and variety, showed that they are equivalent, in a suitable sense, to the corresponding geometric notions, and established a topological…
The classical matrix-tree theorem relates the determinant of the combinatorial Laplacian on a graph to the number of spanning trees. We generalize this result to Laplacians on one- and two-dimensional vector bundles, giving a combinatorial…
We discuss methods for visualizing neural network decision boundaries and decision regions. We use these visualizations to investigate issues related to reproducibility and generalization in neural network training. We observe that changes…
We consider how the problem of determining normal forms for a specific class of nonholonomic systems leads to various interesting and concrete bridges between two apparently unrelated themes. Various ideas that traditionally pertain to the…
We classify Legendrian rational unknots with tight complements in the lens spaces L(p,1) up to coarse equivalence. As an example of the general case, this classification is also worked out for L(5,2). The knots are described explicitly in a…
Let $X$ be a projective variety and let $C$ be a rational normal curve on $X$. We compute the normal bundle of $C$ in a general complete intersection of hypersurfaces of sufficiently large degree in $X$. As a result, we establish the…
Pseudo links have two crossing types: classical crossings and indeterminate crossings. They were first introduced by Ryo Hanaki as a possible tool for analyzing images produced by electron microscopy of DNA. A normalized bracket polynomial…