Related papers: Geometric and Spectral Alignment for Deep Neural N…
The success of randomized range finders (RRFs) is typically analyzed via the singular value gaps of a target matrix $A$. In this work, we show that the so-called Frobenius singular value ratio provides a sharper analysis of an RRF's…
Random spatial networks-that is, graphs whose connectivity is governed by geometric proximity-have emerged as fundamental models for systems constrained by an underlying spatial structure. A prototypical example is the random geometric…
A linear structural equation model relates random variables of interest and corresponding Gaussian noise terms via a linear equation system. Each such model can be represented by a mixed graph in which directed edges encode the linear…
Unconditional guaranteed lower and upper eigenvalue bounds are mandatory for the understanding of the Schr\"odinger eigenvalue spectrum and its spectral gaps. While upper eigenvalue bounds are naturally induced by conforming…
We study the distribution of a fully connected neural network with random Gaussian weights and biases in which the hidden layer widths are proportional to a large constant $n$. Under mild assumptions on the non-linearity, we obtain…
We present new higher-order quadratures for a family of boundary integral operators re-derived using the approach introduced in [Kublik, Tanushev, and Tsai - J. Comp. Phys. 247: 279-311, 2013]. In this formulation, a boundary integral over…
Given a directed graph $E$ and an associative unital ring $R$ one may define the Leavitt path algebra with coefficients in $R$, denoted by $L_R(E)$. For an arbitrary group $G$, $L_R(E)$ can be viewed as a $G$-graded ring. In this article,…
In this note, given a pair $(\mathfrak{g}, \lambda)$, where $\mathfrak{g}$ is a complex semisimple Lie algebra and $\lambda \in \mathfrak{h}^*$ is a dominant integral weight of $\mathfrak{g}$, where $\mathfrak{h} \subset \mathfrak{g}$ is…
Surface parameterizations are widely applied in computer graphics, medical imaging and transformation optics. In this paper, we rigorously derive the gradient vector and Hessian matrix of the discrete conformal energy for spherical…
We consider the scenario of supervised learning in Deep Learning (DL) networks, and exploit the arbitrariness of choice in the Riemannian metric relative to which the gradient descent flow can be defined (a general fact of differential…
This paper gives a complete geometric characterization in all dimensions and codimensions of those Radon-like transforms which, up to endpoints, satisfy the largest possible range of local $L^p \rightarrow L^q$ inequalities permitted by…
We announce the extension of optimal regularity and Uhlenbeck compactness to the general setting of connections on vector bundles with non-compact gauge groups over non-Riemannian manifolds, including the Lorentzian metric connections of…
In this paper, we propose a general procedure for establishing the geometric landscape connections of a Riemannian optimization problem under the embedded and quotient geometries. By applying the general procedure to the fixed-rank positive…
Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…
Given a compact metric graph $\Gamma$ and the Laplacian $\Delta_{\Gamma}$ coupled with standard (Kirchhoff) vertex conditions, solutions to fractional elliptic partial differential equations of the form $(\kappa^2 -…
LayerNorm and RMSNorm impose fundamentally different geometric constraints on their outputs - and this difference has a precise, quantifiable consequence for model complexity. We prove that LayerNorm's mean-centering step, by confining data…
A rigidity property for the homotopy invariant stable linear framed presheaves is established. As a consequence a variant of Gabber rigidity theorem is obtained for a cohomology theory representable in the motivic stable homotopy category…
We propose a general error analysis related to the low-rank approximation of a given real matrix in both the spectral and Frobenius norms. First, we derive deterministic error bounds that hold with some minimal assumptions. Second, we…
We study the geometry of the algebraic set of tuples of composable matrices which multiply to a fixed matrix, using tools from the theory of quiver representations. In particular, we determine its codimension $C$ and the number $\theta$ of…
We establish a margin based data dependent generalization error bound for a general family of deep neural networks in terms of the depth and width, as well as the Jacobian of the networks. Through introducing a new characterization of the…