English
Related papers

Related papers: Geodesics in the Deep Linear Network

200 papers

We prove that for a Baire-generic Riemannian metric on a closed smooth manifold, the union of the images of all stationary geodesic nets forms a dense set.

Differential Geometry · Mathematics 2023-02-17 Yevgeny Liokumovich , Bruno Staffa

The deep linear network (DLN) is a model for implicit regularization in gradient based optimization of overparametrized learning architectures. Training the DLN corresponds to a Riemannian gradient flow, where the Riemannian metric is…

Dynamical Systems · Mathematics 2023-05-12 Nadav Cohen , Govind Menon , Zsolt Veraszto

We construct convex bodies that can be "captured by nets." More precisely, for each dimension $n \geq 2$, we construct a family of Riemannian $n$-spheres, each with a stable geodesic net, which is a stable 1-dimensional integral varifold.…

Differential Geometry · Mathematics 2023-12-01 Herng Yi Cheng

Real world data often lie on low-dimensional Riemannian manifolds embedded in high-dimensional spaces. This motivates learning degenerate normalizing flows that map between the ambient space and a low-dimensional latent space. However, if…

Machine Learning · Computer Science 2026-04-14 Hanlin Yu , Søren Hauberg , Marcelo Hartmann , Arto Klami , Georgios Arvanitidis

The aim of this paper is to construct a Riemann-Lagrange geometry on 1-jet spaces, in the sense of d-connections, d-torsions, d-curvatures, electromagnetic d-field and geometric electromagnetic Yang-Mills energy, starting from a given…

Differential Geometry · Mathematics 2011-02-17 Mircea Neagu

We find necessary and sufficient conditions for the foliation defined by level sets of a function f(x_{1},...,x_{n}) to be totally geodesic in a torsion-free connection and apply them to find the conditions for d-webs of hypersurfaces to be…

Differential Geometry · Mathematics 2008-10-31 Vladislav V. Goldberg , Valentin V. Lychagin

Geodesics become an essential element of the geometry of a semi-Riemannian manifold. In fact, their differences and similarities with the (positive definite) Riemannian case, constitute the first step to understand semi-Riemannian Geometry.…

Differential Geometry · Mathematics 2010-03-23 Anna Maria Candela , Miguel Sánchez

Let M be either a simply connected pseudo-Riemannian space of constant curvature or a rank one Riemannian symmetric space (other than the octonion hyperbolic plane), and consider the space L(M) of oriented geodesics of M. The space L(M) is…

Differential Geometry · Mathematics 2020-11-19 Dmitri V. Alekseevsky , Brendan Guilfoyle , Wilhelm Klingenberg

The length of the geodesic between two data points along a Riemannian manifold, induced by a deep generative model, yields a principled measure of similarity. Current approaches are limited to low-dimensional latent spaces, due to the…

In this article we investigate a type of totally geodesic map which has its image being a geodesic in an anisotropic Riemannian manifold. We consider its nonlinear stability among the family of wave maps. We first establish the…

Analysis of PDEs · Mathematics 2022-05-24 Senhao Duan , Yue Ma , Weidong Zhang

A general class of Lorentzian metrics, $M_0 x R^2$, $ds^2 = <.,.> + 2 du dv + H(x,u) du^2$, with $(M_0, <.,.>$ any Riemannian manifold, is introduced in order to generalize classical exact plane fronted waves. Here, we start a systematic…

General Relativity and Quantum Cosmology · Physics 2015-06-25 A. M. Candela , J. L. Flores , Miguel Sanchez

The clear understanding of the non-convex landscape of neural network is a complex incomplete problem. This paper studies the landscape of linear (residual) network, the simplified version of the nonlinear network. By treating the gradient…

Algebraic Geometry · Mathematics 2021-02-09 Xiuyi Yang

Manifolds discovered by machine learning models provide a compact representation of the underlying data. Geodesics on these manifolds define locally length-minimising curves and provide a notion of distance, which are key for reduced-order…

Machine Learning · Computer Science 2023-05-25 Daniel Kelshaw , Luca Magri

We find an upper bound for geodesic distances associated to monotone Riemannian metrics on positive definite matrices and density matrices.

Mathematical Physics · Physics 2015-06-26 Anna Jencova

We consider the ability of deep neural networks to represent data that lies near a low-dimensional manifold in a high-dimensional space. We show that deep networks can efficiently extract the intrinsic, low-dimensional coordinates of such…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Ronen Basri , David Jacobs

This paper investigates the relationship between a system of differential equations and the underlying geometry associated with it. The geometry of a surface determines shortest paths, or geodesics connecting nearby points, which are…

Differential Geometry · Mathematics 2007-05-23 Richard Atkins

Deep Neural Networks are widely used for solving complex problems in several scientific areas, such as speech recognition, machine translation, image analysis. The strategies employed to investigate their theoretical properties mainly rely…

Machine Learning · Computer Science 2022-09-26 Alessandro Benfenati , Alessio Marta

This paper uncovers a large class of left-invariant sub-Rie\-mannian systems on Lie groups that admit explicit solutions with certain properties, and provides geometric origins for a class of important curves on Stiefel manifolds, called…

Optimization and Control · Mathematics 2018-09-20 Jurdjevic Velimir , Markina Irina , Silva Leite Fatima

We introduce the concept of ODD ('$\mathbf{O}$rthogonally $\mathbf{D}$egenerating on a $\mathbf{D}$ivisor') Riemannian metrics on real analytic manifolds $M$. These semipositive symmetric $2$-tensors may degenerate on a finite collection of…

Differential Geometry · Mathematics 2022-11-28 Lukas Braun

In this paper, we define and study strong right-invariant sub-Riemannian structures on the group of diffeomorphisms of a manifold with bounded geometry. We derive the Hamiltonian geodesic equations for such structures, and we provide…

Optimization and Control · Mathematics 2015-08-19 Sylvain Arguillere , Emmanuel Trélat