English
Related papers

Related papers: On Hessian limit directions along non-oscillating …

200 papers

We study the Stochastic Gradient Descent (SGD) algorithm in nonparametric statistics: kernel regression in particular. The directional bias property of SGD, which is known in the linear regression setting, is generalized to the kernel…

Machine Learning · Statistics 2022-08-30 Yiling Luo , Xiaoming Huo , Yajun Mei

This work focuses on the gradient flow dynamics of a neural network model that uses correlation loss to approximate a multi-index function on high-dimensional standard Gaussian data. Specifically, the multi-index function we consider is a…

Machine Learning · Computer Science 2025-03-12 Berfin Şimşek , Amire Bendjeddou , Daniel Hsu

Motivated by a constrained minimization problem, it is studied the gradient flows with respect to Hessian Riemannian metrics induced by convex functions of Legendre type. The first result characterizes Hessian Riemannian structures on…

Optimization and Control · Mathematics 2018-11-27 Felipe Alvarez , Jérôme Bolte , Olivier Brahic

Connections between Lie derivatives and the deviation equation has been investigated in spaces with affine connection. The deviation equations of the geodesics as well as deviation equations of non-geodesics trajectories have been obtained…

Differential Geometry · Mathematics 2007-05-23 Bozhidar Z. Iliev , Sawa S. Manoff

This paper presents a fast and powerful method for the computation of eigenvalue bounds for Hessian matrices $\nabla^2 \varphi(x) $ of nonlinear functions $\varphi: U \subseteq R^n\rightarrow R$ on hyperrectangles $B \subset U$. The method…

Optimization and Control · Mathematics 2015-07-23 Moritz Schulze Darup , Martin Mönnigmann

A new method to represent and approximate rotation matrices is introduced. The method represents approximations of a rotation matrix $Q$ with linearithmic complexity, i.e. with $\frac{1}{2}n\lg(n)$ rotations over pairs of coordinates,…

Machine Learning · Computer Science 2014-04-30 Michael Mathieu , Yann LeCun

For a locally Lipschitz continuous function $f:X\to\mathbb{R}$ the generalized gradient $\partial f(x)$ of Clarke is used to develop some (set-valued) gradient on a set $A\subset X$. Existence, uniqueness and some approximation are…

Optimization and Control · Mathematics 2018-03-19 Jan Mankau , Friedemann Schuricht

For an $n$-vertex graph $G$, and a rooted graph $H^{(v)}$ with $v$ as the root, the rooted product graph $G\circ H^{(v)}$ is obtained from $G$ and $n$ copies of $H$ by identifying the root of the $i$th copy of $H$ with the $i$th vertex of…

Combinatorics · Mathematics 2026-01-06 Wei Wang , Jie Shen , Lihuan Mao

For a graph $G$ let $\varepsilon(G)$ denote the number of Eulerian orientations, and $v(G)$ denote the number of vertices of $G$. We show that if $(G_n)_n$ is a sequence of Eulerian graphs that are convergent in Benjamini--Schramm sense,…

Combinatorics · Mathematics 2024-09-27 Ferenc Bencs , Márton Borbényi , Péter Csikvári

Let G be a definably compact group in an o-minimal expansion of a real closed field. We prove that if dim(G X) < dim G for some definable X subset of G then X contains a torsion point of G. Along the way we develop a general theory for…

Logic · Mathematics 2007-08-06 Margarita Otero , Ya'acov Peterzil

In analyzing a simple random walk on the Heisenberg group we encounter the problem of bounding the extreme eigenvalues of an $n\times n$ matrix of the form $M=C+D$ where $C$ is a circulant and $D$ a diagonal matrix. The discrete…

Probability · Mathematics 2015-11-10 Daniel Bump , Persi Diaconis , Angela Hicks , Laurent Miclo , Harold Widom

We calculate analytically properties of holographic superconductors in the probe limit. We analyze the range $1/2 < \Delta < 3$, where $\Delta$ is the dimension of the operator that condenses. We obtain the critical temperature in terms of…

High Energy Physics - Theory · Physics 2015-05-18 George Siopsis , Jason Therrien

We study graphs with nonnegative Bakry-\'Emery curvature or Ollivier curvature outside a finite subset. For such a graph, via introducing the discrete Gromov-Hausdorff convergence we prove that the space of bounded harmonic functions is…

Differential Geometry · Mathematics 2022-10-04 Bobo Hua , Florentin Münch

If V is a representation of a linear algebraic group G, a set S of G-invariant regular functions on V is called separating if the following holds: If two elements v,v' from V can be separated by an invariant function, then there is an f…

Commutative Algebra · Mathematics 2014-06-25 Martin Kohls , Hanspeter Kraft

We investigate the notion of H-subdifferential and H-normal map of a function on the Heisenberg group, based on its sub-Riemannian structure. In particular, a characterization of the convexity of a function is given via the nonemptiness of…

Differential Geometry · Mathematics 2008-11-17 A. Calogero , R. Pini

In this paper, we describe the leftmost eigenvalue of the non-selfadjoint operator $\mathcal{A}_h = -h^2\Delta+iV(x)$ with Dirichlet boundary conditions on a smooth bounded domain $\Omega\subset\mathbb{R}^n\,$, as $h\rightarrow0\,$. $V$ is…

Spectral Theory · Mathematics 2014-05-26 Raphaël Henry

We consider functionals of long-range dependent Gaussian sequences with infinite variance and obtain nonstandard limit theorems. When the long-range dependence is strong enough, the limit is a Hermite process, while for weaker long-range…

Probability · Mathematics 2008-12-18 Allan Sly , Chris Heyde

We consider a transport equation by a gradient vector field with a small viscous perturbation --$\epsilon\Delta_g$. We study uniform observability (resp. controllability) properties in the (singular) vanishing viscosity limit…

Analysis of PDEs · Mathematics 2021-02-10 Camille Laurent , Matthieu Léautaud

For a graph $G=(V,\ E)$ and a nonempty set $S\subseteq V$, the \emph{vertex boundary} of $S$, denoted by $\partial_G(S)$, is defined to be the set of vertices that are not in $S$ but have at least one neighbor in $S$. In this paper, for $G$…

Combinatorics · Mathematics 2025-10-07 Runze Wang

We give formulae for first and second derivatives of generalized eigenvalues/eigenvectors of symmetric matrices and generalized singular values/singular vectors of rectangular matrices when the matrices are linear or nonlinear functions of…

Computation · Statistics 2025-08-18 Jan de Leeuw