English
Related papers

Related papers: On Hessian limit directions along non-oscillating …

200 papers

Let $\mathcal{V}=\bigsqcup_{i=0}^n\mathcal{V}_i$ be the lattice of subspaces of the $n$-dimensional vector space over the finite field $\mathbb{F}_q$ and let $\mathcal{A}$ be the graded Gorenstein algebra defined over $\mathbb{Q}$ which has…

Combinatorics · Mathematics 2016-09-15 Saeed Nasseh , Alexandra Seceleanu , Junzo Watanabe

Let $\mathbb F=\mathbb R$ or $\mathbb C$ and $n\in\b N$. Let $(S_k)_{k\ge0}$ be a time-homogeneous random walk on $GL_n(\b F)$ associated with an $U_n(\b F)$-biinvariant measure $\nu\in M^1(GL_n(\b F))$. We derive a central limit theorem…

Classical Analysis and ODEs · Mathematics 2012-05-23 Michael Voit

The geodesic equations for optical media whose refractive indices have a non-vanishing gradient are developed. It is shown that when those media are optically isotropic, the light paths will be mull geodesics of a spatial metric that is…

General Relativity and Quantum Cosmology · Physics 2020-02-21 D. H. Delphenich

In this paper we find spectral properties in the large $N$ limit of Dirac operators that come from random finite noncommutative geometries. In particular for a Gaussian potential the limiting eigenvalue spectrum is shown to be universal…

High Energy Physics - Theory · Physics 2022-06-10 Masoud Khalkhali , Nathan Pagliaroli

In this paper, we investigate Hessian curvature hypersurfaces with prescribed Gauss images. Given geodesically strictly convex bounded domains $\Omega$ in $\mathbb{R}^n$ and $\tilde{\Omega}$ in the unit hemisphere, we prove that there is a…

Differential Geometry · Mathematics 2024-12-13 Huang Rongli , Qu Changzheng , Wang Zhizhang , Wo Weifeng

We present a family of generalized Hessian estimators of the objective using random direction stochastic approximation (RDSA) by utilizing only noisy function measurements. The form of each estimator and the order of the bias depend on the…

Machine Learning · Computer Science 2026-02-24 Soumen Pachal , Prashanth L. A. , Shalabh Bhatnagar , Avinash Achar

Consider the product $X = X_{1}\cdots X_{m}$ of $m$ independent $n\times n$ iid random matrices. When $m$ is fixed and the dimension $n$ tends to infinity, we prove Gaussian limits for the centered linear spectral statistics of $X$ for…

Probability · Mathematics 2019-04-11 Natalie Coston , Sean O'Rourke

This work is concerned with operators of the type A = --c$\Delta$ acting in domains $\Omega$ := $\Omega$ ' x (0, H) $\subseteq$ R^d x R ^+. The diffusion coefficient c > 0 depends on one coordinate y $\in$ (0, H) and is bounded but may be…

Analysis of PDEs · Mathematics 2022-12-14 Assia Benabdallah , Matania Ben-Artzi , Yves Dermenjian

We propose a novel reachability analysis method tailored for neural networks with differentiable activations. Our idea hinges on a sound abstraction of the neural network map based on first-order Taylor expansion and bounding the remainder.…

Machine Learning · Computer Science 2024-06-10 Sina Sharifi , Mahyar Fazlyab

This report investigates the fitting of the Hessian or its inverse for stochastic optimizations using a Hessian fitting criterion derived from the preconditioned stochastic gradient descent (PSGD) method. This criterion is closely related…

Machine Learning · Statistics 2025-12-02 Xi-Lin Li

If a one-variable function is sufficiently smooth, then the limit position of secant lines its graph is a tangent line. By analogy, one would expect that the limit position of secant planes of a two-variable smooth function is a plane…

Differential Geometry · Mathematics 2022-08-30 Paolo Roselli

Let $f$ be an entire transcendental function of finite order and $\Delta$ be a forward invariant bounded Siegel disk for $f$ with rotation number in Herman's class $\mathcal{H}$. We show that if $f$ has two singular values with bounded…

Dynamical Systems · Mathematics 2014-07-30 Anna Miriam Benini , Nuria Fagella

We consider a stochastic directed graph on the integers whereby a directed edge between $i$ and a larger integer $j$ exists with probability $p_{j-i}$ depending solely on the distance between the two integers. Under broad conditions, we…

Probability · Mathematics 2017-11-29 Denis Denisov , Sergey Foss , Takis Konstantopoulos

The Hessian-vector product has been utilized to find a second-order stationary solution with strong complexity guarantee (e.g., almost linear time complexity in the problem's dimensionality). In this paper, we propose to further reduce the…

Optimization and Control · Mathematics 2017-10-03 Mingrui Liu , Tianbao Yang

We present a gradient-based algorithm for unconstrained minimization derived from iterated linear change of basis. The new method is equivalent to linear conjugate gradient in the case of a quadratic objective function. In the case of exact…

Optimization and Control · Mathematics 2008-08-19 Stephen A. Vavasis

We study the set ${\cal D}(\Phi)$ of limit directions of a vector cocycle $(\Phi_n)$ over a dynamical system, i.e., the set of limit values of $\Phi_n(x) /\|\Phi_n(x)\|$ along subsequences such that $\|\Phi_n(x)\|$ tends to $\infty$. This…

Dynamical Systems · Mathematics 2014-05-09 Jean-Pierre Conze , Stéphane Le Borgne

Let G denote a closed, connected, self adjoint, noncompact subgroup of GL(n,R), and let d_{R} denote the canonical right invariant Riemannian metric on G. For v in R^{n} let G_{v} = {g in G : g(v) = v}. We obtain algebraically defined upper…

Differential Geometry · Mathematics 2010-12-15 Patrick Eberlein

In this paper, we showed that for suitable $(\beta,p, s,\ell)$ the $\beta$-order fractional derivative with respect to the last coordinate of the Fourier transform of an $L^p(\mathbb{R}^n)$ function is in $H^{-s}$ after restricting to a…

Functional Analysis · Mathematics 2024-10-24 Michael Goldberg , Chun Ho Lau

This work investigates the asymptotic behaviour of the gradient approximation method called the generalized simplex gradient (GSG). This method has an error bound that at first glance seems to tend to infinity as the number of sample points…

Numerical Analysis · Mathematics 2021-04-05 Warren Hare , Gabriel Jarry-Bolduc , Chayne Planiden

We prove a central limit theorem for the components of the largest eigenvectors of the adjacency matrix of a finite-dimensional random dot product graph whose true latent positions are unknown. In particular, we follow the methodology…

Statistics Theory · Mathematics 2013-12-24 Avanti Athreya , Vince Lyzinski , David J. Marchette , Carey E. Priebe , Daniel L. Sussman , Minh Tang