English
Related papers

Related papers: Counting Stationary Points of Random Landscapes as…

200 papers

We construct a N-dimensional Gaussian landscape with multiscale, translation invariant, logarithmic correlations and investigate the statistical mechanics of a single particle in this environment. In the limit of high dimension N>>1 the…

Disordered Systems and Neural Networks · Physics 2009-11-13 Yan V Fyodorov , Jean-Philippe Bouchaud

In this paper we model the loss function of high-dimensional optimization problems by a Gaussian random field, or equivalently a Gaussian process. Our aim is to study gradient descent in such loss functions or energy landscapes and compare…

Machine Learning · Statistics 2018-03-28 Mariano Chouza , Stephen Roberts , Stefan Zohren

We formulate a stochastic game of mean field type where the agents solve optimal stopping problems and interact through the proportion of players that have already stopped. Working with a continuum of agents, typical equilibria become…

Optimization and Control · Mathematics 2017-12-01 Marcel Nutz

We use Stein's method to obtain bounds on the rate of convergence for a class of statistics in geometric probability obtained as a sum of contributions from Poisson points which are exponentially stabilizing, i.e. locally determined in a…

Probability · Mathematics 2007-05-23 Mathew D. Penrose , J. E. Yukich

In this paper, we present a fine-grained analysis of the local landscape of phase retrieval under the regime of limited samples. Specifically, we aim to ascertain the minimal sample size required to guarantee a benign local landscape…

Information Theory · Computer Science 2024-10-15 Kaizhao Liu , Zihao Wang , Lei Wu

The problem of finding large average submatrices of a real-valued matrix arises in the exploratory analysis of data from a variety of disciplines, ranging from genomics to social sciences. In this paper we provide a detailed asymptotic…

Probability · Mathematics 2013-06-17 Shankar Bhamidi , Partha S. Dey , Andrew B. Nobel

We consider the problem of uniform sampling of points on an algebraic variety. Specifically, we develop a randomized algorithm that, given a small set of multivariate polynomials over a sufficiently large finite field, produces a common…

Data Structures and Algorithms · Computer Science 2009-02-10 Mahdi Cheraghchi , Amin Shokrollahi

We study the landscape complexity of the Hamiltonian $X_N(x) +\frac\mu2 \|x\|^2,$ where $X_{N}$ is a smooth Gaussian process with isotropic increments on $\mathbb R^{N}$. This model describes a single particle on a random potential in…

Probability · Mathematics 2023-07-26 Antonio Auffinger , Qiang Zeng

In order to better understand the occurrence of phase transitions, we adopt an approach based on the study of energy landscapes: The relation between stationary points of the potential energy landscape of a classical many-particle system…

Statistical Mechanics · Physics 2009-03-24 Michael Kastner

A common measure of a function's complexity is the count of its stationary points. For complicated functions, this count grows exponentially with the volume and dimension of their domain. In practice, the count is averaged over a class of…

Statistical Mechanics · Physics 2024-01-17 Jaron Kent-Dobias

We address the construction of stable random matrix ensembles as the generalization of the stable random variables (Levy distributions). With a simple method we derive the Cauchy case, which is known to have remarkable properties. These…

Statistical Mechanics · Physics 2007-05-23 M. Tierz

Loss landscape analysis is extremely useful for a deeper understanding of the generalization ability of deep neural network models. In this work, we propose a layerwise loss landscape analysis where the loss surface at every layer is…

Machine Learning · Computer Science 2020-12-09 Adepu Ravi Sankar , Yash Khasbage , Rahul Vigneswaran , Vineeth N Balasubramanian

Using the replica method we calculate the mean spectral density of the Hessian matrix at the global minimum of a random $N \gg 1$ dimensional isotropic, translationally invariant Gaussian random landscape confined by a parabolic potential…

Disordered Systems and Neural Networks · Physics 2019-03-19 Yan V Fyodorov , Pierre Le Doussal

This paper studies the saddle point problem of polynomials. We give an algorithm for computing saddle points. It is based on solving Lasserre's hierarchy of semidefinite relaxations. Under some genericity assumptions on defining…

Optimization and Control · Mathematics 2021-06-10 Jiawang Nie , Zi Yang , Guangming Zhou

This paper characterizes the annealed, topological complexity (both of total critical points and of local minima) of the elastic manifold. This classical model of a disordered elastic system captures point configurations with…

Probability · Mathematics 2021-05-12 Gérard Ben Arous , Paul Bourgade , Benjamin McKenna

We consider the logarithm of the characteristic polynomial of random permutation matrices, evaluated on a finite set of different points. The permutations are chosen with respect to the Ewens distribution on the symmetric group. We show…

Probability · Mathematics 2013-09-17 Kim Dang , Dirk Zeindler

The problem of maximizing the average cross section through a point within a shape is introduced. This idea is extended into arbitrary dimensions. However, the average cross sectional volume cannot be maximized unless the cross sections…

General Mathematics · Mathematics 2022-11-18 Kyeong Min Kim

Geodesic metric spaces support a variety of averaging constructions for given finite sets. Computing such averages has generated extensive interest in diverse disciplines. Here we consider the inverse problem of recognizing computationally…

Optimization and Control · Mathematics 2024-06-07 Ariel Goodwin , Adrian S. Lewis , Genaro Lopez-Acedo , Adriana Nicolae

A method is presented to compute approximate solutions for eigenequations in quantum mechanics with an arbitrary kinetic part. In some cases, the approximate eigenvalues can be analytically determined and they can be lower or upper bounds.…

Quantum Physics · Physics 2012-10-01 Claude Semay

This paper considers the problem of computing Bayesian estimates of both states and model parameters for nonlinear state-space models. Generally, this problem does not have a tractable solution and approximations must be utilised. In this…

Machine Learning · Statistics 2020-12-15 Jarrad Courts , Johannes Hendriks , Adrian Wills , Thomas Schön , Brett Ninness