English
Related papers

Related papers: On $\ell_p$-Gaussian-Grothendieck problem

200 papers

We consider the problem of linear regression where the $\ell_2^n$ norm loss (i.e., the usual least squares loss) is replaced by the $\ell_p^n$ norm. We show how to solve such problems up to machine precision in $O^*(n^{|1/2 - 1/p|})$…

Optimization and Control · Mathematics 2018-06-26 Sébastien Bubeck , Michael B. Cohen , Yin Tat Lee , Yuanzhi Li

We consider an invariant random matrix model where the standard Gaussian potential is distorted by an additional single pole of order $m$. We compute the average or macroscopic spectral density in the limit of large matrix size, solving the…

Mathematical Physics · Physics 2014-07-09 Gernot Akemann , Dario Villamaina , Pierpaolo Vivo

The validity of the Parisi formula in the Sherrington-Kirkpatrick model (SK) was initially proved by Talagrand [18]. The central argument therein relied on a very dedicated study of the coupled free energy via the two-dimensional…

Probability · Mathematics 2016-05-16 Wei-Kuo Chen

Let $n$ be a large integer, and let $G$ be the standard Gaussian vector in $R^n$. Paouris, Valettas and Zinn (2015) showed that for all $p\in[1,c\log n]$, the variance of the $\ell_p^n$--norm of $G$ is equivalent, up to a constant multiple,…

Functional Analysis · Mathematics 2017-07-11 Anna Lytova , Konstantin Tikhomirov

We compute the probability of positive large deviations of the free energy per spin in mean-field Spin-Glass models. The probability vanishes in the thermodynamic limit as $P(\Delta f) \propto \exp[-N^2 L_2(\Delta f)]$. For the…

Disordered Systems and Neural Networks · Physics 2012-10-31 Giorgio Parisi , Tommaso Rizzo

The Ghatak-Sherrington (GS) spin glass model is a random probability measure defined on the configuration space $\{0,\pm1,\pm2,\ldots, \pm \mathcal{S} \}^N$ with system size $N$ and $\mathcal{S}\ge1$ finite. This generalizes the classical…

Probability · Mathematics 2024-04-03 Yueqi Sheng , Qiang Wu

We focus on spherical spin glasses whose Parisi distribution has support of the form $[0,q]$. For such models we construct paths from the origin to the sphere which consistently remain close to the ground-state energy on the sphere of…

Probability · Mathematics 2019-12-03 Eliran Subag

As a first step towards a mathematically rigorous understanding of adaptive spectral/$hp$ discretizations of elliptic boundary-value problems, we study the performance of adaptive Legendre-Galerkin methods in one space dimension. These…

Numerical Analysis · Mathematics 2012-06-26 Claudio Canuto , Ricardo H. Nochetto , Marco Verani

We study the probability distribution P(E) of the ground state energy E in various Ising spin glasses. In most models, P(E) seems to become Gaussian with a variance growing as the system's volume V. Exceptions include the…

Disordered Systems and Neural Networks · Physics 2009-11-07 J. -P. Bouchaud , F. Krzakala , O. C. Martin

We establish an explicit maximum principle for the Dirichlet problem associated with the $p$-Laplacian ($p>1$), where the constant depends on both $p$ and the geometry of the domain. From this result we derive two main applications. First,…

Analysis of PDEs · Mathematics 2026-05-19 Kevin Carrillo-Reina , Jean C. Cortissoz

We consider mean-field vector spin glasses with self-overlap correction. The limit of free energy is known to be the Parisi formula, which is an infimum over matrix-valued paths. We decompose such a path into a Lipschitz matrix-valued path…

Probability · Mathematics 2023-12-27 Hong-Bin Chen

The classical Gaussian ensembles of random matrices can be constructed by maximizing Boltzmann-Gibbs-Shannon's entropy, S_{BGS} = - \int d{\bf H} [P({\bf H})] \ln [P({\bf H})], with suitable constraints. Here we construct and analyze…

Statistical Mechanics · Physics 2009-11-10 Fabricio Toscano , Raul O. Vallejos , Constantino Tsallis

We investigate the behavior of the rare fluctuations of the free energy in the p-spin spherical model, evaluating the corresponding rate function via the G\"artner-Ellis theorem. This approach requires the knowledge of the analytic…

Disordered Systems and Neural Networks · Physics 2019-11-27 Mauro Pastore , Andrea Di Gioacchino , Pietro Rotondo

We show that the thermodynamic limit of the ground state energy in the mixed p-spin model can be identified as a variational problem. This gives a natural generalization of the Parisi formula at zero temperature.

Probability · Mathematics 2016-06-29 Antonio Auffinger , Wei-Kuo Chen

A large number of problems in optimization, machine learning, signal processing can be effectively addressed by suitable semidefinite programming (SDP) relaxations. Unfortunately, generic SDP solvers hardly scale beyond instances with a few…

Optimization and Control · Mathematics 2016-03-15 Andrea Montanari

Given a graph $G=([n],E)$ and $w\in\R^E$, consider the integer program ${\max}_{x\in \{\pm 1\}^n} \sum_{ij \in E} w_{ij}x_ix_j$ and its canonical semidefinite programming relaxation ${\max} \sum_{ij \in E} w_{ij}v_i^Tv_j$, where the maximum…

Combinatorics · Mathematics 2011-06-15 Monique Laurent , Antonios Varvitsiotis

In this paper we study the Parisi variational problem for mixed $p$-spin glasses with Ising spins. Our starting point is a characterization of Parisi measures whose origin lies in the first order optimality conditions for the Parisi…

Probability · Mathematics 2017-07-03 Aukosh Jagannath , Ian Tobasco

In this paper, we consider an $\ell_{0}$-norm penalized formulation of the generalized eigenvalue problem (GEP), aimed at extracting the leading sparse generalized eigenvector of a matrix pair. The formulation involves maximization of a…

Machine Learning · Statistics 2015-06-22 Junxiao Song , Prabhu Babu , Daniel P. Palomar

We show that the limiting ground state energy of the spherical mixed p-spin model can be identified as the infimum of certain variational problem. This complements the well-known Parisi formula for the limiting free energy in the spherical…

Probability · Mathematics 2017-01-04 Wei-Kuo Chen , Arnab Sen

We present a critical analysis of the Sompolinsky theory of equilibrium dynamics. By using the spherical $2+p$ spin glass model we test the asymptotic static limit of the Sompolinsky solution showing that it fails to yield a…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. Crisanti , L. Leuzzi