Related papers: Tight Lipschitz Hardness for Optimizing Mean Field…
We characterize the complexity of minimizing $\max_{i\in[N]} f_i(x)$ for convex, Lipschitz functions $f_1,\ldots, f_N$. For non-smooth functions, existing methods require $O(N\epsilon^{-2})$ queries to a first-order oracle to compute an…
Randomness and frustration are considered to be the key ingredients for the existence of spin glass (SG) phase. In a canonical system, these ingredients are realized by the random mixture of ferromagnetic (FM) and antiferromagnetic (AF)…
We discuss the mean-field theory of spin-glass models with frustrated long-range random spin exchange. We analyze the reasons for breakdown of the simple mean-field theory of Sherrington and Kirkpatrick. We relate the replica-symmetry…
In a companion paper we developed the generalized TAP approach for general multi-species spherical mixed $p$-spin models. In this paper, we use it to compute the limit of the free energy at any temperature for all pure multi-species…
We study a multi-species spin glass system where the density of each species is kept fixed at increasing volumes. The model reduces to the Sherrington-Kirkpatrick one for the single species case. The existence of the thermodynamic limit is…
This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…
We show that in random $K$-uniform hypergraphs of constant average degree, for even $K \geq 4$, local algorithms defined as factors of i.i.d. can not find nearly maximal cuts, when the average degree is sufficiently large. These algorithms…
We study the Potts spin glass model, which generalizes the Sherrington-Kirkpatrick model to the case when spins take more than two values but their interactions are counted only if the spins are equal. We obtain the analogue of the Parisi…
Ising spin glasses with bimodal and Gaussian near-neighbor interaction distributions are studied through numerical simulations. The non-self-averaging (normalized inter-sample variance) parameter $U_{22}(T,L)$ for the spin glass…
A formalism capable of handling the first step of hierarchical replica symmetry breaking in finite-connectivity models is introduced. The emerging order parameter is claimed to be a probability distribution over the space of field…
We propose a new first-order method for minimizing nonconvex functions with Lipschitz continuous gradients and H\"older continuous Hessians. The proposed algorithm is a heavy-ball method equipped with two particular restart mechanisms. It…
Non-deterministic polynomial-time (NP) problems are ubiquitous in almost every field of study. Recently, all-optical approaches have been explored for solving classic NP problems based on the spin-glass Ising Hamiltonian. However, obtaining…
We study the Replica Symmetric region of general multi-species Sherrington-Kirkpatrick (MSK) Model and answer some of the questions raised in Ann.~Probab.~43~(2015), no.~6, 3494--3513, where the author proved the Parisi formula under…
Inspired by the boolean discrepancy problem, we study the following optimization problem which we term \textsc{Spherical Discrepancy}: given $m$ unit vectors $v_1, \dots, v_m$, find another unit vector $x$ that minimizes $\max_i \langle x,…
Models of spin glasses are studied with a phase transition discontinuous in the Parisi order parameter. It is assumed that the leading order corrections to the thermodynamic limit of the high temperature free energy are due to the existence…
We consider $h$-stable local optima of Ising spin glass models, defined as spin configurations such that for nearly all of the spins, flipping their values results in increasing energy by at least a given amount $h$. Spins satisfying this…
We study order-parameter fluctuations (OPF) in disordered systems by considering the behavior of some recently introduced paramaters $G,G_c$ which have proven very useful to locate phase transitions. We prove that both parameters G (for…
We discuss the computational complexity of random 2D Ising spin glasses, which represent an interesting class of constraint satisfaction problems for black box optimization. Two extremal cases are considered: (1) the +/- J spin glass, and…
We formulate an affine invariant implementation of the accelerated first-order algorithm in Nesterov (1983). Its complexity bound is proportional to an affine invariant regularity constant defined with respect to the Minkowski gauge of the…
We present a critical analysis of the Sompolinsky theory of equilibrium dynamics. By using the spherical $2+p$ spin glass model we test the asymptotic static limit of the Sompolinsky solution showing that it fails to yield a…