相关论文: Hessian descent for spherical spin glasses with un…
We study the large $N$-dimensional limit of the Hessian spectrum at the global minimum of some subclasses of the spherical mixed $p$-spin models. Specifically, we show that its empirical spectral measure converges in probability to a…
We show marginal stability of near-ground states in spherical spin glasses is equivalent to full replica symmetry breaking at zero temperature near overlap $1$. This connection has long been implicit in the physics literature, which also…
We derive sufficient conditions for a probability measure on a finite product space (a spin system) to satisfy a (modified) logarithmic Sobolev inequality. We establish these conditions for various examples, such as the (vertex-weighted)…
We present the first iterative spectral algorithm to find near-optimal solutions for a random quadratic objective over the discrete hypercube, resolving a conjecture of Subag [Subag, Communications on Pure and Applied Mathematics, 74(5),…
We consider a noninteracting unbounded spin system with conservation of the mean spin. We derive a uniform logarithmic Sobolev inequality (LSI) provided the single-site potential is a bounded perturbation of a strictly convex function. The…
We propose to use the {\L}ojasiewicz inequality as a general tool for analyzing the convergence rate of gradient descent on a Hilbert manifold, without resorting to the continuous gradient flow. Using this tool, we show that a Sobolev…
In this paper we establish some explicit and sharp estimates of the spectral gap and the log-Sobolev constant for mean field particles system, uniform in the number of particles, when the confinement potential have many local minimums. Our…
In this paper, we are concerned with the optimal asymptotic lower bound for the stability of Sobolev inequality on the Heisenberg group. We first establish the optimal local stability of Sobolev inequality on the CR sphere through…
We propose a Langevin diffusion-based algorithm for non-convex optimization and sampling on a product manifold of spheres. Under a logarithmic Sobolev inequality, we establish a guarantee for finite iteration convergence to the Gibbs…
We propose a multidimensional smoothing spline algorithm in the context of manifold learning. We generalize the bending energy penalty of thin-plate splines to a quadratic form on the Sobolev space of a flat manifold, based on the Frobenius…
We introduce a new approach to studying spherical spin glass dynamics based on differential inequalities for one-time observables. Using this approach, we obtain an approximate phase diagram for the evolution of the energy $H$ and its…
We introduce efficient algorithms for approximate sampling from symmetric Gibbs distributions on the sparse random (hyper)graph. The examples we consider include (but are not restricted to) important distributions on spin systems and…
Log-Sobolev inequalities (LSIs) upper-bound entropy via a multiple of the Dirichlet form (i.e. norm of a gradient). In this paper we prove a family of entropy-energy inequalities for the binary hypercube which provide a non-linear…
We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…
We consider the community detection problem in sparse random hypergraphs under the non-uniform hypergraph stochastic block model (HSBM), a general model of random networks with community structure and higher-order interactions. When the…
We consider minimizing a smooth and strongly convex objective function using a stochastic Newton method. At each iteration, the algorithm is given an oracle access to a stochastic estimate of the Hessian matrix. The oracle model includes…
We prove that stochastic gradient descent (SGD) finds a solution that achieves $(1-\epsilon)$ classification accuracy on the entire dataset. We do so under two main assumptions: (1. Local progress) The model accuracy improves on average…
We obtain an improved Sobolev inequality in H^s spaces involving Morrey norms. This refinement yields a direct proof of the existence of optimizers and the compactness up to symmetry of optimizing sequences for the usual Sobolev embedding.…
We present a very simple proof that the $O(n)$ model satisfies a uniform logarithmic Sobolev inequality (LSI) if the positive definite coupling matrix has largest eigenvalue less than $n$. This condition applies in particular to the SK spin…
This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the…