English
Related papers

Related papers: Optimization of the Sherrington-Kirkpatrick Hamilt…

200 papers

The matrix $A:\mathbb{R}^n \to \mathbb{R}^m$ is $(\delta,k)$-regular if for any $k$-sparse vector $x$, $$ \left| \|Ax\|_2^2-\|x\|_2^2\right| \leq \delta \sqrt{k} \|x\|_2^2. $$ We show that if $A$ is $(\delta,k)$-regular for $1 \leq k \leq…

Statistics Theory · Mathematics 2021-03-10 Shahar Mendelson

Gradient-based minimax optimal algorithms have greatly promoted the development of continuous optimization and machine learning. One seminal work due to Yurii Nesterov [Nes83a] established $\tilde{\mathcal{O}}(\sqrt{L/\mu})$ gradient…

Machine Learning · Computer Science 2023-12-07 Yuanshi Liu , Hanzhen Zhao , Yang Xu , Pengyun Yue , Cong Fang

We propose a general learning algorithm for solving optimization problems, based on a simple strategy of trial and adaptation. The algorithm maintains a probability distribution of possible solutions (configurations), which is updated…

adap-org · Physics 2009-10-30 Kan Chen

We propose a new iterative construction of solutions of the classical TAP equations for the Sherrington-Kirkpatrick model, i.e. with finite-size Onsager correction. The algorithm can be started in an arbitrary point, and converges up to the…

Probability · Mathematics 2023-11-21 Stephan Gufler , Adrien Schertzer , Marius A. Schmidt

Francesco Guerra and Fabio Toninelli have developped a very powerful technique to study the high temperature behaviour of the Sherrington-Kirkpatrick mean field spin glass model. They show that this model is asymptoticaly comparable to a…

Probability · Mathematics 2007-05-23 Philippe Carmona

We prove that the Sherrington-Kirkpatrick model of spin glasses is chaotic under small perturbations of the couplings at any temperature in the absence of an external field. The result is proved for two kinds of perturbations: (a)…

Probability · Mathematics 2009-11-24 Sourav Chatterjee

A sliding window algorithm receives a stream of symbols and has to output at each time instant a certain value which only depends on the last $n$ symbols. If the algorithm is randomized, then at each time instant it produces an incorrect…

Formal Languages and Automata Theory · Computer Science 2018-02-22 Moses Ganardi , Danny Hucke , Markus Lohrey

A mean field spherical model with random couplings between pairs, quartets, and possibly higher multiplets of spins is considered. It has the same critical behavior as the Sherrington-Kirkpatrick model. It thus exhibits replica symmetry…

Condensed Matter · Physics 2009-10-22 Th. M. Nieuwenhuizen

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

Machine Learning · Computer Science 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

We exhibit a randomized algorithm which given a matrix $A\in \mathbb{C}^{n\times n}$ with $\|A\|\le 1$ and $\delta>0$, computes with high probability an invertible $V$ and diagonal $D$ such that $\|A-VDV^{-1}\|\le \delta$ using…

Numerical Analysis · Mathematics 2022-07-21 Jess Banks , Jorge Garza-Vargas , Archit Kulkarni , Nikhil Srivastava

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

Computational Complexity · Computer Science 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We apply methods and techniques of tropical optimization to develop a new theoretical and computational framework for the implementation of the Analytic Hierarchy Process in multi-criteria problems of rating alternatives from pairwise…

Optimization and Control · Mathematics 2022-07-11 Nikolai Krivulin , Sergei Sergeev

We present a methodology for generating Ising Hamiltonians of tunable complexity and with a priori known ground states based on a decomposition of the model graph into edge-disjoint subgraphs. The idea is illustrated with a spin-glass model…

Disordered Systems and Neural Networks · Physics 2018-04-17 Firas Hamze , Darryl C. Jacob , Andrew J. Ochoa , Dilina Perera , Wenlong Wang , Helmut G. Katzgraber

The Becchi-Rouet-Stora-Tyutin (BRST) supersymmetry is a powerful tool for the calculation of the complexity of metastable states in glassy systems, and it is particularly useful to uncover the relationships between complexity and standard…

Statistical Mechanics · Physics 2009-11-10 Alessia Annibale , Andrea Cavagna , Irene Giardina , Giorgio Parisi , Elisa Trevigne

We study the statistical estimation problem of orthogonal group synchronization and rotation group synchronization. The model is $Y_{ij} = Z_i^* Z_j^{*T} + \sigma W_{ij}\in\mathbb{R}^{d\times d}$ where $W_{ij}$ is a Gaussian random matrix…

Statistics Theory · Mathematics 2022-04-27 Chao Gao , Anderson Y. Zhang

Let $G_1,\dots,G_m$ be independent copies of the standard gaussian random vector in $\mathbb{R}^d$. We show that there is an absolute constant $c$ such that for any $A \subset S^{d-1}$, with probability at least $1-2\exp(-c\Delta m)$, for…

Probability · Mathematics 2024-11-14 Daniel Bartl , Shahar Mendelson

We reinterpret the Thouless-Anderson-Palmer approach to mean field spin glass models as a variational principle in the spirit of the Gibbs variational principle and the Bragg-Williams approximation. We prove this TAP-Plefka variational…

Probability · Mathematics 2019-04-12 David Belius , Nicola Kistler

In this paper we adapt the broken replica interpolation technique (developed by Francesco Guerra to deal with the Sherrington-Kirkpatrick model, namely a pairwise mean-field spin-glass whose couplings are i.i.d. standard Gaussian variables)…

Mathematical Physics · Physics 2020-06-02 Elena Agliari , Linda Albanese , Adriano Barra , Gabriele Ottaviani

We study numerically the structure of metastable states in the Sherrington-Kirkpatrick spin glass. We find that all non-paramagnetic stationary points of the free energy are organized into pairs, consisting in a minimum and a saddle of…

Statistical Mechanics · Physics 2009-11-10 Andrea Cavagna , Irene Giardina , Giorgio Parisi