English
Related papers

Related papers: AMP algorithms and Stein's method: Understanding T…

200 papers

The demand for precision predictions in the field of high energy physics has dramatically increased over recent years. Experiments conducted at the LHC, as well as precision measurements at the intensity frontier such as Belle II require…

High Energy Physics - Phenomenology · Physics 2022-09-28 Marvin Gerlach , Florian Herren , Martin Lang

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical…

Information Theory · Computer Science 2026-03-12 Sundeep Rangan , Alyson K. Fletcher , Vivek K. Goyal , Evan Byrne , Philip Schniter

A mean field spherical model with random couplings between pairs, quartets, and possibly higher multiplets of spins is considered. It has the same critical behavior as the Sherrington-Kirkpatrick model. It thus exhibits replica symmetry…

Condensed Matter · Physics 2009-10-22 Th. M. Nieuwenhuizen

Anderson mixing (AM) is an acceleration method for fixed-point iterations. Despite its success and wide usage in scientific computing, the convergence theory of AM remains unclear, and its applications to machine learning problems are not…

Machine Learning · Computer Science 2021-10-05 Fuchao Wei , Chenglong Bao , Yang Liu

We examine the behavior of the 2-spin spherical Sherrington-Kirkpatrick model with an external field by analyzing the overlap of a spin with the external field. Previous research has noted that, at low temperature, this overlap exhibits…

Probability · Mathematics 2022-11-21 Elizabeth Collins-Woodfin

We address the numerical solution via Galerkin type methods of the Monge-Amp\`ere equation with transport boundary conditions arising in optimal mass transport, geometric optics and computational mesh or grid movement techniques. This fully…

Numerical Analysis · Mathematics 2018-08-27 Ellya Kawecki , Omar Lakkis , Tristan Pryer

Second-order optimization methods have desirable convergence properties. However, the exact Newton method requires expensive computation for the Hessian and its inverse. In this paper, we propose SPAN, a novel approximate and fast Newton…

Optimization and Control · Mathematics 2020-03-04 Xunpeng Huang , Xianfeng Liang , Zhengyang Liu , Yitan Li , Linyun Yu , Yue Yu , Lei Li

Efficient topology optimization based on the adaptive auxiliary reduced model reanalysis (AARMR) is proposed to improve computational efficiency and scale. In this method, a projection auxiliary reduced model (PARM) is integrated into the…

Computational Engineering, Finance, and Science · Computer Science 2023-01-04 Jichao Yin , Hu Wang , Shuhao Li , Daozhen Guo

We study the problem of chaos in temperature in some mean-field spin-glass models by means of a replica computation over a model of coupled systems. We propose a set of solutions of the saddle point equations which are intrinsically…

Disordered Systems and Neural Networks · Physics 2009-11-07 Tommaso Rizzo

By numerically solving the Schr\"oedinger equation for small sizes we investigate the quantum critical point of the infinite-range Ising spin glass in a transverse field at zero temperature. Despite its simplicity the method yields accurate…

Disordered Systems and Neural Networks · Physics 2009-10-28 David Lancaster , Felix Ritort

The free energy of TAP-solutions for the SK-model of mean field spin glasses can be expressed as a nonlinear functional of local terms: we exploit this feature in order to contrive abstract REM-like models which we then solve by a classical…

Disordered Systems and Neural Networks · Physics 2023-07-19 Nicola Kistler , Marius Alexander Schmidt , Giulia Sebastiani

Recently, in the context of covariance matrix estimation, in order to improve as well as to regularize the performance of the Tyler's estimator [1] also called the Fixed-Point Estimator (FPE) [2], a "shrinkage" fixed-point estimator has…

Applications · Statistics 2015-06-18 Frederic Pascal , Yacine Chitour , Yihui Quek

We propose and analyze an approximate message passing (AMP) algorithm for the matrix tensor product model, which is a generalization of the standard spiked matrix models that allows for multiple types of pairwise observations over a…

Machine Learning · Statistics 2023-06-28 Riccardo Rossetti , Galen Reeves

The inverse Ising problem consists in inferring the coupling constants of an Ising model given the correlation matrix. The fastest methods for solving this problem are based on mean-field approximations, but which one performs better in the…

Disordered Systems and Neural Networks · Physics 2012-08-28 Federico Ricci-Tersenghi

We consider the algorithmic problem of finding a near ground state (near optimal solution) of a $p$-spin model. We show that for a class of algorithms broadly defined as Approximate Message Passing (AMP), the presence of the Overlap Gap…

Probability · Mathematics 2019-11-27 David Gamarnik , Aukosh Jagannath

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

In this paper a multi-scale version of the Sherrington and Kirkpatrick model is introduced and studied. The pressure per particle in the thermodynamical limit is proved to obey a variational principle of Parisi type. The result is achieved…

Mathematical Physics · Physics 2019-02-20 Pierluigi Contucci , Emanuele Mingione

The Quantum Approximate Optimisation Algorithm is a $p$ layer, time-variable split operator method executed on a quantum processor and driven to convergence by classical outer loop optimisation. The classical co-processor varies individual…

Quantum Physics · Physics 2022-07-28 D. Rabinovich , R. Sengupta , E. Campos , V. Akshay , J. Biamonte

We employ Statistical Field Theory techniques for coarse-graining the steady-state properties of Active Ornstein-Uhlenbeck particles. The computation is carried on in the framework of the Unified Colored Noise approximation that allows an…

Statistical Mechanics · Physics 2020-05-27 Matteo Paoluzzi , Claudio Maggi , Andrea Crisanti

The Quantum Approximate Optimization Algorithm (QAOA) is a general-purpose algorithm for combinatorial optimization problems whose performance can only improve with the number of layers $p$. While QAOA holds promise as an algorithm that can…

Quantum Physics · Physics 2022-07-08 Edward Farhi , Jeffrey Goldstone , Sam Gutmann , Leo Zhou