中文
相关论文

相关论文: Memory-free dynamics for the TAP equations of Isin…

200 篇论文

This paper presents a unified framework for constructing Approximate Message Passing (AMP) algorithms for rotationally-invariant models. By employing a general iterative algorithm template and reducing it to long-memory Orthogonal AMP…

统计理论 · 数学 2024-12-03 Songbin Liu , Junjie Ma

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

机器学习 · 计算机科学 2020-08-26 Burak Çakmak , Manfred Opper

Stochastic nonlinear dynamical systems can undergo rapid transitions relative to the change in their forcing, for example due to the occurrence of multiple equilibrium solutions for a specific interval of parameters. In this paper, we…

数据分析、统计与概率 · 物理学 2020-11-12 S. Baars , D. Castellana , F. W. Wubs , H. A. Dijkstra

Improving the predictive accuracy of a dynamics model is crucial to obtaining good control performance and safety from Model Predictive Controllers (MPC). One approach involves learning unmodelled (residual) dynamics, in addition to nominal…

系统与控制 · 电气工程与系统科学 2025-11-19 Leroy D'Souza , Yash Vardhan Pant , Sebastian Fischmeister

We adapted the SWAP molecular dynamics algorithm for use in lattice Ising spin models. We dressed the spins with a randomly distributed length and we alternated long-range spin exchanges with conventional single spin flip Monte Carlo…

统计力学 · 物理学 2025-10-14 Greivin Alfaro Miranda , Leticia F. Cugliandolo , Marco Tarzia

We study cellular automata where the state at each site is decided by a majority vote of the sites in its neighborhood. These are equivalent, for a restricted set of initial conditions, to non-zero probability transitions in single…

统计力学 · 物理学 2009-10-30 Cristopher Moore

In this paper, we address the problem of how many randomly labeled patterns can be correctly classified by a single-layer perceptron when the patterns are correlated with each other. In order to solve this problem, two analytical schemes…

无序系统与神经网络 · 物理学 2016-12-15 Takashi Shinzato , Yoshiyuki Kabashima

We study the temperature structure of the naive TAP equations by mean of a recursion algorithm. The problem of the chaos in temperature is addressed using the notion of the temperature evolution of equilibrium states. The lowest free energy…

无序系统与神经网络 · 物理学 2009-10-31 R. Mulet , A. Pagnani , G. Parisi

Sampling Boltzmann probability distributions plays a key role in machine learning and optimization, motivating the design of hardware accelerators such as Ising machines. While the Ising model can in principle encode arbitrary optimization…

机器学习 · 计算机科学 2025-08-01 Corentin Delacour , M Mahmudul Hasan Sajeeb , Joao P. Hespanha , Kerem Y. Camsari

We present a new method to close the Master Equation representing the continuous time dynamics of Ising interacting spins. The method makes use of the the theory of Random Point Processes to derive a master equation for local conditional…

无序系统与神经网络 · 物理学 2017-05-17 Erik Aurell , Gino Del Ferraro , Eduardo Dominguez , Roberto Mulet

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

机器学习 · 统计学 2017-12-22 Christian Donner , Manfred Opper

We construct a model of short-range interacting Ising spins on a translationally invariant two-dimensional lattice that mimics a reversible circuit that multiplies or factorizes integers, depending on the choice of boundary conditions. We…

We solve the Thouless-Anderson-Palmer (TAP) variational principle associated to the spherical pure $p$-spin mean field spin glass Hamiltonian and present a detailed phase diagram. In the high temperature phase the maximum of variational…

无序系统与神经网络 · 物理学 2022-07-07 David Belius , Marius A. Schmidt

We study metastability and mixing time for a non-reversible probabilistic cellular automaton. With a suitable choice of the parameters, we first show that the stationary distribution is close in total variation to a low temperature Ising…

概率论 · 数学 2014-07-25 Paolo Dai Pra , Benedetto Scoppola , Elisabetta Scoppola

We study analytically the performance of a recently proposed algorithm for learning the couplings of a random asymmetric kinetic Ising model from finite length trajectories of the spin dynamics. Our analysis shows the importance of the…

无序系统与神经网络 · 物理学 2015-09-30 Ludovica Bachschmid-Romano , Manfred Opper

Iterative thresholding algorithms are well-suited for high-dimensional problems in sparse recovery and compressive sensing. The performance of this class of algorithms depends heavily on the tuning of certain threshold parameters. In…

信息论 · 计算机科学 2013-11-04 Ali Mousavi , Arian Maleki , Richard G. Baraniuk

We study estimation in the linear model $y=A\beta^\star+\epsilon$, in a Bayesian setting where $\beta^\star$ has an entrywise i.i.d. prior and the design $A$ is rotationally-invariant in law. In the large system limit as dimension and…

信息论 · 计算机科学 2022-12-22 Yufan Li , Zhou Fan , Subhabrata Sen , Yihong Wu

We consider the Sherrington-Kirkpatrick model of spin glasses with ferromagnetically biased couplings. For a specific choice of the couplings mean, the resulting Gibbs measure is equivalent to the Bayesian posterior for a high-dimensional…

概率论 · 数学 2020-03-27 Zhou Fan , Song Mei , Andrea Montanari

In ill-posed dynamic inverse problems expected spatial features and temporal correlation between frames can be leveraged to improve the quality of the computed solution, in particular when the available data are limited and the…

We compute the complexity (logarithm of the number of TAP states) associated with minima and index-one saddle points of the TAP free energy. Higher-index saddles have smaller complexities. The two leading complexities are equal, consistent…

无序系统与神经网络 · 物理学 2009-11-10 T. Aspelmeier , A. J. Bray , M. A. Moore