English
Related papers

Related papers: High-temperature Expansions and Message Passing Al…

200 papers

We analyze the perceptron model performing a Plefka-like expansion of the free energy. This model falls in the same universality class as hard spheres near jamming, allowing to get exact predictions in high dimensions for more complex…

Disordered Systems and Neural Networks · Physics 2018-01-09 Ada Altieri

Recently we extended Approximate message passing (AMP) algorithm to be able to handle general invariant matrix ensembles. In this contribution we extend our S-AMP approach to non-linear observation models. We obtain generalized AMP (GAMP)…

Information Theory · Computer Science 2015-01-27 Burak Çakmak , Ole Winther , Bernard H. Fleury

Parallel tempering, or replica exchange, is a popular method for simulating complex systems. The idea is to run parallel simulations at different temperatures, and at a given swap rate exchange configurations between the parallel…

Probability · Mathematics 2016-04-20 J. D. Doll , Paul Dupuis , Pierre Nyquist

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We consider dictionary learning and blind calibration for signals and matrices created from a random ensemble. We study the mean-squared error in the limit of large signal dimension using the replica method and unveil the appearance of…

Information Theory · Computer Science 2014-02-04 Florent Krzakala , Marc Mézard , Lenka Zdeborová

In this communication, the derivation of the Boltzmann-Gibbs and the Maxwellian distributions is presented from a geometrical point of view under the hypothesis of equiprobability. It is shown that both distributions can be obtained by…

Chaotic Dynamics · Physics 2010-01-20 Ricardo Lopez-Ruiz , Jaime Sanudo , Xavier Calbet

Extending the transfer matrix DMRG algorithm, we are able to calculate imaginary time spin autocorrelations with high accuracy (absolute error $<10^{-6}$) over a wide temperature range ($0<\beta J<20$). After analytic continuation using the…

Strongly Correlated Electrons · Physics 2007-05-23 F. Naef X. Wang , X. Zotos , W. von der Linden

In this paper we apply the formalism of translation invariant (continuous) matrix product states in the thermodynamic limit to $(1+1)$ dimensional critical models. Finite bond dimension bounds the entanglement entropy and introduces an…

Quantum Physics · Physics 2015-06-18 Vid Stojevic , Jutho Haegeman , I. P. McCulloch , L. Tagliacozzo , Frank Verstraete

Approximate message passing (AMP) is a scalable, iterative approach to signal recovery. For structured random measurement ensembles, including independent and identically distributed (i.i.d.) Gaussian and rotationally-invariant matrices,…

Information Theory · Computer Science 2023-06-27 Dang Qua Nguyen , Taejoon Kim

This article considers a class of disordered mean-field combinatorial optimization problems. We focus on the Gibbs measure, where the inverse temperature does not vary with the size of the graph and the edge weights are sampled from a…

Probability · Mathematics 2024-02-13 Partha S. Dey , Grigory Terlov

Predicting and characterizing phase transitions is crucial for understanding generic physical phenomena such as crystallization, protein folding and others. However, directly observing phase transitions is not always easy, and often one has…

Statistical Mechanics · Physics 2025-03-20 Suemin Lee , Ruiyu Wang , Lukas Herron , Pratyush Tiwary

Parallel tempering, also known as replica exchange sampling, is an important method for simulating complex systems. In this algorithm simulations are conducted in parallel at a series of temperatures, and the key feature of the algorithm is…

Probability · Mathematics 2012-06-14 Paul Dupuis , Yufei Liu , Nuria Plattner , J. D. Doll

We provide a rigorous and asymptotically exact expression of the mutual information of translationally invariant free fermionic lattice systems in a Gibbs state. In order to arrive at this result, we introduce a novel frameworkfor computing…

Quantum Physics · Physics 2015-06-12 H. Bernigau , M. J. Kastoryano , J. Eisert

The Lipkin-Meshkov-Glick model is used to examine the validity of some approximate methods in a many-body theory at finite temperatures. Namely, the thermal random phase approximation (TRPA) and the thermal renormalized random phase…

Nuclear Theory · Physics 2007-05-23 A. N. Storozhenko , D. S. Kosov , A. I. Vdovin

New sampling algorithms based on simulating continuous-time stochastic processes called piece-wise deterministic Markov processes (PDMPs) have shown considerable promise. However, these methods can struggle to sample from multi-modal or…

Methodology · Statistics 2022-05-31 Matthew Sutton , Robert Salomone , Augustin Chevallier , Paul Fearnhead

We develop the strong coupling quantum thermodynamics based on the solution of the exact master equation. We find that both the Hamiltonian and the temperature must be renormalized due to the system-reservoir couplings. With the…

Quantum Physics · Physics 2020-10-06 Wei-Ming Huang , Wei-Min Zhang

Using the scaling relation of the ground state quantum fidelity, we propose the most generic scaling relations of the irreversible work (the residual energy) of a closed quantum system at absolute zero temperature when one of the parameters…

Statistical Mechanics · Physics 2015-09-02 Shraddha Sharma , Amit Dutta

The max-product algorithm, a local message-passing scheme that attempts to compute the most probable assignment (MAP) of a given probability distribution, has been successfully employed as a method of approximate inference for applications…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

In this work we propose a novel iterative estimation algorithm for linear observation systems called S-AMP whose fixed points are the stationary points of the exact Gibbs free energy under a set of (first- and second-) moment consistency…

Information Theory · Computer Science 2014-05-13 Burak Çakmak , Ole Winther , Bernard H. Fleury

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli