English
Related papers

Related papers: Harnessing the Bethe free energy

200 papers

We study a tight Bennett-type concentration inequality for sums of heterogeneous and independent variables, defined as a one-dimensional minimization. We show that this refinement, which outperforms the standard known bounds, remains…

Optimization and Control · Mathematics 2022-11-23 Quentin Jacquet , Riadh Zorgati

We introduce and study a new optimization problem called Hyper Vertex Cover. This problem is a generalization of the standard vertex cover to hypergraphs: one seeks a configuration of particles with minimal density such that every hyperedge…

Statistical Mechanics · Physics 2009-11-13 M. Mézard , M. Tarzia

Propositional satisfiability (SAT) is one of the most fundamental problems in computer science. The worst-case hardness of SAT lies at the core of computational complexity theory. The average-case analysis of SAT has triggered the…

Discrete Mathematics · Computer Science 2019-05-03 Tobias Friedrich , Anton Krohmer , Ralf Rothenberger , Thomas Sauerwald , Andrew M. Sutton

When belief propagation (BP) converges, it does so to a stationary point of the Bethe free energy $F$, and is often strikingly accurate. However, it may converge only to a local optimum or may not converge at all. An algorithm was recently…

Machine Learning · Computer Science 2014-01-03 Adrian Weller , Tony Jebara

In this paper we formulate a general method for building completely integrable quantum systems. The method is based on the use of the so-called multi-parameter spectral equations, i.e. equations with several spectral parameters. We show…

High Energy Physics - Theory · Physics 2007-05-23 Dieter Mayer , Alexander Ushveridze

For interacting classical field theories such as general relativity exact solutions typically can only be found by imposing physically motivated (Killing) {\it symmetry} assumptions. Such highly symmetric solutions are then often used as…

General Relativity and Quantum Cosmology · Physics 2024-04-30 Thomas Thiemann

The number partitioning problem is a classic problem of combinatorial optimization in which a set of $n$ numbers is partitioned into two subsets such that the sum of the numbers in one subset is as close as possible to the sum of the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Christian Borgs , Jennifer Chayes , Stephan Mertens , Chandra Nair

LECTURE GIVEN AT TH2002. Given a set of Boolean variables, and some constraints between them, is it possible to find a configuration of the variables which satisfies all constraints? This problem, which is at the heart of combinatorial…

Disordered Systems and Neural Networks · Physics 2009-11-07 Marc Mezard

Much of the recent work on random constraint satisfaction problems has been inspired by ingenious but non-rigorous approaches from physics. The physics predictions typically come in the form of distributional fixed point problems that are…

Probability · Mathematics 2015-10-08 Victor Bapst , Amin Coja-Oghlan

Many random combinatorial objects have a component structure whose joint distribution is equal to that of a process of mutually independent random variables, conditioned on the value of a weighted sum of the variables. It is interesting to…

Probability · Mathematics 2013-08-16 Richard Arratia , Simon Tavare

Prediction is a central task of statistics and machine learning, yet many inferential settings provide only partial information, typically in the form of moment constraints or estimating equations. We develop a finite, fully Bayesian…

Statistics Theory · Mathematics 2026-03-20 Nicholas G. Polson , Daniel Zantedeschi

We revisit the classical hard-core model, also known as independent set and dual to vertex cover problem, where one puts particles with a first-neighbor hard-core repulsion on the vertices of a random graph. Although the case of random…

Disordered Systems and Neural Networks · Physics 2013-12-17 Jean Barbier , Florent Krzakala , Lenka Zdeborová , Pan Zhang

The dual tasks of quantum Hamiltonian learning and quantum Gibbs sampling are relevant to many important problems in physics and chemistry. In the low temperature regime, algorithms for these tasks often suffer from intractabilities, for…

Many datasets give partial information about an ordering or ranking by indicating which team won a game, which item a user prefers, or who infected whom. We define a continuous spin system whose Gibbs distribution is the posterior…

Artificial Intelligence · Computer Science 2022-06-07 George T. Cantwell , Cristopher Moore

The spontaneous supersymmetry-breaking that takes place in certain spin-glass models signals a particular fragility in the structure of metastable states of such systems. This fragility is due to the presence of at least one marginal mode…

Statistical Mechanics · Physics 2009-11-10 Andrea Cavagna , Irene Giardina , Giorgio Parisi

The statistical mechanics of Gibbs is a juxtaposition of subjective, probabilistic ideas on the one hand and objective, mechanical ideas on the other. In this paper, we follow the path set out by Jaynes, including elements added…

Statistical Mechanics · Physics 2015-11-24 David M. Rogers , Thomas L. Beck , Susan B. Rempe

We provide an explicit formula for the limiting free energy density (log-partition function divided by the number of vertices) for ferromagnetic Potts models on uniformly sparse graph sequences converging locally to the d-regular tree for d…

Probability · Mathematics 2012-07-24 Amir Dembo , Andrea Montanari , Allan Sly , Nike Sun

The Naive-Bayes classifier is widely used due to its simplicity, speed and accuracy. However this approach fails when, for at least one attribute value in a test sample, there are no corresponding training samples with that attribute value.…

Machine Learning · Computer Science 2022-05-31 Patrick Hosein , Kevin Baboolal

This article considers a class of disordered mean-field combinatorial optimization problems. We focus on the Gibbs measure, where the inverse temperature does not vary with the size of the graph and the edge weights are sampled from a…

Probability · Mathematics 2024-02-13 Partha S. Dey , Grigory Terlov

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green