English
Related papers

Related papers: Survey Propagation Revisited

200 papers

This paper studies the form and complexity of inference in graphical models using the abstraction offered by algebraic structures. In particular, we broadly formalize inference problems in graphical models by viewing them as a sequence of…

Artificial Intelligence · Computer Science 2015-05-05 Siamak Ravanbakhsh , Russell Greiner

In this note we study an iterative belief propagation (IBP) algorithm and demonstrate it's ability to solve sparse combinatorial optimization problems. Similar to simulated annealing (SA), our IBP algorithm attempts to sample from the…

Optimization and Control · Mathematics 2024-11-04 Sam Reifenstein , Timothée Leleu

Numerical analysis has no satisfactory method for the more realistic optimization models. However, with constraint programming one can compute a cover for the solution set to arbitrarily close approximation. Because the use of constraint…

Numerical Analysis · Mathematics 2025-10-20 M. H. van Emden , B. Moa

Expectation propagation is a general prescription for approximation of integrals in statistical inference problems. Its literature is mainly concerned with Bayesian inference scenarios. However, expectation propagation can also be used to…

Methodology · Statistics 2018-05-23 P. Hall , I. M. Johnstone , J. T. Ormerod , M. P. Wand , J. C. F. Yu

In this paper, the authors first provide an overview of two major developments on complex survey data analysis: the empirical likelihood methods and statistical inference with non-probability survey samples, and highlight the important…

Methodology · Statistics 2025-08-14 Yilin Chen , Pengfei Li , J. N. K. Rao , Changbao Wu

Causal discovery can be a powerful tool for investigating causality when a system can be observed but is inaccessible to experiments in practice. Despite this, it is rarely used in any scientific or medical fields. One of the major hurdles…

Machine Learning · Statistics 2019-10-07 Erich Kummerfeld , Alexander Rix

It has been proposed by many researchers that combining deep neural networks with graphical models can create more efficient and better regularized composite models. The main difficulties in implementing this in practice are associated with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Patrick Knöbelreiter , Christian Sormann , Alexander Shekhovtsov , Friedrich Fraundorfer , Thomas Pock

As one of the most important types of (weaker) supervised information in machine learning and pattern recognition, pairwise constraint, which specifies whether a pair of data points occur together, has recently received significant…

Computer Vision and Pattern Recognition · Computer Science 2015-02-23 Zhenyong Fu , Zhiwu Lu

In this work, we address the problem of solving a series of underdetermined linear inverse problems subject to a sparsity constraint. We generalize the spike-and-slab prior distribution to encode a priori correlation of the support of the…

Machine Learning · Statistics 2018-01-19 Michael Riis Andersen , Aki Vehtari , Ole Winther , Lars Kai Hansen

We study the susceptibility propagation, a message-passing algorithm to compute correlation functions. It is applied to constraint satisfaction problems and its accuracy is examined. As a heuristic method to find a satisfying assignment, we…

Disordered Systems and Neural Networks · Physics 2010-07-29 Saburo Higuchi , Marc Mézard

The problem of identifying regions of spatially interesting, different or adversarial behavior is inherent to many practical applications involving distributed multisensor systems. In this work, we develop a general framework stemming from…

Signal Processing · Electrical Eng. & Systems 2022-06-14 Martin Gölz , Abdelhak M. Zoubir , Visa Koivunen

This work is intended for researchers in the field of side-channel attacks, countermeasure analysis, and probing security. It reports on a formalization of simulatability in terms of categorical properties, which we think will provide a…

Cryptography and Security · Computer Science 2023-03-02 Vittorio Zaccaria

In pseudo-boolean solving the currently most successful unit propagation strategy is a hybrid mode combining the watched literal scheme with the counting method. This short paper introduces new heuristics for this hybrid decision, which are…

Artificial Intelligence · Computer Science 2025-12-22 Mia Müßig , Jan Johannsen

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

A susceptibility propagation that is constructed by combining a belief propagation and a linear response method is used for approximate computation for Markov random fields. Herein, we formulate a new, improved susceptibility propagation by…

Statistical Mechanics · Physics 2017-12-04 Muneki Yasuda , Kazuyuki Tanaka

Compressive sensing (CS) is an emerging field based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable, sub-Nyquist signal acquisition. When a statistical…

Information Theory · Computer Science 2009-06-25 Dror Baron , Shriram Sarvotham , Richard G. Baraniuk

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing…

Information Theory · Computer Science 2012-12-18 Nima Noorshams , Martin J. Wainwright

Well-spread samples are desirable in many disciplines because they improve estimation when target variables exhibit spatial structure. This paper introduces an integrated methodological framework for spreading samples over the population's…

Methodology · Statistics 2025-10-29 Bardia Panahbehagh , Mehdi Mohebbi , Amir Mohammad HosseiniNasab

An advantage of methods that base inference on a posterior distribution is that credible regions are readily obtained. Except in well-specified situations, however, there is no guarantee that such regions will achieve the nominal…

Methodology · Statistics 2019-06-28 Nicholas Syring , Ryan Martin