English
Related papers

Related papers: Empirical Evaluation of Approximation Algorithms f…

200 papers

In this work we explore possibilities for coding and decoding tailor-made for mean squared error evaluation of error in contexts such as image transmission. To do so, we introduce a loss function that expresses the overall performance of a…

Information Theory · Computer Science 2014-11-06 Marcelo Firer , Luciano Panek , Jerry Anderson Pinheiro

Loopy and generalized belief propagation are popular algorithms for approximate inference in Markov random fields and Bayesian networks. Fixed points of these algorithms correspond to extrema of the Bethe and Kikuchi free energy. However,…

Machine Learning · Computer Science 2012-12-12 Tom Heskes , Kees Albers , Hilbert Kappen

Recent developments show that Multiply Sectioned Bayesian Networks (MSBNs) can be used for diagnosis of natural systems as well as for model-based diagnosis of artificial systems. They can be applied to single-agent oriented reasoning…

Artificial Intelligence · Computer Science 2013-02-21 Yang Xiang

We consider large-scale linear inverse problems in Bayesian settings. We follow a recent line of work that applies the approximate message passing (AMP) framework to multi-processor (MP) computational systems, where each processor node…

Information Theory · Computer Science 2016-11-09 Junan Zhu , Dror Baron , Ahmad Beirami

Since the classical work of Berlekamp, McEliece and van Tilborg, it is well known that the problem of exact maximum-likelihood (ML) decoding of general linear codes is NP-hard. In this paper, we show that exact ML decoding of a classs of…

Information Theory · Computer Science 2016-11-17 Weiyu Xu , Babak Hassibi

Interior point methods (IPMs) are a common approach for solving linear programs (LPs) with strong theoretical guarantees and solid empirical performance. The time complexity of these methods is dominated by the cost of solving a linear…

Optimization and Control · Mathematics 2022-02-04 Gregory Dexter , Agniva Chowdhury , Haim Avron , Petros Drineas

Probabilistic circuits (PCs) such as sum-product networks efficiently represent large multi-variate probability distributions. They are preferred in practice over other probabilistic representations such as Bayesian and Markov networks…

Machine Learning · Computer Science 2024-02-07 Shivvrat Arya , Tahrima Rahman , Vibhav Gogate

We introduce a novel mechanism to tighten the local polytope relaxation for MAP inference in Markov random fields with low state space variables. We consider a surjection of the variables to a set of hyper-variables and apply the local…

Machine Learning · Computer Science 2018-05-15 Julian Yarkony , Shaofei Wang

Quantum error correction is crucial for universal fault-tolerant quantum computing. Highly accurate and low-time-complexity decoding algorithms play an indispensable role in ensuring quantum error correction works effectively. Among…

Quantum Physics · Physics 2025-07-01 Jiahan Chen , Zhengzhong Yi , Zhipeng Liang , Xuan Wang

The Bethe approximation, or loopy belief propagation algorithm is a successful method for approximating partition functions of probabilistic models associated with a graph. Chertkov and Chernyak derived an interesting formula called Loop…

Discrete Mathematics · Computer Science 2009-11-14 Yusuke Watanabe , Kenji Fukumizu

This paper proposes a quasi-belief propagation decoder for BCH codes that systematically integrates domain knowledge--specifically, channel noise variance, the cyclic property of the codes, and the deliberate redundancy in their…

Information Theory · Computer Science 2026-04-07 Guangwen Li

We consider the general problem of finding the minimum weight $\bm$-matching on arbitrary graphs. We prove that, whenever the linear programming (LP) relaxation of the problem has no fractional solutions, then the belief propagation (BP)…

Information Theory · Computer Science 2015-03-13 Mohsen Bayati , Christian Borgs , Jennifer Chayes , Riccardo Zecchina

In this letter, we develop an efficient linear programming (LP) decoding algorithm for low-density parity-check (LDPC) codes. We first relax the maximum likelihood (ML) decoding problem to a LP problem by using check-node decomposition.…

Information Theory · Computer Science 2019-01-24 Jing Bai , Yongchao Wang , Francis C. M. Lau

This paper presents an efficient parallel approximation scheme for a new class of min-max problems. The algorithm is derived from the matrix multiplicative weights update method and can be used to find near-optimal strategies for…

Quantum Physics · Physics 2015-03-17 Gus Gutoski , Xiaodi Wu

Probabilistic inference algorithms for finding the most probable explanation, the maximum aposteriori hypothesis, and the maximum expected utility and for updating belief are reformulated as an elimination--type algorithm called bucket…

Artificial Intelligence · Computer Science 2013-02-18 Rina Dechter

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

Information Theory · Computer Science 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

Among the many ways to model signals, a recent approach that draws considerable attention is sparse representation modeling. In this model, the signal is assumed to be generated as a random linear combination of a few atoms from a…

Computer Vision and Pattern Recognition · Computer Science 2015-05-18 Javier Turek , Irad Yavneh , Matan Protter , Michael Elad

A low-density parity-check (LDPC) code is a linear block code described by a sparse parity-check matrix, which can be efficiently represented by a bipartite Tanner graph. The standard iterative decoding algorithm, known as belief…

Information Theory · Computer Science 2016-05-17 Sachini Jayasooriya , Sarah J. Johnson , Lawrence Ong , Regina Berretta

We propose a new method called decoupling representation to represent Pauli operators as vectors over $GF(2)$, based on which we propose partially decoupled belief propagation and fully decoupled belief propagation decoding algorithm for…

Quantum Physics · Physics 2023-12-05 Zhengzhong Yi , Zhipeng Liang , Kaixin Zhong , Yulin Wu , Zhou Fang , Xuan Wang

Tree-based demappers for multiple-input multiple-output (MIMO) detection such as the sphere decoder can achieve near-optimal performance but incur high computational cost due to their sequential nature. In this paper, we propose the…

Information Theory · Computer Science 2022-09-12 Daniel E. Worrall , Markus Peschl , Arash Behboodi , Roberto Bondesan