English
Related papers

Related papers: Approximate Message Passing with Consistent Parame…

200 papers

We introduce a theoretical approach for designing generalizations of the approximate message passing (AMP) algorithm for compressed sensing which are valid for large observation matrices that are drawn from an invariant random matrix…

Information Theory · Computer Science 2017-05-12 Burak Çakmak , Manfred Opper , Ole Winther , Bernard H. Fleury

Vector Approximate Message Passing (VAMP) provides the means of solving a linear inverse problem in a Bayes-optimal way assuming the measurement operator is sufficiently random. However, VAMP requires implementing the linear minimum mean…

Information Theory · Computer Science 2022-06-23 Nikolajs Skuratovs , Mike E. Davies

Low-complexity Bayes-optimal memory approximate message passing (MAMP) is an efficient signal estimation algorithm in compressed sensing and multicarrier modulation. However, achieving replica Bayes optimality with MAMP necessitates a…

Information Theory · Computer Science 2024-07-19 Lei Liu , Ming Wang , Shufeng Li , Yuhao Chi , Ning Wei , ZhaoYang Zhang

Deep generative priors are a powerful tool for reconstruction problems with complex data such as images and text. Inverse problems using such models require solving an inference problem of estimating the input and hidden units of the…

Information Theory · Computer Science 2019-03-05 Parthe Pandit , Mojtaba Sahraee , Sundeep Rangan , Alyson K. Fletcher

A signal recovery scheme is developed for linear observation systems based on expectation consistent (EC) mean field approximation. Approximate message passing (AMP) is known to be consistent with the results obtained using the replica…

Information Theory · Computer Science 2014-07-08 Yoshiyuki Kabashima , Mikko Vehkapera

We analyse a linear regression problem with nonconvex regularization called smoothly clipped absolute deviation (SCAD) under an overcomplete Gaussian basis for Gaussian random data. We propose an approximate message passing (AMP) algorithm…

Machine Learning · Statistics 2018-04-04 Ayaka Sakata , Yingying Xu

We study the compressed sensing reconstruction problem for a broad class of random, band-diagonal sensing matrices. This construction is inspired by the idea of spatial coupling in coding theory. As demonstrated heuristically and…

Information Theory · Computer Science 2015-03-19 David L. Donoho , Adel Javanmard , Andrea Montanari

We introduce Tree-AMP, standing for Tree Approximate Message Passing, a python package for compositional inference in high-dimensional tree-structured models. The package provides a unifying framework to study several approximate message…

Machine Learning · Statistics 2023-04-19 Antoine Baker , Benjamin Aubin , Florent Krzakala , Lenka Zdeborová

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex…

Statistics Theory · Mathematics 2023-02-08 Gen Li , Wei Fan , Yuting Wei

Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems. A key feature of the AMP-type algorithms is that their dynamics can be correctly described by state…

Information Theory · Computer Science 2023-07-03 Lei Liu , Shunqi Huang , YuZhi Yang , Zhaoyang Zhang , Brian M. Kurkoski

Orthogonal approximate message-passing (OAMP) is proposed for signal recovery from right-orthogonally invariant linear measurements with spatial coupling. Conventional state evolution is generalized to a unified framework of state evolution…

Information Theory · Computer Science 2023-05-22 Keigo Takeuchi

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Reconstruction of images from noisy linear measurements is a core problem in image processing, for which convex optimization methods based on total variation (TV) minimization have been the long-standing state-of-the-art. We present an…

Information Theory · Computer Science 2016-08-31 Jean Barbier , Eric W. Tramel , Florent Krzakala

Sparse regression codes (SPARCs) are a promising coding scheme that can approach the Shannon limit over Additive White Gaussian Noise (AWGN) channels. Previous works have proven the capacity-achieving property of SPARCs with Gaussian design…

Information Theory · Computer Science 2023-03-16 Yizhou Xu , YuHao Liu , ShanSuo Liang , Tingyi Wu , Bo Bai , Jean Barbier , TianQi Hou

In phase retrieval, the goal is to recover a complex signal from the magnitude of its linear measurements. While many well-known algorithms guarantee deterministic recovery of the unknown signal using i.i.d. random measurement matrices,…

Information Theory · Computer Science 2017-03-24 Boshra Rajaei , Sylvain Gigan , Florent Krzakala , Laurent Daudet

This paper proposes Bayes-optimal convolutional approximate message-passing (CAMP) for signal recovery in compressed sensing. CAMP uses the same low-complexity matched filter (MF) for interference suppression as approximate message-passing…

Information Theory · Computer Science 2021-04-05 Keigo Takeuchi

This is Part II of a two-part work on the estimation for a multi-layer generalized linear model (ML-GLM) in large system limits. In Part I, we had analyzed the asymptotic performance of an exact MMSE estimator, and obtained a set of coupled…

Information Theory · Computer Science 2020-07-21 Qiuyun Zou , Haochuan Zhang , Hongwen Yang

Normal priors with unknown variance (NUV) have long been known to promote sparsity and to blend well with parameter learning by expectation maximization (EM). In this paper, we advocate this approach for linear state space models for…

Information Theory · Computer Science 2016-02-10 Hans-Andrea Loeliger , Lukas Bruderer , Hampus Malmberg , Federico Wadehn , Nour Zalmai

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Approximate Message Passing (AMP) algorithms have seen widespread use across a variety of applications. However, the precise forms for their Onsager corrections and state evolutions depend on properties of the underlying random matrix…

Probability · Mathematics 2021-08-16 Zhou Fan