English
Related papers

Related papers: Universality of Approximate Message Passing algori…

200 papers

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter

In this paper, we propose a deep learning aided list approximate message passing (AMP) algorithm to further improve the user identification performance in massive machine type communications. A neural network is employed to identify a…

Information Theory · Computer Science 2019-07-24 Bryan Liu , Zhiqiang Wei , Jinhong Yuan , Milutin Pajovic

We introduce the bilinear generalized vector approximate message passing (BiG-VAMP) algorithm which jointly recovers two matrices U and V from their noisy product through a probabilistic observation model. BiG-VAMP provides computationally…

Information Theory · Computer Science 2020-09-16 Mohamed Akrout , Anis Housseini , Faouzi Bellili , Amine Mezghani

The max-product algorithm, a local message-passing scheme that attempts to compute the most probable assignment (MAP) of a given probability distribution, has been successfully employed as a method of approximate inference for applications…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

We consider tensor factorizations using a generative model and a Bayesian approach. We compute rigorously the mutual information, the Minimal Mean Squared Error (MMSE), and unveil information-theoretic phase transitions. In addition, we…

Statistics Theory · Mathematics 2020-01-22 Thibault Lesieur , Léo Miolane , Marc Lelarge , Florent Krzakala , Lenka Zdeborová

Gradient-descent-based algorithms and their stochastic versions have widespread applications in machine learning and statistical inference. In this work we perform an analytic study of the performances of one of them, the Langevin…

We study the problem of estimating a rank one signal matrix from an observed matrix generated by corrupting the signal with additive rotationally invariant noise. We develop a new class of approximate message-passing algorithms for this…

Statistics Theory · Mathematics 2025-09-09 Rishabh Dudeja , Songbin Liu , Junjie Ma

Optimal data detection in multiple-input multiple-output (MIMO) communication systems with a large number of antennas at both ends of the wireless link entails prohibitive computational complexity. In order to reduce the computational…

Information Theory · Computer Science 2015-10-22 Charles Jeon , Ramina Ghods , Arian Maleki , Christoph Studer

We study the performance of a Bayesian statistician who estimates a rank-one signal corrupted by non-symmetric rotationally invariant noise with a generic distribution of singular values. As the signal-to-noise ratio and the noise structure…

Information Theory · Computer Science 2023-02-09 Teng Fu , YuHao Liu , Jean Barbier , Marco Mondelli , ShanSuo Liang , TianQi Hou

In this work we aim to solve the compressed sensing problem for the case of a complex unknown vector by utilizing the Bayesian-optimal structured signal approximate message passing (BOSSAMP) algorithm on the jointly sparse real and…

Information Theory · Computer Science 2015-11-30 Gabor Hannak , Martin Mayer , Gerald Matz , Norbert Goertz

We analyse a linear regression problem with nonconvex regularization called smoothly clipped absolute deviation (SCAD) under an overcomplete Gaussian basis for Gaussian random data. We propose an approximate message passing (AMP) algorithm…

Machine Learning · Statistics 2018-04-04 Ayaka Sakata , Yingying Xu

We propose an estimator of prediction error using an approximate message passing (AMP) algorithm that can be applied to a broad range of sparse penalties. Following Stein's lemma, the estimator of the generalized degrees of freedom, which…

Machine Learning · Statistics 2018-08-01 Ayaka Sakata

Sparse regression codes with approximate message passing (AMP) decoding have gained much attention in recent times. The concepts underlying this coding scheme extend to unsourced random access with coded compressed sensing (CCS), as first…

Information Theory · Computer Science 2020-10-12 Vamsi K. Amalladinne , Asit Kumar Pradhan , Cynthia Rush , Jean-Francois Chamberland , Krishna R. Narayanan

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

In this paper, we study a spiked Wigner problem with an inhomogeneous noise profile. Our aim in this problem is to recover the signal passed through an inhomogeneous low-rank matrix channel. While the information-theoretic performances are…

Machine Learning · Statistics 2023-02-15 Aleksandr Pak , Justin Ko , Florent Krzakala

We consider the problem of recovering a vector $\beta_o \in \mathbb{R}^p$ from $n$ random and noisy linear observations $y= X\beta_o + w$, where $X$ is the measurement matrix and $w$ is noise. The LASSO estimate is given by the solution to…

Statistics Theory · Mathematics 2015-11-05 Ali Mousavi , Arian Maleki , Richard G. Baraniuk

This paper considers a discrete-valued signal estimation scheme based on a low-complexity Bayesian optimal message passing algorithm (MPA) for solving massive linear inverse problems under highly correlated measurements. Gaussian belief…

Signal Processing · Electrical Eng. & Systems 2024-11-14 Tomoharu Furudoi , Takumi Takahashi , Shinsuke Ibi , Hideki Ochiai

Message passing (MP) is a computational technique used to find approximate solutions to a variety of problems defined on networks. MP approximations are generally accurate in locally tree-like networks but require corrections to maintain…

Physics and Society · Physics 2023-09-27 George T. Cantwell , Alec Kirkley , Filippo Radicchi

Message-passing (MP) is a powerful tool for finding an approximate solution in optimization. We generalize it to nonlinear product-sum form, and numerically show the fast convergence for the minimum feedback vertex set and the minimum…

Physics and Society · Physics 2024-04-03 Yukio Hayashi

Purpose: For quantitative susceptibility mapping (QSM), the lack of ground-truth in clinical settings makes it challenging to determine suitable parameters for the dipole inversion. We propose a probabilistic Bayesian approach for QSM with…

Image and Video Processing · Electrical Eng. & Systems 2023-06-01 Shuai Huang , James J. Lah , Jason W. Allen , Deqiang Qiu
‹ Prev 1 8 9 10 Next ›