English
Related papers

Related papers: Fast convergence to an approximate solution by mes…

200 papers

Message passing (MP) is a computational technique used to find approximate solutions to a variety of problems defined on networks. MP approximations are generally accurate in locally tree-like networks but require corrections to maintain…

Physics and Society · Physics 2023-09-27 George T. Cantwell , Alec Kirkley , Filippo Radicchi

Approximate message passing (AMP) is an algorithmic framework for solving linear inverse problems from noisy measurements, with exciting applications such as reconstructing images, audio, hyper spectral images, and various other signals,…

Information Theory · Computer Science 2017-02-13 Junan Zhu , Ryan Pilgrim , Dror Baron

Approximate message passing is an iterative algorithm for compressed sensing and related applications. A solid theory about the performance and convergence of the algorithm exists for measurement matrices having iid entries of zero mean.…

Information Theory · Computer Science 2014-10-03 Francesco Caltagirone , Florent Krzakala , Lenka Zdeborová

A popular approach to the MAP inference problem in graphical models is to minimize an upper bound obtained from a dual linear programming or Lagrangian relaxation by (block-)coordinate descent. This is also known as convex/convergent…

Artificial Intelligence · Computer Science 2024-06-06 Vaclav Voracek , Tomas Werner

We propose and analyze an approximate message passing (AMP) algorithm for the matrix tensor product model, which is a generalization of the standard spiked matrix models that allows for multiple types of pairwise observations over a…

Machine Learning · Statistics 2023-06-28 Riccardo Rossetti , Galen Reeves

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical…

Information Theory · Computer Science 2026-03-12 Sundeep Rangan , Alyson K. Fletcher , Vivek K. Goyal , Evan Byrne , Philip Schniter

Over the last decade or so, Approximate Message Passing (AMP) algorithms have become extremely popular in various structured high-dimensional statistical problems. The fact that the origins of these techniques can be traced back to notions…

Statistics Theory · Mathematics 2021-05-11 Oliver Y. Feng , Ramji Venkataramanan , Cynthia Rush , Richard J. Samworth

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Approximate message-passing (AMP) method is a simple and efficient framework for the linear inverse problems. In this letter, we propose a faster AMP to solve the \emph{$L_1$-Split-Analysis} for the 2D sparsity separation, which is referred…

Information Theory · Computer Science 2015-07-13 Jaewook Kang , Hyoyoung Jung , Kiseon Kim

For the problem of multi-class linear classification and feature selection, we propose approximate message passing approaches to sparse multinomial logistic regression (MLR). First, we propose two algorithms based on the Hybrid Generalized…

Information Theory · Computer Science 2016-09-21 Evan Byrne , Philip Schniter

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the…

Information Theory · Computer Science 2018-10-23 Cynthia Rush , Ramji Venkataramanan

We give a fast, spectral procedure for implementing approximate-message passing (AMP) algorithms robustly. For any quadratic optimization problem over symmetric matrices $X$ with independent subgaussian entries, and any separable AMP…

Data Structures and Algorithms · Computer Science 2024-11-06 Misha Ivkov , Tselil Schramm

Maximum a posteriori (MAP) inference is a fundamental computational paradigm for statistical inference. In the setting of graphical models, MAP inference entails solving a combinatorial optimization problem to find the most likely…

Machine Learning · Computer Science 2020-03-03 Jonathan N. Lee , Aldo Pacchiano , Michael I. Jordan

The max-product algorithm, a local message-passing scheme that attempts to compute the most probable assignment (MAP) of a given probability distribution, has been successfully employed as a method of approximate inference for applications…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

Orthogonal/vector approximate message-passing (AMP) is a powerful message-passing (MP) algorithm for signal reconstruction in compressed sensing. This paper proves the convergence of Bayes-optimal orthogonal/vector AMP in the large system…

Information Theory · Computer Science 2022-04-26 Keigo Takeuchi

We consider large-scale linear inverse problems in Bayesian settings. Our general approach follows a recent line of work that applies the approximate message passing (AMP) framework in multi-processor (MP) computational systems by storing…

Information Theory · Computer Science 2016-11-17 Junan Zhu , Ahmad Beirami , Dror Baron

Various alignment problems arising in cryo-electron microscopy, community detection, time synchronization, computer vision, and other fields fall into a common framework of synchronization problems over compact groups such as Z/L, U(1), or…

Information Theory · Computer Science 2018-09-14 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

Approximate Message Passing (AMP) has been shown to be a superior method for inference problems, such as the recovery of signals from sets of noisy, lower-dimensionality measurements, both in terms of reconstruction accuracy and in…

Information Theory · Computer Science 2015-06-10 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

Vector approximate message passing (VAMP) is an efficient approximate inference algorithm used for generalized linear models. Although VAMP exhibits excellent performance, particularly when measurement matrices are sampled from rotationally…

Information Theory · Computer Science 2025-08-05 Takashi Takahashi , Yoshiyuki Kabashima

Approximate Message Passing (AMP) algorithms are a family of iterative algorithms based on large random matrices with the special property of tracking the statistical properties of their iterates. They are used in various fields such as…

Probability · Mathematics 2025-03-27 Mohammed-Younes Gueddari , Walid Hachem , Jamal Najim
‹ Prev 1 2 3 10 Next ›