English
Related papers

Related papers: Phase Diagram and Approximate Message Passing for …

200 papers

The implementation of computational sensing strategies often faces calibration problems typically solved by means of multiple, accurately chosen training signals, an approach that can be resource-consuming and cumbersome. Conversely, blind…

Information Theory · Computer Science 2017-02-17 Valerio Cambareri , Laurent Jacques

The generalized approximate message passing (GAMP) algorithm is an efficient method of MAP or approximate-MMSE estimation of $x$ observed from a noisy version of the transform coefficients $z = Ax$. In fact, for large zero-mean i.i.d…

Information Theory · Computer Science 2015-08-11 Jeremy Vila , Philip Schniter , Sundeep Rangan , Florent Krzakala , Lenka Zdeborova

In the dictionary learning (or sparse coding) problem, we are given a collection of signals (vectors in $\mathbb{R}^d$), and the goal is to find a "basis" in which the signals have a sparse (approximate) representation. The problem has…

Machine Learning · Computer Science 2019-05-30 Aditya Bhaskara , Wai Ming Tai

We consider the problem of calibrating a compressed sensing measurement system under the assumption that the decalibration consists in unknown gains on each measure. We focus on {\em blind} calibration, using measures performed on a few…

Statistics Theory · Mathematics 2011-12-01 Rémi Gribonval , Gilles Chardon , Laurent Daudet

We propose and analyze an approximate message passing (AMP) algorithm for the matrix tensor product model, which is a generalization of the standard spiked matrix models that allows for multiple types of pairwise observations over a…

Machine Learning · Statistics 2023-06-28 Riccardo Rossetti , Galen Reeves

Calibration of sensors is a major challenge especially in inexpensive sensors and sensors installed in inaccessible locations. The feasibility of calibrating sensors without the need for a standard sensor is called blind calibration. There…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Amit Kumar Mishra

Generalized linear models (GLMs) arise in high-dimensional machine learning, statistics, communications and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing,…

Information Theory · Computer Science 2019-04-01 Jean Barbier , Florent Krzakala , Nicolas Macris , Léo Miolane , Lenka Zdeborová

Generalised approximate message passing (GAMP) is an approximate Bayesian estimation algorithm for signals observed through a linear transform with a possibly non-linear subsequent measurement model. By leveraging prior information about…

Signal Processing · Electrical Eng. & Systems 2018-12-05 Christian Schou Oxvig , Thomas Arildsen

We study phase retrieval from magnitude measurements of an unknown signal as an algebraic estimation problem. Indeed, phase retrieval from rank-one and more general linear measurements can be treated in an algebraic way. It is verified that…

Functional Analysis · Mathematics 2014-02-18 Franz J Király , Martin Ehler

Mean field-like approximations (including naive mean field, Bethe and Kikuchi and more general Cluster Variational Methods) are known to stabilize ordered phases at temperatures higher than the thermodynamical transition. For example, in…

Disordered Systems and Neural Networks · Physics 2015-06-22 A. Lage-Castellanos , R. Mulet , F. Ricci-Tersenghi

Phase retrieval refers to the problem of recovering a high-dimensional vector $\boldsymbol{x} \in \mathbb{C}^N$ from the magnitude of its linear transform $\boldsymbol{z} = A \boldsymbol{x}$, observed through a noisy channel. To improve the…

Computation · Statistics 2024-10-10 Hajime Ueda , Shun Katakami , Masato Okada

We revisit the error correction scheme of real-valued signals when the codeword is corrupted by gross errors on a fraction of entries and a small noise on all the entries. Combining the recent developments of approximate message passing and…

Information Theory · Computer Science 2014-02-04 Jean Barbier , Florent Krzakala , Lenka Zdeborová , Pan Zhang

We address the problem of blind gain and phase calibration of a sensor array from ambient noise. The key motivation is to ease the calibration process by avoiding a complex procedure setup. We show that computing the sample covariance…

Instrumentation and Detectors · Physics 2023-03-22 Charles Vanwynsberghe , Simon Bouley , Jérôme Antoni

We propose regularized approximate message passing (RAMP), a low-complexity algorithm for discrete signal detection in overloaded multiple-input multiple-output (MIMO) systems where the number of transmit antennas exceeds the number of…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Shreesal Shrestha , Getuar Rexhepi , Kuranage Roche Rayan Ranasinghe , Hyeon Seok Rou , Giuseppe Thadeu Freitas de Abreu

We present a method for blind acoustic parameter estimation from single-channel reverberant speech. The method is structured into three stages. In the first stage, a variational auto-encoder is trained to extract latent representations of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Philipp Götz , Cagdas Tuna , Andreas Brendel , Andreas Walther , Emanuël A. P. Habets

We consider tensor factorizations using a generative model and a Bayesian approach. We compute rigorously the mutual information, the Minimal Mean Squared Error (MMSE), and unveil information-theoretic phase transitions. In addition, we…

Statistics Theory · Mathematics 2020-01-22 Thibault Lesieur , Léo Miolane , Marc Lelarge , Florent Krzakala , Lenka Zdeborová

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the…

Information Theory · Computer Science 2018-10-23 Cynthia Rush , Ramji Venkataramanan

Message-passing (MP) is a powerful tool for finding an approximate solution in optimization. We generalize it to nonlinear product-sum form, and numerically show the fast convergence for the minimum feedback vertex set and the minimum…

Physics and Society · Physics 2024-04-03 Yukio Hayashi

Despite the widespread use and success of machine-learning techniques for detecting phase transitions from data, their working principle and fundamental limits remain elusive. Here, we explain the inner workings and identify potential…

Disordered Systems and Neural Networks · Physics 2023-11-20 Julian Arnold , Niels Lörch , Flemming Holtorf , Frank Schäfer

Gaussian and quadratic approximations of message passing algorithms on graphs have attracted considerable recent attention due to their computational simplicity, analytic tractability, and wide applicability in optimization and statistical…

Information Theory · Computer Science 2026-03-12 Sundeep Rangan , Alyson K. Fletcher , Vivek K. Goyal , Evan Byrne , Philip Schniter