English
Related papers

Related papers: Role of Bootstrap Averaging in Generalized Approxi…

200 papers

We propose an orthogonal approximate message passing (OAMP) algorithm for signal estimation in the rectangular spiked matrix model with general rotationally invariant (RI) noise. We establish a rigorous state evolution that exactly…

Statistics Theory · Mathematics 2026-02-04 Haohua Chen , Songbin Liu , Junjie Ma

We present a novel compressed sensing recovery algorithm - termed Bayesian Optimal Structured Signal Approximate Message Passing (BOSSAMP) - that jointly exploits the prior distribution and the structured sparsity of a signal that shall be…

Information Theory · Computer Science 2015-08-06 Martin Mayer , Norbert Goertz

High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so far often rely on stringent assumptions regarding the sparsity…

Information Theory · Computer Science 2025-03-20 Daria Tieplova , Samriddha Lahiry , Jean Barbier

In this paper, we propose a practical receiver for multicarrier signals subjected to a strong memoryless nonlinearity. The receiver design is based on a generalized approximate message passing (GAMP) framework, and this allows real-time…

Information Theory · Computer Science 2017-03-07 Sergey V. Zhidkov

Approximate message passing (AMP) emerges as an effective iterative paradigm for solving high-dimensional statistical problems. However, prior AMP theory -- which focused mostly on high-dimensional asymptotics -- fell short of predicting…

Statistics Theory · Mathematics 2023-03-20 Gen Li , Yuting Wei

Sparse superposition (SS) codes were originally proposed as a capacity-achieving communication scheme over the additive white Gaussian noise channel (AWGNC) [1]. Very recently, it was discovered that these codes are universal, in the sense…

Information Theory · Computer Science 2020-06-05 Erdem Biyik , Jean Barbier , Mohamad Dia

Generalized Linear Models (GLMs), where a random vector $\mathbf{x}$ is observed through a noisy, possibly nonlinear, function of a linear transform $\mathbf{z}=\mathbf{Ax}$ arise in a range of applications in nonlinear filtering and…

Information Theory · Computer Science 2016-05-03 Sundeep Rangan , Alyson K. Fletcher , Philip Schniter , Ulugbek Kamilov

Conformal prediction has emerged as a powerful tool for building prediction intervals that are valid in a distribution-free way. However, its evaluation may be computationally costly, especially in the high-dimensional setting where the…

Machine Learning · Statistics 2025-11-13 Lucas Clarté , Lenka Zdeborová

We propose regularized approximate message passing (RAMP), a low-complexity algorithm for discrete signal detection in overloaded multiple-input multiple-output (MIMO) systems where the number of transmit antennas exceeds the number of…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Shreesal Shrestha , Getuar Rexhepi , Kuranage Roche Rayan Ranasinghe , Hyeon Seok Rou , Giuseppe Thadeu Freitas de Abreu

Approximate Message Passing (AMP) is a class of iterative algorithms that have found applications in many problems in high-dimensional statistics and machine learning. In its general form, AMP can be formulated as an iterative procedure…

Probability · Mathematics 2023-05-02 Rishabh Dudeja , Yue M. Lu , Subhabrata Sen

Mean-field characterizations of first-order iterative algorithms -- including Approximate Message Passing (AMP), stochastic and proximal gradient descent, and Langevin diffusions -- have enabled a precise understanding of learning dynamics…

Statistics Theory · Mathematics 2025-07-01 Max Lovig , Tianhao Wang , Zhou Fan

Motivated by the recent interest in approximate message passing (AMP) for matrix-valued linear observations with superposition of \emph{multiple statistically asymmetric signal sources}, we introduce a multi-source AMP framework in which…

Information Theory · Computer Science 2025-01-22 Burak Çakmak , Giuseppe Caire

In phase retrieval, the goal is to recover a signal $\mathbf{x}\in\mathbb{C}^N$ from the magnitudes of linear measurements $\mathbf{Ax}\in\mathbb{C}^M$. While recent theory has established that $M\approx 4N$ intensity measurements are…

Information Theory · Computer Science 2015-06-19 Philip Schniter , Sundeep Rangan

We study the problem of regression in a generalized linear model (GLM) with multiple signals and latent variables. This model, which we call a matrix GLM, covers many widely studied problems in statistical learning, including mixed linear…

Machine Learning · Statistics 2024-04-10 Nelvin Tan , Ramji Venkataramanan

When recovering a sparse signal from noisy compressive linear measurements, the distribution of the signal's non-zero coefficients can have a profound effect on recovery mean-squared error (MSE). If this distribution was apriori known, then…

Information Theory · Computer Science 2015-06-05 Jeremy P. Vila , Philip Schniter

This paper proposes two distinct contributions to econometric analysis of large information sets and structural instabilities. First, it treats a regression model with time-varying coefficients, stochastic volatility and exogenous…

Methodology · Statistics 2020-04-27 Dimitris Korobilis

Approximate Message Passing (AMP) algorithms have seen widespread use across a variety of applications. However, the precise forms for their Onsager corrections and state evolutions depend on properties of the underlying random matrix…

Probability · Mathematics 2021-08-16 Zhou Fan

We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appealing features: the…

Machine Learning · Statistics 2021-02-18 Marco Mondelli , Ramji Venkataramanan

To support complex communication scenarios in next-generation wireless communications, this paper focuses on a generalized MIMO (GMIMO) with practical assumptions, such as massive antennas, practical channel coding, arbitrary input…

Information Theory · Computer Science 2023-11-08 Yufei Chen , Lei Liu , Yuhao Chi , Ying Li , Zhaoyang Zhang

We consider the problem of localizing change points in a generalized linear model (GLM), a model that covers many widely studied problems in statistical learning including linear, logistic, and rectified linear regression. We propose a…

Machine Learning · Statistics 2025-09-08 Gabriel Arpino , Xiaoqi Liu , Julia Gontarek , Ramji Venkataramanan