中文
相关论文

相关论文: The Overlap Gap Property and Approximate Message P…

200 篇论文

Approximate Message Passing (AMP) algorithms have seen widespread use across a variety of applications. However, the precise forms for their Onsager corrections and state evolutions depend on properties of the underlying random matrix…

概率论 · 数学 2021-08-16 Zhou Fan

Consider the problem of estimating a low-rank matrix when its entries are perturbed by Gaussian noise. If the empirical distribution of the entries of the spikes is known, optimal estimators that exploit this knowledge can substantially…

统计理论 · 数学 2019-08-08 Andrea Montanari , Ramji Venkataramanan

We study a class of Approximate Message Passing (AMP) algorithms for symmetric and rectangular spiked random matrix models with orthogonally invariant noise. The AMP iterates have fixed dimension $K \geq 1$, a multivariate non-linearity is…

统计理论 · 数学 2024-06-14 Xinyi Zhong , Tianhao Wang , Zhou Fan

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform…

信息论 · 计算机科学 2022-06-24 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Approximate Message Passing (AMP) algorithms are a family of iterative algorithms based on large random matrices with the special property of tracking the statistical properties of their iterates. They are used in various fields such as…

概率论 · 数学 2025-03-27 Mohammed-Younes Gueddari , Walid Hachem , Jamal Najim

SLOPE is a relatively new convex optimization procedure for high-dimensional linear regression via the sorted l1 penalty: the larger the rank of the fitted coefficient, the larger the penalty. This non-separable penalty renders many…

机器学习 · 统计学 2019-07-18 Zhiqi Bu , Jason Klusowski , Cynthia Rush , Weijie Su

This paper addresses the reconstruction of sparse signals from generalized linear measurements. Signal sparsity is assumed to be sublinear in the signal dimension while it was proportional to the signal dimension in conventional research.…

信息论 · 计算机科学 2026-04-13 Keigo Takeuchi

This paper introduces a framework for approximate message passing (AMP) in dynamic settings where the data at each iteration is passed through a linear operator. This framework is motivated in part by applications in large-scale,…

统计理论 · 数学 2026-01-19 Riccardo Rossetti , Bobak Nazer , Galen Reeves

Approximate Message Passing (AMP) algorithms are a class of iterative procedures for computationally-efficient estimation in high-dimensional inference and estimation tasks. Due to the presence of an 'Onsager' correction term in its…

统计理论 · 数学 2023-02-02 Collin Cademartori , Cynthia Rush

In the pooled data problem, the goal is to identify the categories associated with a large collection of items via a sequence of pooled tests. Each pooled test reveals the number of items of each category within the pool. We study an…

信息论 · 计算机科学 2024-10-25 Nelvin Tan , Pablo Pascual Cobo , Jonathan Scarlett , Ramji Venkataramanan

Approximate message passing (AMP) methods and their variants have attracted considerable recent attention for the problem of estimating a random vector $\mathbf{x}$ observed through a linear transform $\mathbf{A}$. In the case of large…

信息论 · 计算机科学 2018-03-05 Sundeep Rangan , Philip Schniter , Alyson K. Fletcher , Subrata Sarkar

We consider the problem of signal estimation in generalized linear models defined via rotationally invariant design matrices. Since these matrices can have an arbitrary spectral distribution, this model is well suited for capturing complex…

机器学习 · 统计学 2022-06-10 Ramji Venkataramanan , Kevin Kögler , Marco Mondelli

The Approximate Message Passing (AMP) algorithm efficiently reconstructs signals which have been sampled with large i.i.d. sub-Gaussian sensing matrices. Central to AMP is its "state evolution", which guarantees that the difference between…

信号处理 · 电气工程与系统科学 2020-09-08 Charles Millard , Aaron T Hess , Boris Mailhé , Jared Tanner

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

机器学习 · 统计学 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

In a streaming constraint satisfaction problem (streaming CSP), a $p$-pass algorithm receives the constraints of an instance sequentially, making $p$ passes over the input in a fixed order, with the goal of approximating the maximum…

计算复杂性 · 计算机科学 2026-04-06 Yumou Fei , Dor Minzer , Shuo Wang

Approximate Message Passing (AMP) has been shown to be a superior method for inference problems, such as the recovery of signals from sets of noisy, lower-dimensionality measurements, both in terms of reconstruction accuracy and in…

信息论 · 计算机科学 2015-06-10 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

Vector approximate message passing (VAMP) is an efficient approximate inference algorithm used for generalized linear models. Although VAMP exhibits excellent performance, particularly when measurement matrices are sampled from rotationally…

信息论 · 计算机科学 2025-08-05 Takashi Takahashi , Yoshiyuki Kabashima

We study the problem of regression in a generalized linear model (GLM) with multiple signals and latent variables. This model, which we call a matrix GLM, covers many widely studied problems in statistical learning, including mixed linear…

机器学习 · 统计学 2024-04-10 Nelvin Tan , Ramji Venkataramanan

This paper presents a unified framework for constructing Approximate Message Passing (AMP) algorithms for rotationally-invariant models. By employing a general iterative algorithm template and reducing it to long-memory Orthogonal AMP…

统计理论 · 数学 2024-12-03 Songbin Liu , Junjie Ma

For the problem of binary linear classification and feature selection, we propose algorithmic approaches to classifier design based on the generalized approximate message passing (GAMP) algorithm, recently proposed in the context of…

信息论 · 计算机科学 2015-06-18 Justin Ziniel , Philip Schniter , Per Sederberg