中文
相关论文

相关论文: State Evolution for Approximate Message Passing wi…

200 篇论文

We consider the problem of recovering an unknown signal ${\mathbf x}\in {\mathbb R}^n$ from general nonlinear measurements obtained through a generalized linear model (GLM), i.e., ${\mathbf y}= f\left({\mathbf A}{\mathbf x}+{\mathbf…

信息论 · 计算机科学 2022-10-18 Jiang Zhu , Xiangming Meng , Xupeng Lei , Qinghua Guo

Gradient-descent-based algorithms and their stochastic versions have widespread applications in machine learning and statistical inference. In this work we perform an analytic study of the performances of one of them, the Langevin…

We study the compressed sensing reconstruction problem for a broad class of random, band-diagonal sensing matrices. This construction is inspired by the idea of spatial coupling in coding theory. As demonstrated heuristically and…

信息论 · 计算机科学 2015-03-19 David L. Donoho , Adel Javanmard , Andrea Montanari

Generalized Linear Models (GLMs), where a random vector $\mathbf{x}$ is observed through a noisy, possibly nonlinear, function of a linear transform $\mathbf{z}=\mathbf{Ax}$ arise in a range of applications in nonlinear filtering and…

信息论 · 计算机科学 2016-05-03 Sundeep Rangan , Alyson K. Fletcher , Philip Schniter , Ulugbek Kamilov

Compressed sensing, allows to acquire compressible signals with a small number of measurements. In applications, a hardware implementation often requires a calibration as the sensing process is not perfectly known. Blind calibration, that…

统计力学 · 物理学 2021-03-22 Marylou Gabrié , Jean Barbier , Florent Krzakala , Lenka Zdeborová

Generalized approximate message passing (GAMP) is a promising technique for unknown signal reconstruction of generalized linear models (GLM). However, it requires that the transformation matrix has independent and identically distributed…

信息论 · 计算机科学 2021-10-18 Feiyan Tian , Lei Liu , Xiaoming Chen

Generalized approximate message passing (GAMP) is a computationally efficient algorithm for estimating an unknown signal $w_0\in\mathbb{R}^N$ from a random linear measurement $y= Xw_0 + \epsilon\in\mathbb{R}^M$, where…

信息论 · 计算机科学 2025-08-06 Takashi Takahashi

Iterative thresholding algorithms are well-suited for high-dimensional problems in sparse recovery and compressive sensing. The performance of this class of algorithms depends heavily on the tuning of certain threshold parameters. In…

信息论 · 计算机科学 2013-11-04 Ali Mousavi , Arian Maleki , Richard G. Baraniuk

Approximate message passing (AMP) algorithms have shown great promise in sparse signal reconstruction due to their low computational requirements and fast convergence to an exact solution. Moreover, they provide a probabilistic framework…

声音 · 计算机科学 2018-02-02 Turab Iqbal , Wenwu Wang

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

信息论 · 计算机科学 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

Approximate message passing (AMP) is an efficient iterative signal recovery algorithm for compressed sensing (CS). For sensing matrices with independent and identically distributed (i.i.d.) Gaussian entries, the behavior of AMP can be…

信息论 · 计算机科学 2016-10-20 Zhipeng Xue , Junjie Ma , Xiaojun Yuan

The approximate master equation (AME) provides a highly accurate description of dynamical processes on networks, yet its steady states are generally analytically intractable. In this study, we develop an analytical framework to derive the…

物理与社会 · 物理学 2026-05-05 Yu Takiguchi , Takehisa Hasegawa

This paper considers probabilistic estimation of a low-rank matrix from non-linear element-wise measurements of its elements. We derive the corresponding approximate message passing (AMP) algorithm and its state evolution. Relying on…

信息论 · 计算机科学 2016-04-19 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

Signal recovery from unitarily invariant measurements is investigated in this paper. A message-passing algorithm is formulated on the basis of expectation propagation (EP). A rigorous analysis is presented for the dynamics of the algorithm…

信息论 · 计算机科学 2019-05-22 Keigo Takeuchi

We introduce LAMP: the Linear Additive Markov Process. Transitions in LAMP may be influenced by states visited in the distant history of the process, but unlike higher-order Markov processes, LAMP retains an efficient parametrization. LAMP…

机器学习 · 计算机科学 2017-04-06 Ravi Kumar , Maithra Raghu , Tamas Sarlos , Andrew Tomkins

We propose regularized approximate message passing (RAMP), a low-complexity algorithm for discrete signal detection in overloaded multiple-input multiple-output (MIMO) systems where the number of transmit antennas exceeds the number of…

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time…

This paper proves the convergence of Bayes-optimal orthogonal/vector approximate message-passing (AMP) to a fixed point in the large system limit. The proof is based on Bayes-optimal long-memory (LM) message-passing (MP) that is guaranteed…

信息论 · 计算机科学 2022-05-09 Keigo Takeuchi

In a recent work we presented a recursive algorithm to compute the matrix elements of a generic Gaussian transformation in the photon-number basis. Its purpose was to evolve a quantum state by building the transformation matrix and…

量子物理 · 物理学 2021-02-12 Yuan Yao , Filippo M. Miatto

We analyse a linear regression problem with nonconvex regularization called smoothly clipped absolute deviation (SCAD) under an overcomplete Gaussian basis for Gaussian random data. We propose an approximate message passing (AMP) algorithm…

机器学习 · 统计学 2018-04-04 Ayaka Sakata , Yingying Xu