中文
相关论文

相关论文: Mixed Regression via Approximate Message Passing

200 篇论文

This letter proposes a novel message-passing algorithm for signal recovery in compressed sensing. The proposed algorithm solves the disadvantages of approximate message-passing (AMP) and orthogonal/vector AMP, and realizes their advantages.…

信息论 · 计算机科学 2020-04-22 Keigo Takeuchi

In this paper, we address the problem of recovering complex-valued signals from a set of complex-valued linear measurements. Approximate message passing (AMP) is one state-of-the-art algorithm to recover real-valued sparse signals. However,…

信息论 · 计算机科学 2016-01-26 Xiangming Meng , Sheng Wu , Linling Kuang , Jianhua Lu

Gradient-descent-based algorithms and their stochastic versions have widespread applications in machine learning and statistical inference. In this work we perform an analytic study of the performances of one of them, the Langevin…

Given a high-dimensional data matrix ${\boldsymbol A}\in{\mathbb R}^{m\times n}$, Approximate Message Passing (AMP) algorithms construct sequences of vectors ${\boldsymbol u}^t\in{\mathbb R}^n$, ${\boldsymbol v}^t\in{\mathbb R}^m$, indexed…

信息论 · 计算机科学 2017-08-15 Raphael Berthier , Andrea Montanari , Phan-Minh Nguyen

In this paper we consider the generalized approximate message passing (GAMP) algorithm for recovering a sparse signal from modulo samples of randomized projections of the unknown signal. The modulo samples are obtained by a self-reset (SR)…

信号处理 · 电气工程与系统科学 2018-07-10 Osman Musa , Peter Jung , Norbert Goertz

Optimal data detection in multiple-input multiple-output (MIMO) communication systems with a large number of antennas at both ends of the wireless link entails prohibitive computational complexity. In order to reduce the computational…

信息论 · 计算机科学 2015-10-22 Charles Jeon , Ramina Ghods , Arian Maleki , Christoph Studer

Approximate message passing algorithm enjoyed considerable attention in the last decade. In this paper we introduce a variant of the AMP algorithm that takes into account glassy nature of the system under consideration. We coin this…

无序系统与神经网络 · 物理学 2019-02-07 Fabrizio Antenucci , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless,…

信息论 · 计算机科学 2015-01-21 Fuwei Li , Jun Fang , Huiping Duan , Zhi Chen , Hongbin Li

The ubiquity of approximately sparse data has led a variety of com- munities to great interest in compressed sensing algorithms. Although these are very successful and well understood for linear measurements with additive noise, applying…

信息论 · 计算机科学 2016-07-27 Christophe Schülke , Francesco Caltagirone , Lenka Zdeborová

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

信息论 · 计算机科学 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

信息论 · 计算机科学 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

We consider the problem of decoding a discrete signal of categorical variables from the observation of several histograms of pooled subsets of it. We present an Approximate Message Passing (AMP) algorithm for recovering the signal in the…

信息论 · 计算机科学 2020-01-22 Ahmed El Alaoui , Aaditya Ramdas , Florent Krzakala , Lenka Zdeborova , Michael I. Jordan

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. AMP only applies to independent identically distributed (IID) transform…

信息论 · 计算机科学 2022-06-24 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Heuristic tools from statistical physics have been used in the past to locate the phase transitions and compute the optimal learning and generalization errors in the teacher-student scenario in multi-layer neural networks. In this…

机器学习 · 计算机科学 2024-03-01 Benjamin Aubin , Antoine Maillard , Jean Barbier , Florent Krzakala , Nicolas Macris , Lenka Zdeborová

Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, depending on a…

信号处理 · 电气工程与系统科学 2018-04-02 Kazushi Mimura

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

信息论 · 计算机科学 2013-01-29 Justin Ziniel , Philip Schniter

In this paper, we consider the problem of multi-resolution compressed sensing (MR-CS) reconstruction, which has received little attention in the literature. Instead of always reconstructing the signal at the original high resolution (HR),…

信息论 · 计算机科学 2016-01-21 Xing Wang , Jie Liang

Generalized linear models (GLMs) -- such as logistic regression, Poisson regression, and robust regression -- provide interpretable models for diverse data types. Probabilistic approaches, particularly Bayesian ones, allow coherent…

统计计算 · 统计学 2018-12-19 Jonathan H. Huggins , Ryan P. Adams , Tamara Broderick

The generalized approximate message passing (GAMP) algorithm under the Bayesian setting shows advantage in recovering under-sampled sparse signals from corrupted observations. Compared to conventional convex optimization methods, it has a…

信息论 · 计算机科学 2017-01-12 Shuai Huang , Trac D. Tran

We give a fast, spectral procedure for implementing approximate-message passing (AMP) algorithms robustly. For any quadratic optimization problem over symmetric matrices $X$ with independent subgaussian entries, and any separable AMP…

数据结构与算法 · 计算机科学 2024-11-06 Misha Ivkov , Tselil Schramm