中文
相关论文

相关论文: PCA Initialization for Approximate Message Passing…

200 篇论文

We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appealing features: the…

机器学习 · 统计学 2021-02-18 Marco Mondelli , Ramji Venkataramanan

Consider the problem of estimating a low-rank matrix when its entries are perturbed by Gaussian noise. If the empirical distribution of the entries of the spikes is known, optimal estimators that exploit this knowledge can substantially…

统计理论 · 数学 2019-08-08 Andrea Montanari , Ramji Venkataramanan

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex…

统计理论 · 数学 2023-02-08 Gen Li , Wei Fan , Yuting Wei

We consider the problem of signal estimation in generalized linear models defined via rotationally invariant design matrices. Since these matrices can have an arbitrary spectral distribution, this model is well suited for capturing complex…

机器学习 · 统计学 2022-06-10 Ramji Venkataramanan , Kevin Kögler , Marco Mondelli

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

信息论 · 计算机科学 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

We study a class of Approximate Message Passing (AMP) algorithms for symmetric and rectangular spiked random matrix models with orthogonally invariant noise. The AMP iterates have fixed dimension $K \geq 1$, a multivariate non-linearity is…

统计理论 · 数学 2024-06-14 Xinyi Zhong , Tianhao Wang , Zhou Fan

Approximate Message Passing (AMP) algorithms have seen widespread use across a variety of applications. However, the precise forms for their Onsager corrections and state evolutions depend on properties of the underlying random matrix…

概率论 · 数学 2021-08-16 Zhou Fan

Approximate message passing (AMP) algorithms are devised under the Gaussianity assumption of the measurement noise vector. In this work, we relax this assumption within the vector AMP (VAMP) framework to arbitrary independent and…

信息论 · 计算机科学 2024-02-07 Mohamed Akrout , Tiancheng Gao , Faouzi Bellili , Amine Mezghani

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

机器学习 · 统计学 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

信息论 · 计算机科学 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

We consider the problem of parameter estimation from a generalized linear model with a random design matrix that is orthogonally invariant in law. Such a model allows the design have an arbitrary distribution of singular values and only…

统计理论 · 数学 2026-02-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

Approximate Message Passing (AMP) algorithms are a class of iterative procedures for computationally-efficient estimation in high-dimensional inference and estimation tasks. Due to the presence of an 'Onsager' correction term in its…

统计理论 · 数学 2023-02-02 Collin Cademartori , Cynthia Rush

Designing efficient sparse recovery algorithms that could handle noisy quantized measurements is important in a variety of applications -- from radar to source localization, spectrum sensing and wireless networking. We take advantage of the…

信号处理 · 电气工程与系统科学 2022-05-24 Shuai Huang , Deqiang Qiu , Trac D. Tran

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the…

信息论 · 计算机科学 2018-10-23 Cynthia Rush , Ramji Venkataramanan

Approximate message passing (AMP) emerges as an effective iterative paradigm for solving high-dimensional statistical problems. However, prior AMP theory -- which focused mostly on high-dimensional asymptotics -- fell short of predicting…

统计理论 · 数学 2023-03-20 Gen Li , Yuting Wei

Approximate Message Passing (AMP) has been shown to be a superior method for inference problems, such as the recovery of signals from sets of noisy, lower-dimensionality measurements, both in terms of reconstruction accuracy and in…

信息论 · 计算机科学 2015-06-10 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

We study optimal estimation for sparse principal component analysis when the number of non-zero elements is small but on the same order as the dimension of the data. We employ approximate message passing (AMP) algorithm and its state…

信息论 · 计算机科学 2020-01-22 Thibault Lesieur , Florent Krzakala , Lenka Zdeborova

When the dimension of data is comparable to or larger than the number of data samples, Principal Components Analysis (PCA) may exhibit problematic high-dimensional noise. In this work, we propose an Empirical Bayes PCA method that reduces…

统计方法学 · 统计学 2021-09-07 Xinyi Zhong , Chang Su , Zhou Fan

We propose an orthogonal approximate message passing (OAMP) algorithm for signal estimation in the rectangular spiked matrix model with general rotationally invariant (RI) noise. We establish a rigorous state evolution that exactly…

统计理论 · 数学 2026-02-04 Haohua Chen , Songbin Liu , Junjie Ma

High-dimensional signal recovery of standard linear regression is a key challenge in many engineering fields, such as, communications, compressed sensing, and image processing. The approximate message passing (AMP) algorithm proposed by…

信息论 · 计算机科学 2022-03-02 Qiuyun Zou , Hongwen Yang
‹ 上一页 1 2 3 10 下一页 ›