中文
相关论文

相关论文: An Information Geometry Interpretation for Approxi…

200 篇论文

Approximate message passing (AMP) is a class of low-complexity, scalable algorithms for solving high-dimensional linear regression tasks where one wishes to recover an unknown signal from noisy, linear measurements. AMP is an iterative…

信息论 · 计算机科学 2019-08-27 Yanting Ma , Cynthia Rush , Dror Baron

We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appealing features: the…

机器学习 · 统计学 2021-02-18 Marco Mondelli , Ramji Venkataramanan

Designing efficient sparse recovery algorithms that could handle noisy quantized measurements is important in a variety of applications -- from radar to source localization, spectrum sensing and wireless networking. We take advantage of the…

信号处理 · 电气工程与系统科学 2022-05-24 Shuai Huang , Deqiang Qiu , Trac D. Tran

We study compressed sensing (CS) signal reconstruction problems where an input signal is measured via matrix multiplication under additive white Gaussian noise. Our signals are assumed to be stationary and ergodic, but the input statistics…

信息论 · 计算机科学 2016-11-03 Yanting Ma , Junan Zhu , Dror Baron

The generalized linear model (GLM), where a random vector $\boldsymbol{x}$ is observed through a noisy, possibly nonlinear, function of a linear transform output $\boldsymbol{z}=\boldsymbol{Ax}$, arises in a range of applications such as…

信息论 · 计算机科学 2016-12-06 Philip Schniter , Sundeep Rangan , Alyson K. Fletcher

In Generalized Linear Estimation (GLE) problems, we seek to estimate a signal that is observed through a linear transform followed by a component-wise, possibly nonlinear and noisy, channel. In the Bayesian optimal setting, Generalized…

无序系统与神经网络 · 物理学 2021-02-03 Luca Saglietti , Yue M. Lu , Carlo Lucibello

Long-range interactions are essential for the correct description of complex systems in many scientific fields. The price to pay for including them in the calculations, however, is a dramatic increase in the overall computational costs.…

This paper presents an iterative geometric mean decomposition (IGMD) algorithm for multiple-input-multiple-output (MIMO) wireless communications. In contrast to the existing GMD algorithms, the proposed IGMD does not require the explicit…

信息论 · 计算机科学 2013-11-05 Chiao-En Chen , Chia-Hsiang Yang

Network alignment generalizes and unifies several approaches for forming a matching or alignment between the vertices of two graphs. We study a mathematical programming framework for network alignment problem and a sparse variation of it…

最优化与控制 · 数学 2011-11-03 Mohsen Bayati , David F. Gleich , Amin Saberi , Ying Wang

Generalized approximate message passing (GAMP) is a computationally efficient algorithm for estimating an unknown signal $w_0\in\mathbb{R}^N$ from a random linear measurement $y= Xw_0 + \epsilon\in\mathbb{R}^M$, where…

信息论 · 计算机科学 2025-08-06 Takashi Takahashi

This paper considers a discrete-valued signal estimation scheme based on a low-complexity Bayesian optimal message passing algorithm (MPA) for solving massive linear inverse problems under highly correlated measurements. Gaussian belief…

信号处理 · 电气工程与系统科学 2024-11-14 Tomoharu Furudoi , Takumi Takahashi , Shinsuke Ibi , Hideki Ochiai

We introduce new families of Integral Probability Metrics (IPM) for training Generative Adversarial Networks (GAN). Our IPMs are based on matching statistics of distributions embedded in a finite dimensional feature space. Mean and…

机器学习 · 计算机科学 2017-06-12 Youssef Mroueh , Tom Sercu , Vaibhava Goel

Computing expected information gain (EIG) from prior to posterior (equivalently, mutual information between candidate observations and model parameters or other quantities of interest) is a fundamental challenge in Bayesian optimal…

统计方法学 · 统计学 2026-01-30 Fengyi Li , Ricardo Baptista , Youssef Marzouk

For the problem of multi-class linear classification and feature selection, we propose approximate message passing approaches to sparse multinomial logistic regression (MLR). First, we propose two algorithms based on the Hybrid Generalized…

信息论 · 计算机科学 2016-09-21 Evan Byrne , Philip Schniter

Consider the problem of estimating a low-rank matrix when its entries are perturbed by Gaussian noise. If the empirical distribution of the entries of the spikes is known, optimal estimators that exploit this knowledge can substantially…

统计理论 · 数学 2019-08-08 Andrea Montanari , Ramji Venkataramanan

In this paper, we propose the cross splitting based information geometry approach (CS-IGA), a novel and low complexity iterative detector for uplink signal recovery in extralarge-scale MIMO (XL-MIMO) systems. Conventional iterative…

信息论 · 计算机科学 2025-10-13 Wenjun Zhang , An-An Lu , Xiqi Gao

Many deep neural networks have been used to solve Ising models, including autoregressive neural networks, convolutional neural networks, recurrent neural networks, and graph neural networks. Learning a probability distribution of energy…

统计力学 · 物理学 2024-11-20 Qunlong Ma , Zhi Ma , Jinlong Xu , Hairui Zhang , Ming Gao

This paper addresses the reconstruction of sparse signals from generalized linear measurements. Signal sparsity is assumed to be sublinear in the signal dimension while it was proportional to the signal dimension in conventional research.…

信息论 · 计算机科学 2026-04-13 Keigo Takeuchi

In this paper we consider the generalized approximate message passing (GAMP) algorithm for recovering a sparse signal from modulo samples of randomized projections of the unknown signal. The modulo samples are obtained by a self-reset (SR)…

信号处理 · 电气工程与系统科学 2018-07-10 Osman Musa , Peter Jung , Norbert Goertz

We extend the generalized approximate message passing (G-AMP) approach, originally proposed for high-dimensional generalized-linear regression in the context of compressive sensing, to the generalized-bilinear case, which enables its…

信息论 · 计算机科学 2015-06-17 Jason T. Parker , Philip Schniter , Volkan Cevher