中文
相关论文

相关论文: An Information Geometry Interpretation for Approxi…

200 篇论文

The standard linear regression (SLR) problem is to recover a vector $\mathbf{x}^0$ from noisy linear observations $\mathbf{y}=\mathbf{Ax}^0+\mathbf{w}$. The approximate message passing (AMP) algorithm recently proposed by Donoho, Maleki,…

信息论 · 计算机科学 2018-07-24 Sundeep Rangan , Philip Schniter , Alyson K. Fletcher

Image matting is an ill-posed problem that aims to estimate the opacity of foreground pixels in an image. However, most existing deep learning-based methods still suffer from the coarse-grained details. In general, these algorithms are…

计算机视觉与模式识别 · 计算机科学 2021-06-29 Yuhao Liu , Jiake Xie , Yu Qiao , Yong Tang and , Xin Yang

Efficiently finding the maximum a posteriori (MAP) configuration of a graphical model is an important problem which is often implemented using message passing algorithms. The optimality of such algorithms is only well established for…

人工智能 · 计算机科学 2012-05-14 Tony S. Jebara

Analyzing high-dimensional data presents challenges due to the "curse of dimensionality'', making computations intensive. Dimension reduction techniques, categorized as linear or non-linear, simplify such data. Non-linear methods are…

机器学习 · 统计学 2025-04-15 Praveen T. W. Hettige , Benjamin W. Ong

Approximate message passing (AMP) is a class of efficient algorithms for solving high-dimensional linear regression tasks where one wishes to recover an unknown signal \beta_0 from noisy, linear measurements y = A \beta_0 + w. When applying…

信息论 · 计算机科学 2017-08-15 Yanting Ma , Cynthia Rush , Dror Baron

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

人工智能 · 计算机科学 2015-08-21 Siamak Ravanbakhsh

Efficient massive/ultra-massive multiple-input multiple-output (MIMO) detection algorithms with satisfactory performance and low complexity are critical to meet the high throughput and ultra-low latency requirements in 5G and beyond…

信息论 · 计算机科学 2023-01-10 Hengtao He , Alva Kosasih , Xianghao Yu , Jun Zhang , S. H. Song , Wibowo Hardjawana , Khaled B. Letaief

Isogeometric Analysis (IgA) is a spline based approach to the numerical solution of partial differential equations. There are two major issues that IgA was designed to address. The first issue is the exact representation of domains stemming…

数值分析 · 数学 2024-05-16 Stefan Tyoler , Stefan Takacs

Approximate message passing (AMP) refers to a class of efficient algorithms for statistical estimation in high-dimensional problems such as compressed sensing and low-rank matrix estimation. This paper analyzes the performance of AMP in the…

信息论 · 计算机科学 2018-10-23 Cynthia Rush , Ramji Venkataramanan

Deep learning has gained great popularity due to its widespread success on many inference problems. We consider the application of deep learning to the sparse linear inverse problem encountered in compressive sensing, where one seeks to…

信息论 · 计算机科学 2016-07-21 Mark Borgerding , Philip Schniter

We propose a scheme to estimate the parameters $b_i$ and $c_j$ of the bilinear form $z_m=\sum_{i,j} b_i z_m^{(i,j)} c_j$ from noisy measurements $\{y_m\}_{m=1}^M$, where $y_m$ and $z_m$ are related through an arbitrary likelihood function…

信息论 · 计算机科学 2016-05-25 Jason T. Parker , Philip Schniter

Message passing neural networks have recently evolved into a state-of-the-art approach to representation learning on graphs. Existing methods perform synchronous message passing along all edges in multiple subsequent rounds and consequently…

机器学习 · 计算机科学 2020-12-21 Julian Busch , Jiaxing Pi , Thomas Seidl

This paper considers the multi-agent distributed linear least-squares problem. The system comprises multiple agents, each agent with a locally observed set of data points, and a common server with whom the agents can interact. The agents'…

最优化与控制 · 数学 2020-12-01 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

The Fisher information metric is an important foundation of information geometry, wherein it allows us to approximate the local geometry of a probability distribution. Recurrent neural networks such as the Sequence-to-Sequence (Seq2Seq)…

机器学习 · 统计学 2018-01-09 Alessandro Bay , Biswa Sengupta

Sparse Group LASSO (SGL) is a regularized model for high-dimensional linear regression problems with grouped covariates. SGL applies $l_1$ and $l_2$ penalties on the individual predictors and group predictors, respectively, to guarantee…

统计理论 · 数学 2022-02-23 Kan Chen , Zhiqi Bu , Shiyun Xu

Optimal data detection in multiple-input multiple-output (MIMO) communication systems with a large number of antennas at both ends of the wireless link entails prohibitive computational complexity. In order to reduce the computational…

信息论 · 计算机科学 2015-10-22 Charles Jeon , Ramina Ghods , Arian Maleki , Christoph Studer

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

信息论 · 计算机科学 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

The estimation of a random vector with independent components passed through a linear transform followed by a componentwise (possibly nonlinear) output map arises in a range of applications. Approximate message passing (AMP) methods, based…

信息论 · 计算机科学 2016-05-03 Sundeep Rangan , Philip Schniter , Erwin Riegler , Alyson Fletcher , Volkan Cevher

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

机器学习 · 计算机科学 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

统计理论 · 数学 2026-01-01 Yufan Li , Pragya Sur