English
Related papers

Related papers: Replicated Vector Approximate Message Passing For …

200 papers

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter

The paper illustrates an application of the Resampling approach [2] for the estimation of the aircraft circulation plan reliability. Resampling is an intensive computer statistical method, which can be used effectively in the case of small…

Applications · Statistics 2013-05-14 Maxim Fioshin

In this paper, we consider a general form of noisy compressive sensing (CS) where the sensing matrix is not precisely known. Such cases exist when there are imperfections or unknown calibration parameters during the measurement process.…

Signal Processing · Electrical Eng. & Systems 2018-08-28 Jiang Zhu , Qi Zhang , Xiangming Meng , Zhiwei Xu

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

In a recent paper, the authors proposed a new class of low-complexity iterative thresholding algorithms for reconstructing sparse signals from a small set of linear measurements \cite{DMM}. The new algorithms are broadly referred to as AMP,…

Information Theory · Computer Science 2009-11-24 David L. Donoho , Arian Maleki , Andrea Montanari

Message-passing (MP) is a powerful tool for finding an approximate solution in optimization. We generalize it to nonlinear product-sum form, and numerically show the fast convergence for the minimum feedback vertex set and the minimum…

Physics and Society · Physics 2024-04-03 Yukio Hayashi

We develop a message-passing algorithm for noisy matrix completion problems based on matrix factorization. The algorithm is derived by approximating message distributions of belief propagation with Gaussian distributions that share the same…

Machine Learning · Statistics 2021-10-27 Koki Okajima , Yoshiyuki Kabashima

High-dimensional time series appear in many scientific setups, demanding a nuanced approach to model and analyze the underlying dependence structure. Theoretical advancements so far often rely on stringent assumptions regarding the sparsity…

Information Theory · Computer Science 2025-03-20 Daria Tieplova , Samriddha Lahiry , Jean Barbier

Compressed sensing is triggering a major evolution in signal acquisition. It consists in sampling a sparse signal at low rate and later using computational power for its exact reconstruction, so that only the necessary information is…

Statistical Mechanics · Physics 2012-06-07 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

We consider the recovery of a nonnegative vector x from measurements y = Ax, where A is an m-by-n matrix whos entries are in {0, 1}. We establish that when A corresponds to the adjacency matrix of a bipartite graph with sufficient…

Information Theory · Computer Science 2010-01-26 Venkat Chandar , Devavrat Shah , Gregory W. Wornell

In this work we aim to solve the compressed sensing problem for the case of a complex unknown vector by utilizing the Bayesian-optimal structured signal approximate message passing (BOSSAMP) algorithm on the jointly sparse real and…

Information Theory · Computer Science 2015-11-30 Gabor Hannak , Martin Mayer , Gerald Matz , Norbert Goertz

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

Characterizing the distribution of high-dimensional statistical estimators is a challenging task, due to the breakdown of classical asymptotic theory in high dimension. This paper makes progress towards this by developing non-asymptotic…

Statistics Theory · Mathematics 2024-01-09 Gen Li , Yuting Wei

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in…

Disordered Systems and Neural Networks · Physics 2022-02-28 Chun-Yan Zhao , Yan-Rong Fu , Jin-Hua Zhao

We propose a novel resampling-based method to construct an asymptotically exact test for any subset of hypotheses on coefficients in high-dimensional linear regression. It can be embedded into any multiple testing procedure to make…

Methodology · Statistics 2022-05-26 Anna Vesely , Jelle J. Goeman , Livio Finos

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

Artificial Intelligence · Computer Science 2015-08-21 Siamak Ravanbakhsh

Approximate message passing is an iterative algorithm for compressed sensing and related applications. A solid theory about the performance and convergence of the algorithm exists for measurement matrices having iid entries of zero mean.…

Information Theory · Computer Science 2014-10-03 Francesco Caltagirone , Florent Krzakala , Lenka Zdeborová

Maximum A Posteriori inference in graphical models is often solved via message-passing algorithms, such as the junction-tree algorithm, or loopy belief-propagation. The exact solution to this problem is well known to be exponential in the…

Artificial Intelligence · Computer Science 2010-04-09 Julian J. McAuley , Tiberio S. Caetano

We consider random instances of non-convex perceptron problems in the high-dimensional limit of a large number of examples $M$ and weights $N$, with finite load $\alpha = M/N$. We develop a formalism based on replica theory to predict the…

Disordered Systems and Neural Networks · Physics 2026-02-11 Elizaveta Demyanenko , Davide Straziota , Carlo Baldassi , Carlo Lucibello

In this paper, we focus on the matching recovery problem between a pair of correlated Gaussian Wigner matrices with a latent vertex correspondence. We are particularly interested in a robust version of this problem such that our observation…

Machine Learning · Statistics 2025-06-02 Zhangsong Li