中文
相关论文

相关论文: Dynamical Functional Theory for Compressed Sensing

200 篇论文

Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, depending on a…

信号处理 · 电气工程与系统科学 2018-04-02 Kazushi Mimura

This paper is divided into two parts. The first part is devoted to the study of a class of Approximate Message Passing (AMP) algorithms which are widely used in the fields of statistical physics, machine learning, or communication theory.…

概率论 · 数学 2024-06-13 Walid Hachem

Recent results in compressed sensing showed that the optimal subsampling strategy should take into account the sparsity pattern of the signal at hand. This oracle-like knowledge, even though desirable, nevertheless remains elusive in most…

信息论 · 计算机科学 2023-06-28 Simon Ruetz

Approximate-message passing (AMP) algorithms have become an important element of high-dimensional statistical inference, mostly due to their adaptability and concentration properties, the state evolution (SE) equations. This is demonstrated…

信息论 · 计算机科学 2022-04-20 Cédric Gerbelot , Raphaël Berthier

We consider the problem of localizing change points in a generalized linear model (GLM), a model that covers many widely studied problems in statistical learning including linear, logistic, and rectified linear regression. We propose a…

机器学习 · 统计学 2025-09-08 Gabriel Arpino , Xiaoqi Liu , Julia Gontarek , Ramji Venkataramanan

In compressed sensing one measures sparse signals directly in a compressed form via a linear transform and then reconstructs the original signal. However, it is often the case that the linear transform itself is known only approximately, a…

信息论 · 计算机科学 2013-11-13 Florent Krzakala , Marc Mézard , Lenka Zdeborová

Approximate message passing algorithms proved to be extremely effective in reconstructing sparse signals from a small number of incoherent linear measurements. Extensive numerical experiments further showed that their dynamics is accurately…

信息论 · 计算机科学 2012-03-06 Mohsen Bayati , Andrea Montanari

Approximate message passing (AMP) is a class of low-complexity, scalable algorithms for solving high-dimensional linear regression tasks where one wishes to recover an unknown signal from noisy, linear measurements. AMP is an iterative…

信息论 · 计算机科学 2019-08-27 Yanting Ma , Cynthia Rush , Dror Baron

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

信息论 · 计算机科学 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Iterative thresholding algorithms are well-suited for high-dimensional problems in sparse recovery and compressive sensing. The performance of this class of algorithms depends heavily on the tuning of certain threshold parameters. In…

信息论 · 计算机科学 2013-11-04 Ali Mousavi , Arian Maleki , Richard G. Baraniuk

We study compressed sensing (CS) signal reconstruction problems where an input signal is measured via matrix multiplication under additive white Gaussian noise. Our signals are assumed to be stationary and ergodic, but the input statistics…

信息论 · 计算机科学 2014-10-22 Yanting Ma , Junan Zhu , Dror Baron

Compressed sensing is a novel technique where one can recover sparse signals from the undersampled measurements. In this correspondence, a $K \times N$ measurement matrix for compressed sensing is deterministically constructed via additive…

信息论 · 计算机科学 2010-10-04 Nam Yul Yu

Approximate message passing (AMP) is a scalable, iterative approach to signal recovery. For structured random measurement ensembles, including independent and identically distributed (i.i.d.) Gaussian and rotationally-invariant matrices,…

信息论 · 计算机科学 2023-06-27 Dang Qua Nguyen , Taejoon Kim

We propose an iterative algorithm for solving the Thouless-Anderson-Palmer (TAP) equations of Ising models with arbitrary rotation invariant (random) coupling matrices. In the thermodynamic limit, we prove by means of the dynamical…

无序系统与神经网络 · 物理学 2019-07-03 Burak Çakmak , Manfred Opper

Approximate message passing (AMP) has emerged both as a popular class of iterative algorithms and as a powerful analytic tool in a wide range of statistical estimation problems and statistical physics models. A well established line of AMP…

统计理论 · 数学 2025-07-22 Zhigang Bao , Qiyang Han , Xiaocong Xu

We analyze the dynamics of a random sequential message passing algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we…

机器学习 · 计算机科学 2022-07-13 Burak Çakmak , Yue M. Lu , Manfred Opper

We introduce Tree-AMP, standing for Tree Approximate Message Passing, a python package for compositional inference in high-dimensional tree-structured models. The package provides a unifying framework to study several approximate message…

机器学习 · 统计学 2023-04-19 Antoine Baker , Benjamin Aubin , Florent Krzakala , Lenka Zdeborová

Bayesian approximate message passing (BAMP) is an efficient method in compressed sensing that is nearly optimal in the minimum mean squared error (MMSE) sense. Bayesian approximate message passing (BAMP) performs joint recovery of multiple…

信息论 · 计算机科学 2019-01-30 Gabor Hannak , Alessandro Perelli , Norbert Goertz , Gerald Matz , Mike E. Davies

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

机器学习 · 统计学 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

A signal recovery scheme is developed for linear observation systems based on expectation consistent (EC) mean field approximation. Approximate message passing (AMP) is known to be consistent with the results obtained using the replica…

信息论 · 计算机科学 2014-07-08 Yoshiyuki Kabashima , Mikko Vehkapera