中文
相关论文

相关论文: Approximate message passing for nonconvex sparse r…

200 篇论文

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

信息论 · 计算机科学 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari

In this paper, an efficient distributed approach for implementing the approximate message passing (AMP) algorithm, named distributed AMP (DAMP), is developed for compressed sensing (CS) recovery in sensor networks with the sparsity K…

分布式、并行与集群计算 · 计算机科学 2014-05-26 Puxiao Han , Ruixin Niu , Mengqi Ren

Sparse superposition (SS) codes were originally proposed as a capacity-achieving communication scheme over the additive white Gaussian noise channel (AWGNC) [1]. Very recently, it was discovered that these codes are universal, in the sense…

信息论 · 计算机科学 2020-06-05 Erdem Biyik , Jean Barbier , Mohamad Dia

We give a fast, spectral procedure for implementing approximate-message passing (AMP) algorithms robustly. For any quadratic optimization problem over symmetric matrices $X$ with independent subgaussian entries, and any separable AMP…

数据结构与算法 · 计算机科学 2024-11-06 Misha Ivkov , Tselil Schramm

Approximate Message Passing (AMP) algorithms are a family of iterative algorithms based on large random matrices with the special property of tracking the statistical properties of their iterates. They are used in various fields such as…

概率论 · 数学 2025-03-27 Mohammed-Younes Gueddari , Walid Hachem , Jamal Najim

Solving a large-scale regularized linear inverse problem using multiple processors is important in various real-world applications due to the limitations of individual processors and constraints on data sharing policies. This paper focuses…

信息论 · 计算机科学 2017-01-31 Yanting Ma , Yue M. Lu , Dror Baron

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

最优化与控制 · 数学 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

The analytic characterization of the high-dimensional behavior of optimization for Generalized Linear Models (GLMs) with Gaussian data has been a central focus in statistics and probability in recent years. While convex cases, such as the…

Conformal prediction has emerged as a powerful tool for building prediction intervals that are valid in a distribution-free way. However, its evaluation may be computationally costly, especially in the high-dimensional setting where the…

机器学习 · 统计学 2025-11-13 Lucas Clarté , Lenka Zdeborová

Approximate message passing (AMP) is an efficient iterative signal recovery algorithm for compressed sensing (CS). For sensing matrices with independent and identically distributed (i.i.d.) Gaussian entries, the behavior of AMP can be…

信息论 · 计算机科学 2016-10-20 Zhipeng Xue , Junjie Ma , Xiaojun Yuan

In this article, we apply non-convex regularization methods in order to obtain stable estimation of loss development factors in insurance claims reserving. Among the non-convex regularization methods, we focus on the use of the log-adjusted…

统计方法学 · 统计学 2020-12-08 Himchan Jeong , Hyunwoong Chang , Emiliano A. Valdez

Generalized approximate message passing (GAMP) is a computationally efficient algorithm for estimating an unknown signal $w_0\in\mathbb{R}^N$ from a random linear measurement $y= Xw_0 + \epsilon\in\mathbb{R}^M$, where…

信息论 · 计算机科学 2025-08-06 Takashi Takahashi

We consider the problem of recovering clustered sparse signals with no prior knowledge of the sparsity pattern. Beyond simple sparsity, signals of interest often exhibits an underlying sparsity pattern which, if leveraged, can improve the…

信息论 · 计算机科学 2016-01-05 Xiangming Meng , Sheng Wu , Linling Kuang , Defeng , Huang , Jianhua Lu

This paper is divided into two parts. The first part is devoted to the study of a class of Approximate Message Passing (AMP) algorithms which are widely used in the fields of statistical physics, machine learning, or communication theory.…

概率论 · 数学 2024-06-13 Walid Hachem

Approximate message passing (AMP) is an effective iterative sparse recovery algorithm for linear system models. Its performance is characterized by the state evolution (SE) which is a simple scalar recursion. However, depending on a…

信号处理 · 电气工程与系统科学 2018-04-02 Kazushi Mimura

Approximate message passing (AMP) algorithms have shown great promise in sparse signal reconstruction due to their low computational requirements and fast convergence to an exact solution. Moreover, they provide a probabilistic framework…

声音 · 计算机科学 2018-02-02 Turab Iqbal , Wenwu Wang

We introduce the Stochastic Asynchronous Proximal Alternating Linearized Minimization (SAPALM) method, a block coordinate stochastic proximal-gradient method for solving nonconvex, nonsmooth optimization problems. SAPALM is the first…

最优化与控制 · 数学 2016-06-09 Damek Davis , Brent Edmunds , Madeleine Udell

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

计量经济学 · 经济学 2024-02-23 Joel L. Horowitz , Ahnaf Rafi

Approximate Message Passing (AMP) is an efficient iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions, such as sparse systems. In AMP, a so-called Onsager term is added to…

信息论 · 计算机科学 2023-01-16 Lei Liu , Yiyao Cheng , Shansuo Liang , Jonathan H. Manton , Li Ping

We consider the problem of decoding a discrete signal of categorical variables from the observation of several histograms of pooled subsets of it. We present an Approximate Message Passing (AMP) algorithm for recovering the signal in the…

信息论 · 计算机科学 2020-01-22 Ahmed El Alaoui , Aaditya Ramdas , Florent Krzakala , Lenka Zdeborova , Michael I. Jordan