中文
相关论文

相关论文: Convergence of the Generalized Alternating Project…

200 篇论文

In Compressive Sensing, the Restricted Isometry Property (RIP) ensures that robust recovery of sparse vectors is possible from noisy, undersampled measurements via computationally tractable algorithms. It is by now well-known that Gaussian…

信息论 · 计算机科学 2014-02-17 Armin Eftekhari , Han Lun Yap , Christopher J. Rozell , Michael B. Wakin

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

机器学习 · 计算机科学 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

We estimate convergence rates for fixed-point iterations of a class of nonlinear operators which are partially motivated from solving convex optimization problems. We introduce the notion of the generalized averaged nonexpansive (GAN)…

最优化与控制 · 数学 2021-12-13 Yizun Lin , Yuesheng Xu

Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss-Seidel iterative solution of linear equations in the precision matrix. Specifically, the…

统计计算 · 统计学 2015-05-14 Colin Fox , Albert Parker

In this paper, we propose an adaptive proximal inexact gradient (APIG) framework for solving a class of nonsmooth composite optimization problems involving function and gradient errors. Unlike existing inexact proximal gradient methods, the…

信息论 · 计算机科学 2025-04-03 Xilai Fan , Bo Jiang , Ya-Feng Liu

This paper studies a sparse signal recovery task in time-varying (time-adaptive) environments. The contribution of the paper to sparsity-aware online learning is threefold; first, a Generalized Thresholding (GT) operator, which relates to…

信息论 · 计算机科学 2012-12-03 Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis , Stephen McLaughlin

Compressive sensing is a methodology for the reconstruction of sparse or compressible signals using far fewer samples than required by the Nyquist criterion. However, many of the results in compressive sensing concern random sampling…

数值分析 · 数学 2014-04-02 Guangliang Chen , Atul Divekar , Deanna Needell

We study COMP-AMS, a distributed optimization framework based on gradient averaging and adaptive AMSGrad algorithm. Gradient compression with error feedback is applied to reduce the communication cost in the gradient transmission process.…

机器学习 · 统计学 2022-05-12 Xiaoyun Li , Belhal Karimi , Ping Li

We present a novel sparsity-based space-time adaptive processing (STAP) technique based on the alternating direction method to overcome the severe performance degradation caused by array gain/phase (GP) errors. The proposed algorithm…

数据结构与算法 · 计算机科学 2017-06-27 Zhaocheng Yang , Rodrigo C. de Lamare , Weijian Liu

Adam is one of the most popular optimization algorithms in deep learning. However, it is known that Adam does not converge in theory unless choosing a hyperparameter, i.e., $\beta_2$, in a problem-dependent manner. There have been many…

Graph matching has important applications in pattern recognition and beyond. Current approaches predominantly adopt supervised learning, demanding extensive labeled data which can be limited or costly. Meanwhile, self-supervised learning…

机器学习 · 计算机科学 2024-06-26 Jianyuan Bo , Yuan Fang

This paper investigates the problem of recovering the support of structured signals via adaptive compressive sensing. We examine several classes of structured support sets, and characterize the fundamental limits of accurately recovering…

统计理论 · 数学 2016-09-05 Rui M. Castro , Ervin Tánczos

Motivated by applications to distributed optimization over networks and large-scale data processing in machine learning, we analyze the deterministic incremental aggregated gradient method for minimizing a finite sum of smooth functions…

最优化与控制 · 数学 2018-01-16 Mert Gurbuzbalaban , Asuman Ozdaglar , Pablo Parrilo

Spike and Slab priors have been of much recent interest in signal processing as a means of inducing sparsity in Bayesian inference. Applications domains that benefit from the use of these priors include sparse recovery, regression and…

机器学习 · 计算机科学 2016-10-27 Tiep H. Vu , Hojjat S. Mousavi , Vishal Monga

The randomized projection (RP) method is a simple iterative scheme for solving linear feasibility problems and has recently gained popularity due to its speed and low memory requirement. This paper develops an accelerated variant of the…

最优化与控制 · 数学 2022-11-21 Lin Zhu , Yuan Lei , Jiaxin Xie

Alternating direction multiplication is a powerful technique for solving convex optimisation problems. When challenging subproblems are encountered in the real world, it is useful to solve them by introducing neighbourhood terms. When the…

最优化与控制 · 数学 2024-04-29 Boran Wang

Snapshot compressive imaging (SCI) systems aim to capture high-dimensional ($\ge3$D) images in a single shot using 2D detectors. SCI devices include two main parts: a hardware encoder and a software decoder. The hardware encoder typically…

图像与视频处理 · 电气工程与系统科学 2020-12-16 Ziyi Meng , Shirin Jalali , Xin Yuan

In this paper, we study the optimization problem on a compact matrix manifold. While existing feasible algorithms can be broadly categorized into retraction-based and projection-based methods, compared to the more comprehensive and in-depth…

最优化与控制 · 数学 2025-11-21 Wentao Ding , Jianze Li , Shuzhong Zhang

This paper is about iteratively reweighted basis-pursuit algorithms for compressed sensing and matrix completion problems. In a first part, we give a theoretical explanation of the fact that reweighted basis pursuit can improve a lot upon…

信息论 · 计算机科学 2011-07-11 Stéphane Gaïffas , Guillaume Lecué

Recent studies have shown that proximal gradient (PG) method and accelerated gradient method (APG) with restarting can enjoy a linear convergence under a weaker condition than strong convexity, namely a quadratic growth condition (QGC).…

最优化与控制 · 数学 2017-05-16 Mingrui Liu , Tianbao Yang