English
Related papers

Related papers: Convergence Rate Analysis of Proximal Iteratively …

200 papers

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We show that the…

Functional Analysis · Mathematics 2018-11-26 Szilárd Csaba László

In this paper a robust second-order method is developed for the solution of strongly convex l1-regularized problems. The main aim is to make the proposed method as inexpensive as possible, while even difficult problems can be efficiently…

Optimization and Control · Mathematics 2015-01-13 Kimon Fountoulakis , Jacek Gondzio

In this paper, we discuss the statistical properties of the $\ell_q$ optimization methods $(0<q\leq 1)$, including the $\ell_q$ minimization method and the $\ell_q$ regularization method, for estimating a sparse parameter from noisy…

Machine Learning · Statistics 2019-11-14 Xin Li , Yaohua Hu , Chong Li , Xiaoqi Yang , Tianzi Jiang

In this paper, we carry out a unified study for $L_1$ over $L_2$ sparsity promoting models, which are widely used in the regime of coherent dictionaries for recovering sparse nonnegative/arbitrary signals. First, we provide a unified…

Optimization and Control · Mathematics 2023-01-24 Min Tao , Xiao-Ping Zhang

This paper provides a new regularization method which is particularly suitable for linear exponentially ill-posed problems. Under logarithmic source conditions (which have a natural interpretation in terms of Sobolev spaces in the…

Numerical Analysis · Mathematics 2020-07-08 Walter Cedric Simo Tao Lee

In this paper, we consider a class of non-convex and non-smooth sparse optimization problems, which encompass most existing nonconvex sparsity-inducing terms. We show the second-order optimality conditions only depend on the nonzeros of the…

Optimization and Control · Mathematics 2024-12-13 Luwei Bai , Yaohua Hu , Hao Wang , Xiaoqi Yang

In this paper we introduce and analyze an iteratively re-weighted algorithm, that allows to approximate the weak solution of the $p$-Poisson problem for $1 < p \leq 2$ by iteratively solving a sequence of linear elliptic problems. The…

Numerical Analysis · Mathematics 2022-09-26 Lars Diening , Massimo Fornasier , Maximilian Wank

$L_1$ regularization is used for finding sparse solutions to an underdetermined linear system. As sparse signals are widely expected in remote sensing, this type of regularization scheme and its extensions have been widely employed in many…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Yilei Shi , Xiao Xiang Zhu , Wotao Yin , Richard Bamler

Variational regularisation is the primary method for solving inverse problems, and recently there has been considerable work leveraging deeply learned regularisation for enhanced performance. However, few results exist addressing the…

Optimization and Control · Mathematics 2024-06-18 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

In this work, we consider ill-posed inverse problems in which the forward operator is continuous and weakly closed, and the sought solution belongs to a weakly closed constraint set. We propose a regularization method based on minimizing…

Numerical Analysis · Mathematics 2025-05-27 Barbara Palumbo , Paolo Massa , Federico Benvenuto

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

We investigate an inertial algorithm of gradient type in connection with the minimization of a nonconvex differentiable function. The algorithm is formulated in the spirit of Nesterov's accelerated convex gradient method. We prove some…

Functional Analysis · Mathematics 2020-02-11 Szilárd Csaba László

This paper considers the problem of minimizing the sum of a smooth function and the Schatten-$p$ norm of the matrix. Our contribution involves proposing accelerated iteratively reweighted nuclear norm methods designed for solving the…

Optimization and Control · Mathematics 2024-06-27 Hao Wang , Ye Wang , Xiangyu Yang

Machine learning algorithms typically require abundant data under a stationary environment. However, environments are nonstationary in many real-world applications. Critical issues lie in how to effectively adapt models under an…

Machine Learning · Statistics 2020-06-29 Masaaki Takada , Hironori Fujisawa

This paper presents a new algorithmic framework for computing sparse solutions to large-scale linear discrete ill-posed problems. The approach is motivated by recent perspectives on iteratively reweighted norm schemes, viewed through the…

Numerical Analysis · Mathematics 2025-02-05 Lucas Onisk , Malena Sabaté Landman

Weighted $\ell_1$-minimization has been studied as a technique for the reconstruction of a sparse signal from compressively sampled measurements when prior information about the signal, in the form of a support estimate, is available. In…

Information Theory · Computer Science 2016-12-09 Deanna Needell , Rayan Saab , Tina Woolf

Functions of interest are often smooth and sparse in some sense, and both priors should be taken into account when interpolating sampled data. Classical linear interpolation methods are effective under strong regularity assumptions, but…

Functional Analysis · Mathematics 2015-03-27 Holger Rauhut , Rachel Ward

In this letter, an accelerated quadratic programming (QP) algorithm is proposed based on the proximal gradient method. The algorithm can achieve convergence rate $O(1/p^{\alpha})$, where $p$ is the iteration number and $\alpha$ is the given…

Optimization and Control · Mathematics 2022-01-25 Jia Wang , Ying Yang

This paper considers sparsity in linear regression under the restriction that the regression weights sum to one. We propose an approach that combines $\ell_0$- and $\ell_1$-regularization. We compute its solution by adapting a recent…

Methodology · Statistics 2019-07-11 Nick Koning , Paul Bekker