English
Related papers

Related papers: On the convergence of an inertial proximal algorit…

200 papers

We consider the problem of estimating the slope function in a functional regression with a scalar response and a functional covariate. This central problem of functional data analysis is well known to be ill-posed, thus requiring a…

Methodology · Statistics 2016-10-05 Anirvan Chakraborty , Victor M. Panaretos

This paper investigates a general class of problems in which a lower bounded smooth convex function incorporating $\ell_{0}$ and $\ell_{2,0}$ regularization is minimized over a box constraint. Although such problems arise frequently in…

Optimization and Control · Mathematics 2025-11-26 Yuge Ye , Qingna Li

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Rakibuzzaman Shah , Nargiz Sultanova , Guoyin Li , Syed Islam

Regularization plays a pivotal role in ill-posed machine learning and inverse problems. However, the fundamental comparative analysis of various regularization norms remains open. We establish a small noise analysis framework to assess the…

Machine Learning · Statistics 2024-09-05 Quanjun Lang , Fei Lu

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

We consider choice of the regularization parameter in Tikhonov method in the case of the unknown noise level of the data. From known heuristic parameter choice rules often the best results were obtained in the quasi-optimality criterion…

Numerical Analysis · Mathematics 2017-08-08 Toomas Raus , Uno Hämarik

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function. These upper bounds are tight at the current estimate, and each iteration monotonically drives the objective…

Optimization and Control · Mathematics 2015-02-03 Julien Mairal

We consider a misspecified optimization problem that requires minimizing a function f(x;q*) over a closed and convex set X where q* is an unknown vector of parameters that may be learnt by a parallel learning process. In this context, We…

Optimization and Control · Mathematics 2015-04-17 Hesam Ahmadi , Uday V. Shanbhag

We consider variational regularization of nonlinear inverse problems in Banach spaces using Tikhonov functionals. This article addresses the problem of $\Gamma$-convergence of a family of Tikhonov functionals and assertions of the…

Functional Analysis · Mathematics 2022-08-12 Alexey Belenkin , Michael Hartz , Thomas Schuster

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

Proximal operators are now ubiquitous in non-smooth optimization. Since their introduction in the seminal work of Moreau, many papers have shown their effectiveness on a wide variety of problems, culminating in their use to construct…

Optimization and Control · Mathematics 2026-02-03 Guillaume Lauga , Samuel Vaiter

Locating proximal points is a component of numerous minimization algorithms. This work focuses on developing a method to find the proximal point of a convex function at a point, given an inexact oracle. Our method assumes that exact…

Optimization and Control · Mathematics 2016-11-03 Warren Hare , Chayne Planiden

In this paper we present a globally convergent algorithm for the computation of a minimizer of the Tikhonov functional with sparsity promoting penalty term for nonlinear forward operators in Banach space. The dual TIGRA method uses a…

Numerical Analysis · Mathematics 2015-08-05 Wei Wang , Stephan W. Anzengruber , Ronny Ramlau , Bo Han

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

In this paper we derive higher order convergence rates in terms of the Bregman distance for Tikhonov like convex regularisation for linear operator equations on Banach spaces. The approach is based on the idea of variational inequalities,…

Optimization and Control · Mathematics 2011-07-14 Markus Grasmair

In this article, we are concerned with the analysis on the numerical reconstruction of the spatial component in the source term of a time-fractional diffusion equation. This ill-posed problem is solved through a stabilized nonlinear…

Numerical Analysis · Mathematics 2020-05-06 Daijun Jiang , Yikan Liu , Dongling Wang

Entropic optimal transport (OT) and the Sinkhorn algorithm have made it practical for machine learning practitioners to perform the fundamental task of calculating transport distance between statistical distributions. In this work, we focus…

Optimization and Control · Mathematics 2024-03-11 Xun Tang , Holakou Rahmanian , Michael Shavlovsky , Kiran Koshy Thekumparampil , Tesi Xiao , Lexing Ying

We study kernel least-squares estimation under a norm constraint. This form of regularisation is known as Ivanov regularisation and it provides better control of the norm of the estimator than the well-established Tikhonov regularisation.…

Statistics Theory · Mathematics 2019-06-17 Stephen Page , Steffen Grünewälder

Tikhonov regularization is one of the most commonly used methods of regularization of ill-posed problems. In the setting of finite element solutions of elliptic partial differential control problems, Tikhonov regularization amounts to…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Peter Hansbo , Mats Larson

In regularized risk minimization, the associated optimization problem becomes particularly difficult when both the loss and regularizer are nonsmooth. Existing approaches either have slow or unclear convergence properties, are restricted to…

Machine Learning · Computer Science 2016-10-14 Shuai Zheng , Ruiliang Zhang , James T. Kwok