English
Related papers

Related papers: On The Strong Convergence of The Gradient Projecti…

200 papers

We prove novel convergence results for a stochastic proximal gradient algorithm suitable for solving a large class of convex optimization problems, where a convex objective function is given by the sum of a smooth and a possibly non-smooth…

Optimization and Control · Mathematics 2016-08-11 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

Random feature approximation is arguably one of the most widely used techniques for kernel methods in large-scale learning algorithms. In this work, we analyze the generalization properties of random feature methods, extending previous…

Machine Learning · Statistics 2025-06-23 Mike Nguyen , Nicole Mücke

Proximal splitting algorithms for monotone inclusions (and convex optimization problems) in Hilbert spaces share the common feature to guarantee for the generated sequences in general weak convergence to a solution. In order to achieve…

Optimization and Control · Mathematics 2017-11-21 Radu Ioan Bot , Ernö Robert Csetnek , Dennis Meier

In this work, we propose and study a framework of generalized proximal point algorithms associated with a maximally monotone operator. We indicate sufficient conditions on the regularization and relaxation parameters of generalized proximal…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

We investigate the asymptotic properties of the trajectories generated by a second-order dynamical system with Hessian driven damping and a Tikhonov regularization term in connection with the minimization of a smooth convex function in…

Optimization and Control · Mathematics 2020-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilárd Csaba László

Given a proper convex lower semicontinuous function defined on a Hilbert space and whose solution set is supposed nonempty. For attaining a global minimizer when this convex function is continuously differentiable, we approach it by a…

Optimization and Control · Mathematics 2024-04-02 A. C. Bagy , Z. Chbani , H. Riahi

In this paper, we introduce, in a Hilbert space setting, a second order dynamical system with asymptotically vanishing damping and vanishing Tikhonov regularization that approaches a multiobjective optimization problem with convex and…

Optimization and Control · Mathematics 2025-06-30 Radu Ioan Bot , Konstantin Sonntag

A significant milestone in modern gradient-based optimization was achieved with the development of Nesterov's accelerated gradient descent (NAG) method. This forward-backward technique has been further advanced with the introduction of its…

Optimization and Control · Mathematics 2024-04-10 Bowen Li , Bin Shi , Ya-xiang Yuan

In a Hilbert framework, for convex differentiable optimization, we consider accelerated gradient methods obtained by combining temporal scaling and averaging techniques with Tikhonov regularization. We start from the continuous steepest…

Optimization and Control · Mathematics 2022-11-21 Hedy Attouch , Zaki Chbani , Hassan Riahi

This work is concerned with linear inverse problems where a distributed parameter is known a priori to only take on values from a given discrete set. This property can be promoted in Tikhonov regularization with the aid of a suitable convex…

Optimization and Control · Mathematics 2018-04-19 Christian Clason , Thi Bich Tram Do

In order to construct regularizations of continuous linear functionals acting on Sobolev spaces such as $W_0^{1,q}(\Omega)$, where $1<q<\infty$ and $\Omega$ is a Lipschitz domain, we propose a projection method in negative Sobolev spaces…

Numerical Analysis · Mathematics 2022-11-15 Felipe Millar , Ignacio Muga , Sergio Rojas , Kristoffer G. Van der Zee

In a separable Hilbert space, we study the minimization problem of a convex smooth function with Lipschitz continuous gradient whose evaluations are corrupted by random noise. To this end, we associate a stochastic inertial system that…

Optimization and Control · Mathematics 2025-12-18 Chiara Schindler

We consider abstract operator equations $Fu=y$, where $F$ is a compact linear operator between Hilbert spaces $U$ and $V$, which are function spaces on \emph{closed, finite dimensional Riemannian manifolds}, respectively. This setting is of…

Numerical Analysis · Mathematics 2015-05-28 Nicolas Thorstensen , Otmar Scherzer

The aim of this paper is to investigate the links between ${\cal T}_C$-class algorithms, CQ Algorithm and shrinking projection methods. We show that strong convergence of these algorithms are related to coherent ${\cal T}_C$-class sequences…

Optimization and Control · Mathematics 2009-09-21 Jean-Philippe Chancelier

A Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping is proposed for solving a linearly constrained convex optimization problem in Hilbert spaces. The system under consideration…

Optimization and Control · Mathematics 2024-04-24 Ting-Ting Zhu , Rong Hu , Ya-Ping Fang

This paper studies the complexity of projected gradient descent methods for a class of strongly convex constrained optimization problems where the objective function is expressed as a summation of $m$ component functions, each possessing a…

Optimization and Control · Mathematics 2026-02-10 Xiaojun Chen , C. T. Kelley , Lei Wang

This paper deals with a Tikhonov regularized second-order inertial dynamical system that incorporates time scaling, asymptotically vanishing damping and Hessian-driven damping for solving convex optimization problems. Under appropriate…

Optimization and Control · Mathematics 2026-04-30 Xiangkai Sun , Guoxiang Tian , Huan Zhang

Given a compact linear operator $\K$, the (pseudo) inverse $\K^\dagger$ is usually substituted by a family of regularizing operators $\R_\alpha$ which depends on $\K$ itself. Naturally, in the actual computation we are forced to approximate…

Numerical Analysis · Mathematics 2021-06-22 Davide Bianchi , Marco Donatelli

In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$,…

Optimization and Control · Mathematics 2015-07-07 H. Attouch , Z. Chbani

Let $Q$ be a nonempty closed and convex subset of a real Hilbert space $% \mathcal{H}$, $S:Q\rightarrow Q$ a nonexpansive mapping, $A:Q\rightarrow Q$ an inverse strongly monotone operator, and $f:Q\rightarrow Q$ a contraction mapping. We…

Dynamical Systems · Mathematics 2022-09-22 Ramzi May