English
Related papers

Related papers: The convergence rate of a golden ratio algorithm f…

200 papers

In this paper we study the numerical method for approximating the random periodic solution of semiliear stochastic evolution equations. The main challenge lies in proving a convergence over an infinite time horizon while simulating…

Probability · Mathematics 2022-05-12 Yue Wu , Chenggui Yuan

A class of generalized conditional gradient algorithms for the solution of optimization problem in spaces of Radon measures is presented. The method iteratively inserts additional Dirac-delta functions and optimizes the corresponding…

Optimization and Control · Mathematics 2021-03-30 Konstantin Pieper , Daniel Walter

Golden ratio primal-dual algorithm (GRPDA) is a new variant of the classical Arrow-Hurwicz method for solving structured convex optimization problem, in which the objective function consists of the sum of two closed proper convex functions,…

Optimization and Control · Mathematics 2021-05-18 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

In this paper, we apply a new kind of smoothness concept, i.e. H\"older stability estimates for the determination of convergence rates of Tikhonov regularization for linear and non-linear inverse problems in Hilbert spaces. For linear…

Numerical Analysis · Mathematics 2020-11-05 Gaurav Mittal , Ankik Kumar Giri

We consider an optimization problem with strongly convex objective and linear inequalities constraints. To be able to deal with a large number of constraints we provide a penalty reformulation of the problem. As penalty functions we use a…

Optimization and Control · Mathematics 2020-04-29 Angelia Nedich , Tatiana Tatarenko

In this paper we consider resource allocation problem stated as a convex minimization problem with linear constraints. To solve this problem, we use gradient and accelerated gradient descent applied to the dual problem and prove the…

Optimization and Control · Mathematics 2019-10-01 Anastasiya Ivanova , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kamzolov

The rate of convergence of the classical Thresholding Greedy Algorithm with respect to bases is studied in this paper. We bound the error of approximation by the product of both norms -- the norm of $f$ and the $A_1$-norm of $f$. We obtain…

Numerical Analysis · Mathematics 2024-07-29 V. N. Temlyakov

Automatic algorithms attempt to provide approximate solutions that differ from exact solutions by no more than a user-specified error tolerance. This paper describes an automatic, adaptive algorithm for approximating the solution to a…

Numerical Analysis · Mathematics 2018-09-28 Yuhan Ding , Fred J. Hickernell , Lluís Antoni Jiménez Rugama

The paper gives a systematic study of the approximate versions of three greedy-type algorithms that are widely used in convex optimization. By approximate version we mean the one where some of evaluations are made with an error. Importance…

Machine Learning · Statistics 2014-12-11 Vladimir Temlyakov

This paper investigates the optimal ergodic sublinear convergence rate of the relaxed proximal point algorithm for solving monotone variational inequality problems. The exact worst case convergence rate is computed using the performance…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang

A new algorithm for one-dimensional minimization is described in detail and the results of some tests on practical cases are reported and illustrated. The method requires only punctual computation of the function, and is suitable to be…

Optimization and Control · Mathematics 2017-08-24 Glauco Masotti

Analysis of the convergence rates of modern convex optimization algorithms can be achived through binary means: analysis of emperical convergence, or analysis of theoretical convergence. These two pathways of capturing information diverge…

Machine Learning · Computer Science 2013-05-20 Patrick Hop , Xinghao Pan

Folklore says that Howard's Policy Improvement Algorithm converges extraordinarily fast, even for controlled diffusion settings. In a previous paper, we proved that approximations of the solution of a particular parabolic partial…

Optimization and Control · Mathematics 2017-09-20 Jun Maeda , Saul D. Jacka

The paper provides a thorough comparison between R-continuity and other fundamental tools in optimization such as metric regularity, metric subregularity and calmness. We show that R-continuity has some advantages in the convergence rate…

Optimization and Control · Mathematics 2024-08-20 Ba Khiet Le , Michel Théra

This paper is concerned with the optimal convergence rate in homogenization of higher order parabolic systems with bounded measurable, rapidly oscillating periodic coefficients. The sharp $O(\va)$ convergence rate in the space $L^2(0,T;…

Analysis of PDEs · Mathematics 2018-04-19 Weisheng Niu , Yao Xu

This paper provides a new way of developing the splitting method which is used to solve the problem of finding the resolvent of the sum of maximal monotone operators in Hilbert spaces. By employing accelerated techniques developed by Davis…

Optimization and Control · Mathematics 2018-09-13 Shin-ya Matsushita

Although it is relatively easy to apply, the gradient method often displays a disappointingly slow rate of convergence. Its convergence is specially based on the structure of the matrix of the algebraic linear system, and on the choice of…

Numerical Analysis · Mathematics 2025-06-03 Ibrahima Dione

For a family of second-order elliptic systems in divergence form with rapidly oscillating almost-periodic coefficients, we obtain estimates for approximate correctors in terms of a function that quantifies the almost periodicity of the…

Analysis of PDEs · Mathematics 2015-06-26 Zhongwei Shen

Error estimates are proved for finite element approximations to the solution of second-order hyperbolic partial differential equations with coefficients varying in both space and time. Optimal rates of convergence in the energy norm are…

Numerical Analysis · Mathematics 2026-03-17 Oussama Al Jarroudi , Marcus J. Grote

In this work, we analyze the regularizing property of the stochastic gradient descent for the efficient numerical solution of a class of nonlinear ill-posed inverse problems in Hilbert spaces. At each step of the iteration, the method…

Optimization and Control · Mathematics 2019-07-09 Bangti Jin , Zehui Zhou , Jun Zou