English
Related papers

Related papers: Weak and strong convergence of an inertial proxima…

200 papers

We study the convergence of the gradient descent method for solving ill-posed problems where the solution is characterized as a global minimum of a differentiable functional in a Hilbert space. The classical least-squares functional for…

Numerical Analysis · Mathematics 2016-06-02 Stefan Kindermann

In this paper, we study a class of bilevel optimization problems, also known as simple bilevel optimization, where we minimize a smooth objective function over the optimal solution set of another convex constrained optimization problem.…

Optimization and Control · Mathematics 2023-04-25 Ruichen Jiang , Nazanin Abolfazli , Aryan Mokhtari , Erfan Yazdandoost Hamedani

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in…

Functional Analysis · Mathematics 2020-01-09 Fuying Cui , Yang Yang , Yuchao Tang , Chuanxi Zhu

In this paper, we investigate the attractive properties of the proximal gradient algorithm with inertia. Notably, we show that using alternated inertia yields monotonically decreasing functional values, which contrasts with usual…

Optimization and Control · Mathematics 2018-01-18 Franck Iutzeler , Jerome Malick

This paper investigates simple bilevel optimization problems where we minimize an upper-level objective over the optimal solution set of a convex lower-level objective. Existing methods for such problems either only guarantee asymptotic…

Optimization and Control · Mathematics 2024-11-05 Pengyu Chen , Xu Shi , Rujun Jiang , Jiulin Wang

The proximal point algorithm, which is a well-known tool for finding minima of convex functions, is generalized from the classical Hilbert space framework into a nonlinear setting, namely, geodesic metric spaces of nonpositive curvature. We…

Optimization and Control · Mathematics 2012-07-02 Miroslav Bacak

This paper considers the simple bilevel optimization (SBO) problem, which minimizes a composite convex function over the optimal solution set of another composite convex minimization problem. We first show that this bilevel problem is…

Optimization and Control · Mathematics 2025-07-11 Rujun Jiang , Xu Shi , Weizheng Song , Jiulin Wang

We prove weak and strong convergence theorems for a double Krasnoselskij type iterative method to approximate coupled solutions of a bivariate nonexpansive operator F : C x C --> C, where C is a nonempty closed and convex subset of a…

Functional Analysis · Mathematics 2014-02-21 V. Berinde , A. R. Khan , M. Pacurar

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

This paper suggests two novel ideas to develop new proximal variable-metric methods for solving a class of composite convex optimization problems. The first idea is a new parameterization of the optimality condition which allows us to…

Optimization and Control · Mathematics 2018-12-14 Quoc Tran-Dinh , Liang Ling , Kim-Chuan Toh

We analyse the asymptotic properties of a continuous-time, two-timescale stochastic approximation algorithm designed for stochastic bilevel optimisation problems in continuous-time models. We obtain the weak convergence rate of this…

Optimization and Control · Mathematics 2022-07-08 Louis Sharrock

In this paper, we focus on simple bilevel optimization problems, where we minimize a convex smooth objective function over the optimal solution set of another convex smooth constrained optimization problem. We present a novel bilevel…

Optimization and Control · Mathematics 2024-06-03 Jincheng Cao , Ruichen Jiang , Erfan Yazdandoost Hamedani , Aryan Mokhtari

We investigate the convergence properties of a stochastic primal-dual splitting algorithm for solving structured monotone inclusions involving the sum of a cocoercive operator and a composite monotone operator. The proposed method is the…

Optimization and Control · Mathematics 2016-02-26 Lorenzo Rosasco , Silvia Villa , Bang Cong Vu

We prove existence and convergence of sequences generated by the proximal point method and its two variants for monotone vector fields in Hadamard spaces. Before obtaining our results, we investigate some fundamental properties of tangent…

Functional Analysis · Mathematics 2026-05-05 Parin Chaipunya , Fumiaki Kohsaka

In this paper an inexact proximal point method for variational inequalities in Hadamard manifolds is introduced and studied its convergence properties. The main tool used for presenting the method is the concept of enlargement of monotone…

Optimization and Control · Mathematics 2015-11-30 E. E. A. Batista , G. C. Bento , O. P. Ferreira

We consider optimization problems over the Stiefel manifold whose objective function is the summation of a smooth function and a nonsmooth function. Existing methods for solving this kind of problems can be classified into three classes.…

Optimization and Control · Mathematics 2019-05-14 Shixiang Chen , Shiqian Ma , Anthony Man-Cho So , Tong Zhang

In this paper, we investigate the inverse quasi-variational inequality problem in finite-dimensional spaces. First, we introduce a second-order dynamical system whose trajectory converges exponentially to the solution of the inverse…

Optimization and Control · Mathematics 2026-01-19 Pham Viet Hai , Thanh Quoc Trinh , Phan Tu Vuong

We consider a bilevel optimatisation method for inverse linear atmospheric dispersion problems where both linear and non-linear model parameters are to be determined. We propose that a smooth weighted Mahalanobis distance function is used…

Atmospheric and Oceanic Physics · Physics 2016-07-19 Niklas Brännström , Leif Å Persson

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian