English
Related papers

Related papers: Finitely Convergent Iterative Methods with Overrel…

200 papers

The convergence of the projection algorithm for solving the convex feasibility problem for a family of closed convex sets, is in connection with the regularity properties of the family. In the paper [18] are pointed out four cases of such a…

Numerical Analysis · Computer Science 2009-06-01 Laura Maruster , Stefan Maruster

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

We develop a framework for quantitative convergence analysis of Picard iterations of expansive set-valued fixed point mappings. There are two key components of the analysis. The first is a natural generalization of single-valued averaged…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke , Nguyen H. Thao , Matthew K. Tam

A new time relaxation model with iterative modified Lavrentiev regularization method is studied. The aim of the relaxation term is to drive the unresolved fluctuations in a computational simulation to zero exponentially faster by an…

Numerical Analysis · Mathematics 2018-09-26 Ming Zhong

In this paper, we consider convex feasibility problems where the underlying sets are loosely coupled, and we propose several algorithms to solve such problems in a distributed manner. These algorithms are obtained by applying proximal…

Optimization and Control · Mathematics 2013-07-01 Sina Khoshfetrat Pakazad , Martin S. Andersen , Anders Hansson

Immersed finite element (IFE) methods are a group of long-existing numerical methods for solving interface problems on unfitted meshes. A core argument of the methods is to avoid mesh regeneration procedure when solving moving interface…

Numerical Analysis · Mathematics 2020-05-01 Ruchi Guo

We establish the existence theory of several commonly used finite element (FE) nonlinear fully discrete solutions, and the convergence theory of a linearized iteration. First, it is shown for standard FE, SUPG and edge-averaged method…

Numerical Analysis · Mathematics 2023-12-04 Yang Liu , Shi Shu , Ying Yang

We consider variants of trust-region and cubic regularization methods for non-convex optimization, in which the Hessian matrix is approximated. Under mild conditions on the inexact Hessian, and using approximate solution of the…

Optimization and Control · Mathematics 2019-05-15 Peng Xu , Fred Roosta , Michael W. Mahoney

The goal of this paper is to investigate new and simple convergence analysis of dynamic programming for linear quadratic regulator problem of discrete-time linear time-invariant systems. In particular, bounds on errors are given in terms of…

Optimization and Control · Mathematics 2021-06-18 Donghwan Lee

In this paper we extend test set based augmentation methods for integer linear programs to programs with more general convex objective functions. We show existence and computability of finite test sets for these wider problem classes by…

Combinatorics · Mathematics 2007-05-23 Raymond Hemmecke

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

In this article we develop a convergence theory for goal-oriented adaptive finite element algorithms designed for a class of second-order semilinear elliptic equations. We briefly discuss the target problem class, and introduce several…

Numerical Analysis · Mathematics 2014-04-24 Michael Holst , Sara Pollock , Yunrong Zhu

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

In this paper, we consider the iterative method of subspace corrections with random ordering. We prove identities for the expected convergence rate, which can provide sharp estimates for the error reduction per iteration. We also study the…

Numerical Analysis · Mathematics 2018-10-11 Xiaozhe Hu , Jinchao Xu , Ludmil Zikatanov

This article is concerned with the numerical solution of convex variational problems. More precisely, we develop an iterative minimisation technique which allows for the successive enrichment of an underlying discrete approximation space in…

Numerical Analysis · Mathematics 2015-07-07 Paul Houston , Thomas P. Wihler

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

In this paper we propose a new method to stabilise non-symmetric indefinite problems. The idea is to solve a forward and an adjoint problem simultaneously using a suitable stabilised finite element method. Both stabilisation of the element…

Numerical Analysis · Mathematics 2013-08-05 Erik Burman

We extend Fukushima's result on the finite convergence of an algorithm for the global convex feasibility problem to the local nonconvex case.

Optimization and Control · Mathematics 2014-08-01 C. H. Jeffrey Pang

In this paper, we study local convergence of high-order Tensor Methods for solving convex optimization problems with composite objective. We justify local superlinear convergence under the assumption of uniform convexity of the smooth…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov