中文
相关论文

相关论文: A Convergence Result for Asynchronous Algorithms a…

200 篇论文

This paper proposes an algorithmic framework for solving parametric optimization problems which we call adjoint-based predictor-corrector sequential convex programming. After presenting the algorithm, we prove a contraction estimate that…

最优化与控制 · 数学 2011-09-14 Q. Tran Dinh , C. Savorgnan , M. Diehl

In this work, we propose and study a framework of generalized proximal point algorithms associated with a maximally monotone operator. We indicate sufficient conditions on the regularization and relaxation parameters of generalized proximal…

最优化与控制 · 数学 2022-03-29 Hui Ouyang

Recent years have witnessed the surge of asynchronous parallel (async-parallel) iterative algorithms due to problems involving very large-scale data and a large number of decision variables. Because of asynchrony, the iterates are computed…

最优化与控制 · 数学 2021-02-05 Zhimin Peng , Yangyang Xu , Ming Yan , Wotao Yin

Existing asynchronous distributed optimization algorithms often use diminishing step-sizes that cause slow practical convergence, or use fixed step-sizes that depend on and decrease with an upper bound of the delays. Not only are such delay…

最优化与控制 · 数学 2024-11-08 Xuyang Wu , Changxin Liu , Sindri Magnusson , Mikael Johansson

We present a parallelized primal-dual algorithm for solving constrained convex optimization problems. The algorithm is "block-based," in that vectors of primal and dual variables are partitioned into blocks, each of which is updated only by…

最优化与控制 · 数学 2022-05-04 Katherine Hendrickson , Matthew Hale

Motivated by large-scale optimization problems arising in the context of machine learning, there have been several advances in the study of asynchronous parallel and distributed optimization methods during the past decade. Asynchronous…

机器学习 · 计算机科学 2020-06-25 Mahmoud Assran , Arda Aytekin , Hamid Feyzmahdavian , Mikael Johansson , Michael Rabbat

We study the fixed point problem for a system of multivariate operators that are coordinate-wise monotone (i.e., nondecreasing or nonincreasing in each of the variables, independently), in the setting of quasi-ordered sets. We show that…

一般拓扑 · 数学 2012-09-03 Mircea-Dan Rus

We describe an asynchronous parallel stochastic proximal coordinate descent algorithm for minimizing a composite objective function, which consists of a smooth convex function plus a separable convex function. In contrast to previous…

最优化与控制 · 数学 2015-12-14 Ji Liu , Stephen J. Wright

We introduce and study the convergence properties of a projection-type algorithm for solving the variational inequality problem for point-to-set operators. No monotoni\-city assumption is used in our analysis. The operator defining the…

最优化与控制 · 数学 2017-11-29 Regina S. Burachik , R. Díaz Millán

We describe an asynchronous parallel stochastic coordinate descent algorithm for minimizing smooth unconstrained or separably constrained functions. The method achieves a linear convergence rate on functions that satisfy an essential strong…

最优化与控制 · 数学 2014-11-12 Ji Liu , Stephen J. Wright , Christopher Ré , Victor Bittorf , Srikrishna Sridhar

We study the block-coordinate forward-backward algorithm in which the blocks are updated in a random and possibly parallel manner, according to arbitrary probabilities. The algorithm allows different stepsizes along the block-coordinates to…

最优化与控制 · 数学 2020-11-30 Saverio Salzo , Silvia Villa

We propose an algorithm for solving bound-constrained mathematical programs with complementarity constraints on the variables. Each iteration of the algorithm involves solving a linear program with complementarity constraints in order to…

最优化与控制 · 数学 2022-01-14 Christian Kirches , Jeffrey Larson , Sven Leyffer , Paul Manns

We describe several features of parallel or distributed asynchronous iterative algorithms such as unbounded delays, possible out of order messages or flexible communication. We concentrate on the concept of macroiteration sequence which was…

分布式、并行与集群计算 · 计算机科学 2022-10-11 Didier El Baz

In this paper, under the monotonicity of pairs of operators, we propose some Generalized Proximal Point Algorithms to solve non-monotone inclusions using warped resolvents and transformed resolvents. The weak, strong, and linear convergence…

最优化与控制 · 数学 2025-01-24 Ba Khiet Le , Minh N. Dao , Michel Théra

In this paper, we develop rapidly convergent forward-backward algorithms for computing zeroes of the sum of finitely many maximally monotone operators. A modification of the classical forward-backward method for two general operators is…

最优化与控制 · 数学 2021-07-22 Paul-Emile Maingé

A discrepancy principle for solving nonlinear equations with monotone operators given noisy data is formulated. The existence and uniqueness of the corresponding regularization parameter $a(\delta)$ is proved. Convergence of the solution…

数值分析 · 数学 2009-03-04 N. S. Hoang , A. G. Ramm

We establish the optimal nonergodic sublinear convergence rate of the proximal point algorithm for maximal monotone inclusion problems. First, the optimal bound is formulated by the performance estimation framework, resulting in an infinite…

最优化与控制 · 数学 2019-07-15 Guoyong Gu , Junfeng Yang

We study a conical extension of averaged nonexpansive operators and the role it plays in convergence analysis of fixed point algorithms. Various properties of conically averaged operators are systematically investigated, in particular, the…

最优化与控制 · 数学 2020-12-01 Sedi Bartz , Minh N. Dao , Hung M. Phan

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

最优化与控制 · 数学 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

We propose and analyze the convergence of a novel stochastic algorithm for solving monotone inclusions that are the sum of a maximal monotone operator and a monotone, Lipschitzian operator. The propose algorithm requires only unbiased…

最优化与控制 · 数学 2021-02-18 Nguyen Van Dung , Bang Cong Vu