English
Related papers

Related papers: A Block Coordinate and Variance-Reduced Method for…

200 papers

We consider the problem of minimizing a continuous function given quantum access to a stochastic gradient oracle. We provide two new methods for the special case of minimizing a Lipschitz convex function. Each method obtains a dimension…

Quantum Physics · Physics 2024-07-26 Aaron Sidford , Chenyi Zhang

This paper focuses on coordinate update methods, which are useful for solving problems involving large or high-dimensional datasets. They decompose a problem into simple subproblems, where each updates one, or a small block of, variables…

Optimization and Control · Mathematics 2016-08-16 Zhimin Peng , Tianyu Wu , Yangyang Xu , Ming Yan , Wotao Yin

This paper establishes comprehensive stability results for quasi-variational inequalities (QVIs) under monotone perturbations of the governing operator. We prove strong convergence of both minimal and maximal solutions when sequences of…

Functional Analysis · Mathematics 2025-12-16 M. H. M. Rashid

The subgradient method is one of the most fundamental algorithmic schemes for nonsmooth optimization. The existing complexity and convergence results for this method are mainly derived for Lipschitz continuous objective functions. In this…

Optimization and Control · Mathematics 2024-11-01 Xiao Li , Lei Zhao , Daoli Zhu , Anthony Man-Cho So

This paper introduces a family of stochastic extragradient-type algorithms for a class of nonconvex-nonconcave problems characterized by the weak Minty variational inequality (MVI). Unlike existing results on extragradient methods in the…

Optimization and Control · Mathematics 2023-02-20 Thomas Pethick , Olivier Fercoq , Puya Latafat , Panagiotis Patrinos , Volkan Cevher

We improve the understanding of the $\textit{golden ratio algorithm}$, which solves monotone variational inequalities (VI) and convex-concave min-max problems via the distinctive feature of adapting the step sizes to the local Lipschitz…

Optimization and Control · Mathematics 2022-12-29 Ahmet Alacaoglu , Axel Böhm , Yura Malitsky

Distributed nonconvex optimization problems underlie many applications in learning and autonomy, and such problems commonly face asynchrony in agents' computations and communications. When delays in these operations are bounded, they are…

Optimization and Control · Mathematics 2022-03-23 Matthew Ubl , Matthew T. Hale

The main goal of this paper is to present the application of a superiorization methodology to solution of variational inequalities. Within this framework a variational inequality operator is considered as a small perturbation of a convex…

Optimization and Control · Mathematics 2016-11-30 Evgeni Nurminski

Most dynamic simulation tools parameterize the configuration of multi-body robotic systems using minimal coordinates, also called generalized or joint coordinates. However, maximal-coordinate approaches have several advantages over…

Robotics · Computer Science 2021-03-26 Jan Brüdigam , Zachary Manchester

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

In this paper, we present a new stochastic algorithm, namely the stochastic block mirror descent (SBMD) method for solving large-scale nonsmooth and stochastic optimization problems. The basic idea of this algorithm is to incorporate the…

Optimization and Control · Mathematics 2013-09-10 Cong D. Dang , Guanghui Lan

This paper discusses several (sub)gradient methods attaining the optimal complexity for smooth problems with Lipschitz continuous gradients, nonsmooth problems with bounded variation of subgradients, weakly smooth problems with H\"older…

Optimization and Control · Mathematics 2016-05-02 Masoud Ahookhosh

Newton's method has been an important approach for solving variational inequalities, quasi-Newton method is a good alternative choice to save computational cost. In this paper, we propose a new method for solving monotone variational…

Optimization and Control · Mathematics 2025-05-20 Yuge Ye , Qingna Li , Deren Han

The order statistics based list decoding techniques for linear binary block codes of small to medium block length are investigated. The construction of the list of the test error patterns is considered. The original order statistics…

Information Theory · Computer Science 2011-01-27 Saif E. A. Alnawayseh , Pavel Loskot

We propose a randomized nonmonotone block proximal gradient (RNBPG) method for minimizing the sum of a smooth (possibly nonconvex) function and a block-separable (possibly nonconvex nonsmooth) function. At each iteration, this method…

Optimization and Control · Mathematics 2015-03-24 Zhaosong Lu , Lin Xiao

In this paper, we study a class of generalized monotone variational inequality (GMVI) problems whose operators are not necessarily monotone (e.g., pseudo-monotone). We present non-Euclidean extragradient (N-EG) methods for computing…

Optimization and Control · Mathematics 2013-11-13 Cong D. Dang , Guanghui Lan

The original motivation for this paper was to provide an efficient quantitative analysis of convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional (resp. finite-dimensional)…

Optimization and Control · Mathematics 2011-02-11 M. J. Cánovas , M. A. LóPez , B. S. Mordukhovich , J. Parra

In this article the most fundamental decomposition-based optimization method - block coordinate search, based on the sequential decomposition of problems in subproblems - and building performance simulation programs are used to reason about…

Optimization and Control · Mathematics 2016-09-12 Gian Luca Brunetti

We investigate an application of a mathematically robust minimization method -- the gradient method -- to the consistencization problem of a pairwise comparisons (PC) matrix. Our approach sheds new light on the notion of a priority vector…

Rings and Algebras · Mathematics 2022-07-19 Jean-Pierre Magnot , Jiří Mazurek , Viera Čerňanová

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk