English
Related papers

Related papers: Parallel coordinate descent methods for composite …

200 papers

In this paper we present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm…

Optimization and Control · Mathematics 2015-05-11 Kimon Fountoulakis , Rachael Tappenden

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

In this paper we develop a randomized block-coordinate descent method for minimizing the sum of a smooth and a simple nonsmooth block-separable convex function and prove that it obtains an $\epsilon$-accurate solution with probability at…

Optimization and Control · Mathematics 2011-07-15 Peter Richtárik , Martin Takáč

This paper deals with convex nonsmooth optimization problems. We introduce a general smooth approximation framework for the original function and apply random (accelerated) coordinate descent methods for minimizing the corresponding smooth…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies Comput. Optim. Appl. 72(3):609--640, 2019] to minimize the sum of a partially separable…

Optimization and Control · Mathematics 2025-08-06 Ronaldo Lopes , Sandra A. Santos , Paulo J. S. Silva

In this work we propose a distributed randomized block coordinate descent method for minimizing a convex function with a huge number of variables/coordinates. We analyze its complexity under the assumption that the smooth part of the…

Optimization and Control · Mathematics 2015-07-21 Jakub Marecek , Peter Richtarik , Martin Takac

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

Optimization and Control · Mathematics 2026-03-25 Hong Zhu , Xun Qian

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

In this paper, we study the convergence properties of a randomized block-coordinate descent algorithm for the minimization of a composite convex objective function, where the block-coordinates are updated asynchronously and randomly…

Optimization and Control · Mathematics 2023-04-14 Cheik Traoré , Saverio Salzo , Silvia Villa

We propose a new \textit{randomized Bregman (block) coordinate descent} (RBCD) method for minimizing a composite problem, where the objective function could be either convex or nonconvex, and the smooth part are freed from the global…

Optimization and Control · Mathematics 2020-01-16 Tianxiang Gao , Songtao Lu , Jia Liu , Chris Chu

In this paper we analyze the randomized block-coordinate descent (RBCD) methods proposed in [8,11] for minimizing the sum of a smooth convex function and a block-separable convex function. In particular, we extend Nesterov's technique…

Optimization and Control · Mathematics 2013-05-22 Zhaosong Lu , Lin Xiao

This work provides the first convergence analysis for the Randomized Block Coordinate Descent method for minimizing a function that is both H\"older smooth and block H\"older smooth. Our analysis applies to objective functions that are…

Optimization and Control · Mathematics 2024-03-14 Leandro Farias Maia , David Huckleberry Gutman

We present a novel randomized block coordinate descent method for the minimization of a convex composite objective function. The method uses (approximate) partial second-order (curvature) information, so that the algorithm performance is…

Optimization and Control · Mathematics 2018-02-28 Kimon Fountoulakis , Rachael Tappenden

In this paper we analyze a family of general random block coordinate descent methods for the minimization of $\ell_0$ regularized optimization problems, i.e. the objective function is composed of a smooth convex function and the $\ell_0$…

Optimization and Control · Mathematics 2014-07-21 Andrei Patrascu , Ion Necoara

In this paper we consider large-scale composite optimization problems having the objective function formed as a sum of two terms (possibly nonconvex), one has (block) coordinate-wise Lipschitz continuous gradient and the other is…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

A generalized conditional gradient method for minimizing the sum of two convex functions, one of them differentiable, is presented. This iterative method relies on two main ingredients: First, the minimization of a partially linearized…

Optimization and Control · Mathematics 2021-10-01 Karl Kunisch , Daniel Walter

This paper introduces an abstract framework for randomized subspace correction methods for convex optimization, which unifies and generalizes a broad class of existing algorithms, including domain decomposition, multigrid, and block…

Optimization and Control · Mathematics 2026-04-28 Boou Jiang , Jongho Park , Jinchao Xu

A block decomposition method is proposed for minimizing a (possibly non-convex) continuously differentiable function subject to one linear equality constraint and simple bounds on the variables. The proposed method iteratively selects a…

Optimization and Control · Mathematics 2019-03-06 Andrea Cristofari

We study the block-coordinate forward-backward algorithm in which the blocks are updated in a random and possibly parallel manner, according to arbitrary probabilities. The algorithm allows different stepsizes along the block-coordinates to…

Optimization and Control · Mathematics 2020-11-30 Saverio Salzo , Silvia Villa

In two earlier papers, we designed a distributed deterministic asynchronous algorithm for minimizing the sum of subdifferentiable and proximable functions and a regularizing quadratic on time-varying graphs based on Dykstra's algorithm, or…

Optimization and Control · Mathematics 2018-08-23 C. H. Jeffrey Pang
‹ Prev 1 2 3 10 Next ›