English
Related papers

Related papers: Task Embedded Coordinate Update: A Realizable Fram…

200 papers

In this paper we consider the problem of minimizing a convex function using a randomized block coordinate descent method. One of the key steps at each iteration of the algorithm is determining the update to a block of variables. Existing…

Optimization and Control · Mathematics 2014-12-11 Rachael Tappenden , Peter Richtárik , Jacek Gondzio

This paper presents a new approach to solve linear and nonlinear model predictive control (MPC) problems that requires small memory footprint and throughput and is particularly suitable when the model and/or controller parameters change at…

Optimization and Control · Mathematics 2021-03-25 Nilay Saraf , Alberto Bemporad

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

In this paper, we propose an inexact block coordinate descent algorithm for large-scale nonsmooth nonconvex optimization problems. At each iteration, a particular block variable is selected and updated by inexactly solving the original…

Optimization and Control · Mathematics 2019-12-12 Yang Yang , Marius Pesavento , Zhi-Quan Luo , Björn Ottersten

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

Nonconvex optimization problems arise in many areas of computational science and engineering and are (approximately) solved by a variety of algorithms. Existing algorithms usually only have local convergence or subsequence convergence of…

Optimization and Control · Mathematics 2015-08-21 Yangyang Xu , Wotao Yin

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

Optimization and Control · Mathematics 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

Quantum machines are among the most promising technologies expected to provide significant improvements in the following years. However, bridging the gap between real-world applications and their implementation on quantum hardware is still…

This paper deals with convex nonsmooth optimization problems. We introduce a general smooth approximation framework for the original function and apply random (accelerated) coordinate descent methods for minimizing the corresponding smooth…

Optimization and Control · Mathematics 2024-01-10 Flavia Chorobura , Ion Necoara

Block-coordinate descent (BCD) is the method of choice to solve numerous large scale optimization problems, however their theoretical study for non-convex optimization, has received less attention. In this paper, we present a new…

Machine Learning · Computer Science 2026-01-30 Guillaume Lauga

Alternating Direction Method of Multiplier (ADMM) has been a popular algorithmic framework for separable optimization problems with linear constraints. For numerical ADMM fail to exploit the particular structure of the problem at hand nor…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Risheng Liu , Pan Mu , Jin Zhang

In this paper we develop random block coordinate gradient descent methods for minimizing large scale linearly constrained separable convex problems over networks. Since we have coupled constraints in the problem, we devise an algorithm that…

Optimization and Control · Mathematics 2015-12-14 I. Necoara , Yu. Nesterov , F. Glineur

In convex optimization, continuous-time counterparts have been a fruitful tool for analyzing momentum algorithms. Fewer such examples are available when the function to minimize is non-convex. In several cases, discrepancies arise between…

Optimization and Control · Mathematics 2026-01-07 Julien Hermant , Jean-François Aujol , Charles Dossal , Lorick Huang , Aude Rondepierre

Distributed optimization is an essential paradigm to solve large-scale optimization problems in modern applications where big-data and high-dimensionality creates a computational bottleneck. Distributed optimization algorithms that exhibit…

Systems and Control · Electrical Eng. & Systems 2023-05-25 Aayushya Agarwal , Larry Pileggi

With rapid integration of power sources with uncertainty, robustness must be carefully considered in the transmission constrained unit commitment (TCUC) problem. The overall computational complexity of the robust TCUC methods is closely…

Optimization and Control · Mathematics 2018-10-16 Xuan Li , Qiaozhu Zhai , Xiaohong Guan

Motivated by the need for decentralized learning, this paper aims at designing a distributed algorithm for solving nonconvex problems with general linear constraints over a multi-agent network. In the considered problem, each agent owns…

Optimization and Control · Mathematics 2022-06-23 Jiawei Zhang , Songyang Ge , Tsung-Hui Chang , Zhi-Quan Luo

In recent years, the embedding approach for solving switched optimal control problems has been developed in a series of papers. However, the embedding approach, which advantageously converts the hybrid optimal control problem to a classical…

Optimization and Control · Mathematics 2018-04-04 Richard Meyer , Miloš Žefran , Raymond A. DeCarlo

Nonconvex optimization is central to modern machine learning, but the general framework of nonconvex optimization yields weak convergence guarantees that are too pessimistic compared to practice. On the other hand, while convexity enables…

Machine Learning · Computer Science 2025-02-19 Artem Riabinin , Ahmed Khaled , Peter Richtárik

Decentralized non-convex optimization is important in many problems of practical relevance. Existing decentralized methods, however, typically either lack convergence guarantees for general non-convex problems, or they suffer from a high…

Optimization and Control · Mathematics 2025-10-20 Gösta Stomberg , Alexander Engelmann , Timm Faulwasser