English
Related papers

Related papers: Decentralized non-convex optimization via bi-level…

200 papers

We propose a distributed design method for decentralized control by exploiting the underlying sparsity properties of the problem. Our method is based on chordal decomposition of sparse block matrices and the alternating direction method of…

Optimization and Control · Mathematics 2020-08-07 Yang Zheng , Maryam Kamgarpour , Aivar Sootla , Antonis Papachristodoulou

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad

Elliptic optimal control problems with pointwise box constraints on the control (EOCP) are considered. To solve EOCP, the primal-dual active set (PDAS) method, which is a special semismooth Newton (SSN) method, used to be a priority in…

Optimization and Control · Mathematics 2016-12-20 Xiaoliang Song , Bo Yu

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

Bilevel optimization has been developed for many machine learning tasks with large-scale and high-dimensional data. This paper considers a constrained bilevel optimization problem, where the lower-level optimization problem is convex with…

Machine Learning · Computer Science 2023-08-22 Siyuan Xu , Minghui Zhu

The nonconvex and nonsmooth finite-sum optimization problem with linear constraint has attracted much attention in the fields of artificial intelligence, computer, and mathematics, due to its wide applications in machine learning and the…

Optimization and Control · Mathematics 2023-07-11 Yuxuan Zeng , Zhiguo Wang , Jianchao Bai , Xiaojing Shen

In this paper, we establish the convergence properties for a majorized alternating direction method of multipliers (ADMM) for linearly constrained convex optimization problems whose objectives contain coupled functions. Our convergence…

Optimization and Control · Mathematics 2017-01-18 Ying Cui , Xudong Li , Defeng Sun , Kim-Chuan Toh

We consider a class of multi-agent cooperative consensus optimization problems with local nonlinear convex constraints where only those agents connected by an edge can directly communicate, hence, the optimal consensus decision lies in the…

Optimization and Control · Mathematics 2023-02-23 Nazanin Abolfazli , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

The alternating-current optimal power flow (ACOPF) is one of the best known non-convex non-linear optimisation problems. We present a novel re-formulation of ACOPF, which is based on lifting the rectangular power-voltage rank-constrained…

Optimization and Control · Mathematics 2018-02-20 Jakub Marecek , Martin Takac

In this paper, a stochastic alternating direction method of multipliers (ADMM) is proposed for a class of nonsmooth composite and stochastic convex optimization problems in Hilbert space, motivated by optimization problems constrained by…

Optimization and Control · Mathematics 2026-05-18 Weihua Deng , Haiming Song , Hao Wang , Jinda Yang

Quantum computing has attracted significant interest in the optimization community because it potentially can solve classes of optimization problems faster than conventional supercomputers. Several researchers proposed quantum computing…

Quantum Physics · Physics 2023-02-14 Mohammadhossein Mohammadisiahroudi , Ramin Fakhimi , Tamás Terlaky

Support vector machines (SVMs) with sparsity-inducing nonconvex penalties have received considerable attentions for the characteristics of automatic classification and variable selection. However, it is quite challenging to solve the…

Machine Learning · Statistics 2018-09-12 Lei Guan , Linbo Qiao , Dongsheng Li , Tao Sun , Keshi Ge , Xicheng Lu

This paper studies a fundamental problem in convex optimization, which is to solve semidefinite programming (SDP) with high accuracy. This paper follows from the existing robust SDP-based interior point method analysis due to [Huang, Jiang,…

Quantum Physics · Physics 2023-02-08 Baihe Huang , Shunhua Jiang , Zhao Song , Runzhou Tao , Ruizhe Zhang

Distributed nonconvex optimization underpins key functionalities of numerous distributed systems, ranging from power systems, smart buildings, cooperative robots, vehicle networks to sensor networks. Recently, it has also merged as a…

Optimization and Control · Mathematics 2024-03-18 Yanan Bo , Yongqiang Wang

Quantization of the parameters of machine learning models, such as deep neural networks, requires solving constrained optimization problems, where the constraint set is formed by the Cartesian product of many simple discrete sets. For such…

Optimization and Control · Mathematics 2021-03-02 Tianjian Huang , Prajwal Singhania , Maziar Sanjabi , Pabitra Mitra , Meisam Razaviyayn

This paper considers the decentralized optimization problem of minimizing a finite sum of strongly convex and twice continuously differentiable functions over a fixed-connected undirected network. A fully decentralized primal-dual…

Optimization and Control · Mathematics 2024-10-02 Liping Wang , Hao Wu , Hongchao Zhang

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

Optimization and Control · Mathematics 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

This paper considers decentralized optimization of convex functions with mixed affine equality constraints involving both local and global variables. Constraints on global variables may vary across different nodes in the network, while…

Optimization and Control · Mathematics 2026-02-05 Demyan Yarmoshik , Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

Although Anderson acceleration (AA) is known to speed up fixed-point iterations, it is rarely applied in constrained optimization, in particular sequential quadratic programming (SQP). We show that the local convergence behavior of a…

Optimization and Control · Mathematics 2026-04-17 Jonathan Frey , David Kiessling , Katrin Baumgärtner , Moritz Diehl