English
Related papers

Related papers: Composite Optimization Algorithms for Sigmoid Netw…

200 papers

In this paper, we study the problem of minimizing a sum of convex objective functions, which are locally available to agents in a network. Distributed optimization algorithms make it possible for the agents to cooperatively solve the…

Optimization and Control · Mathematics 2020-03-31 Fatemeh Mansoori , Ermin Wei

Finding multiple solutions of non-convex optimization problems is a ubiquitous yet challenging task. Most past algorithms either apply single-solution optimization methods from multiple random initial guesses or search in the vicinity of…

Machine Learning · Computer Science 2023-03-03 Lingxiao Li , Noam Aigerman , Vladimir G. Kim , Jiajin Li , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

In this paper, we propose a successive convex approximation framework for sparse optimization where the nonsmooth regularization function in the objective function is nonconvex and it can be written as the difference of two convex…

Machine Learning · Computer Science 2018-10-26 Yang Yang , Marius Pesavento , Symeon Chatzinotas , Björn Ottersten

In the paper, we develop a composite version of Mirror Prox algorithm for solving convex-concave saddle point problems and monotone variational inequalities of special structure, allowing to cover saddle point/variational analogies of what…

Optimization and Control · Mathematics 2014-05-23 Niao He , Anatoli Juditsky , Arkadi Nemirovski

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

In this paper, we consider solving a class of convex optimization problem which minimizes the sum of three convex functions $f(x)+g(x)+h(Bx)$, where $f(x)$ is differentiable with a Lipschitz continuous gradient, $g(x)$ and $h(x)$ have a…

Optimization and Control · Mathematics 2019-04-30 Yu-Chao Tang , Guo-Rong Wu , Chuan-Xi Zhu

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and…

Multiagent Systems · Computer Science 2016-01-18 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

This article reviews recent advances in convex optimization algorithms for Big Data, which aim to reduce the computational, storage, and communications bottlenecks. We provide an overview of this emerging field, describe contemporary…

Optimization and Control · Mathematics 2014-11-05 Volkan Cevher , Stephen Becker , Mark Schmidt

This letter investigates a channel assignment problem in uplink wireless communication systems. Our goal is to maximize the sum rate of all users subject to integer channel assignment constraints. A convex optimization based algorithm is…

Signal Processing · Electrical Eng. & Systems 2020-01-14 Guangyu Jia , Zhaohui Yang , Hak-Keung Lam , Jianfeng Shi , Mohammad Shikh-Bahaei

We consider strongly-convex-strongly-concave saddle-point problems with general non-bilinear objective and different condition numbers with respect to the primal and the dual variables. First, we consider such problems with smooth composite…

Optimization and Control · Mathematics 2021-06-15 Vladislav Tominin , Yaroslav Tominin , Ekaterina Borodich , Dmitry Kovalev , Alexander Gasnikov , Pavel Dvurechensky

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function so that along the iterations the objective function decreases. Such a simple principle allows to solve a large…

Optimization and Control · Mathematics 2025-03-04 Ion Necoara , Daniela Lupu

This paper addresses a distributed convex optimization problem with a class of coupled constraints, which arise in a multi-agent system composed of multiple communities modeled by cliques. First, we propose a fully distributed…

Optimization and Control · Mathematics 2022-11-21 Yuto Watanabe , Kazunori Sakurama

The problem of minimizing a sum of local convex objective functions over a networked system captures many important applications and has received much attention in the distributed optimization field. Most of existing work focuses on…

Optimization and Control · Mathematics 2019-01-09 Fatemeh Mansoori , Ermin Wei

This paper introduces an abstract framework for randomized subspace correction methods for convex optimization, which unifies and generalizes a broad class of existing algorithms, including domain decomposition, multigrid, and block…

Optimization and Control · Mathematics 2026-04-28 Boou Jiang , Jongho Park , Jinchao Xu

There has been a growing effort in studying the distributed optimization problem over a network. The objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. Literature…

Optimization and Control · Mathematics 2017-05-02 Guannan Qu , Na Li

We consider the problem of minimizing a sum of several convex non-smooth functions. We introduce a new algorithm called the selective linearization method, which iteratively linearizes all but one of the functions and employs simple…

Optimization and Control · Mathematics 2016-08-16 Yu Du , Xiaodong Lin , Andrzej Ruszczynski