English
Related papers

Related papers: Distributed proximal gradient algorithm for non-sm…

200 papers

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning…

Optimization and Control · Mathematics 2020-06-17 Sulaiman A. Alghunaim , Ming Yan , Ali H. Sayed

In this paper we consider distributed optimization problems in which the cost function is separable (i.e., a sum of possibly non-smooth functions all sharing a common variable) and can be split into a strongly convex term and a convex one.…

Optimization and Control · Mathematics 2016-09-20 Ivano Notarnicola , Giuseppe Notarstefano

We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization…

Optimization and Control · Mathematics 2021-06-16 Van Sy Mai , Richard J. La , Tao Zhang , Abdella Battou

In this paper, we study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

This technical note studies a class of distributed nonsmooth convex consensus optimization problem. The cost function is a summation of local cost functions which are convex but nonsmooth. Each of the local cost functions consists of a…

Optimization and Control · Mathematics 2018-08-17 Yue Wei , Hao Fang , Xianlin Zeng , Jie Chen , Panos M. Pardalos

In this work, we consider the distributed optimization of non-smooth convex functions using a network of computing units. We investigate this problem under two regularity assumptions: (1) the Lipschitz continuity of the global objective…

Optimization and Control · Mathematics 2018-06-04 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

Decentralized optimization strategies are helpful for various applications, from networked estimation to distributed machine learning. This paper studies finite-sum minimization problems described over a network of nodes and proposes a…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

This technical note studies the distributed optimization problem of a sum of nonsmooth convex cost functions with local constraints. At first, we propose a novel distributed continuous-time projected algorithm, in which each agent knows its…

Optimization and Control · Mathematics 2016-11-29 Xianlin Zeng , Peng Yi , Yiguang Hong

This paper studies a distributed multi-agent convex optimization problem. The system comprises multiple agents in this problem, each with a set of local data points and an associated local cost function. The agents are connected to a…

Optimization and Control · Mathematics 2021-08-20 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

In this paper we consider a distributed stochastic optimization problem without the gradient/subgradient information for the local objective functions, subject to local convex constraints. The objective functions may be non-smooth and…

Systems and Control · Computer Science 2018-06-25 Yinghui Wang , Wenxiao Zhao , Yiguang Hong , Mohsen Zamani

While many distributed optimization algorithms have been proposed for solving smooth or convex problems over the networks, few of them can handle non-convex and non-smooth problems. Based on a proximal primal-dual approach, this paper…

Optimization and Control · Mathematics 2021-09-01 Zhiguo Wang , Jiawei Zhang , Tsung-Hui Chang , Jian Li , Zhi-Quan Luo

We study nonconvex distributed optimization in multi-agent networks with time-varying (nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed minimization of the sum of a smooth (possibly nonconvex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Paolo Di Lorenzo , Gesualdo Scutari

We study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex (possibly) nonsmooth…

Optimization and Control · Mathematics 2018-09-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

We study non-smooth stochastic decentralized optimization problems over time-varying networks, where objective functions are distributed across nodes and network connections may intermittently appear or break. Specifically, we consider two…

Optimization and Control · Mathematics 2026-04-28 Maxim Divilkovskiy , Alexander Gasnikov

In this paper, a distributed optimization problem with general differentiable convex objective functions is studied for single-integrator and double-integrator multi-agent systems. Two distributed adaptive optimization algorithm is…

Optimization and Control · Mathematics 2017-03-28 Peng Lin , Wei Ren

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

This paper focuses on stochastic proximal gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer and convex constraints. To the best of our knowledge we present the first non-asymptotic…

Optimization and Control · Mathematics 2019-05-27 Michael R. Metel , Akiko Takeda