中文
相关论文

相关论文: Linear Convergence of First- and Zeroth-Order Prim…

200 篇论文

This paper considers nonconvex distributed constrained optimization over networks, modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic framework for the minimization of the sum of a smooth nonconvex…

最优化与控制 · 数学 2018-09-05 Gesualdo Scutari , Ying Sun

Distributed zeroth-order optimization is increasingly applied in heterogeneous scenarios where agents possess distinct data distributions and objectives. This heterogeneity poses fundamental challenges for convergence analysis, as existing…

最优化与控制 · 数学 2026-02-10 Haonan Wang , Xinlei Yi , Yiguang Hong , Minghui Liwang

We study distributed optimization to minimize a global objective that is a sum of smooth and strongly-convex local cost functions. Recently, several algorithms over undirected and directed graphs have been proposed that use a gradient…

最优化与控制 · 数学 2018-08-13 Ran Xin , Usman A. Khan

We consider distributed nonconvex optimization over an undirected network, where each node privately possesses its local objective and communicates exclusively with its neighboring nodes, striving to collectively achieve a common optimal…

最优化与控制 · 数学 2026-03-11 Zichong Ou , Jie Lu

The primal-dual distributed optimization methods have broad large-scale machine learning applications. Previous primal-dual distributed methods are not applicable when the dual formulation is not available, e.g. the sum-of-non-convex…

机器学习 · 计算机科学 2017-10-30 Zhouyuan Huo , Heng Huang

We consider minimizing the sum of three convex functions, where the first one F is smooth, the second one is nonsmooth and proximable and the third one is the composition of a nonsmooth proximable function with a linear operator L. This…

最优化与控制 · 数学 2022-07-27 Adil Salim , Laurent Condat , Konstantin Mishchenko , Peter Richtárik

Constrained optimization problems where both the objective and constraints may be nonsmooth and nonconvex arise across many learning and data science settings. In this paper, we show for any Lipschitz, weakly convex objectives and…

最优化与控制 · 数学 2025-01-17 Zhichao Jia , Benjamin Grimmer

Economic dispatch problem for a networked power system has been considered. The objective is to minimize the total generation cost while meeting the overall supply-demand balance and generation capacity. In particular, a more practical…

系统与控制 · 计算机科学 2019-05-01 Seungjoon Lee , Hyungbo Shim

This paper presents a canonical dual approach for solving a nonconvex global optimization problem governed by a sum of fourth-order polynomial and a log-sum-exp function. Such a problem arises extensively in engineering and sciences. Based…

最优化与控制 · 数学 2014-01-30 Yi Chen , David Y Gao

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

分布式、并行与集群计算 · 计算机科学 2024-02-20 Richard Heusdens , Guoqiang Zhang

Distributed multi-agent optimization finds many applications in distributed learning, control, estimation, etc. Most existing algorithms assume knowledge of first-order information of the objective and have been analyzed for convex…

最优化与控制 · 数学 2020-06-17 Yujie Tang , Junshan Zhang , Na Li

In this paper, we develop a novel distributed algorithm for addressing convex optimization with both nonlinear inequality and linear equality constraints, where the objective function can be a general nonsmooth convex function and all the…

最优化与控制 · 数学 2021-02-26 Xuyang Wu , He Wang , Jie Lu

In this paper, we develop a distributed mixing-accelerated primal-dual proximal algorithm, referred to as MAP-Pro, which enables nodes in multi-agent networks to cooperatively minimize the sum of their nonconvex, smooth local cost functions…

最优化与控制 · 数学 2024-03-12 Zichong Ou , Chenyang Qiu , Dandan Wang , Jie Lu

The paper considers the problem of network-based computation of global minima in smooth nonconvex optimization problems. It is known that distributed gradient-descent-type algorithms can achieve convergence to the set of global minima by…

最优化与控制 · 数学 2019-10-24 Brian Swenson , Anirudh Sridhar , H. Vincent Poor

The filtering-clustering models, including trend filtering and convex clustering, have become an important source of ideas and modeling tools in machine learning and related fields. The statistical guarantee of optimal solutions in these…

机器学习 · 统计学 2022-01-26 Nhat Ho , Tianyi Lin , Michael I. Jordan

We present a numerical iterative optimization algorithm for the minimization of a cost function consisting of a linear combination of three convex terms, one of which is differentiable, a second one is prox-simple and the third one is the…

最优化与控制 · 数学 2024-10-04 Ignace Loris , Simone Rebegoldi

The paper proves convergence to global optima for a class of distributed algorithms for nonconvex optimization in network-based multi-agent settings. Agents are permitted to communicate over a time-varying undirected graph. Each agent is…

最优化与控制 · 数学 2019-03-19 Brian Swenson , Soummya Kar , H. Vincent Poor , Jose' M. F. Moura

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

最优化与控制 · 数学 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

We propose a simple, stable and distributed algorithm which directly optimizes the nonconvex maximum likelihood criterion for sensor network localization, with no need to tune any free parameter. We reformulate the problem to obtain a…

最优化与控制 · 数学 2015-09-24 Claudia Soares , Joao Xavier , Joao Gomes

The standard assumption for proving linear convergence of first order methods for smooth convex optimization is the strong convexity of the objective function, an assumption which does not hold for many practical applications. In this…

最优化与控制 · 数学 2016-08-10 I. Necoara , Yu. Nesterov , F. Glineur