中文
相关论文

相关论文: Distributed Saddle-Point Problems Under Similarity

200 篇论文

We address distributed learning problems, both nonconvex and convex, over undirected networks. In particular, we design a novel algorithm based on the distributed Alternating Direction Method of Multipliers (ADMM) to address the challenges…

机器学习 · 计算机科学 2026-03-23 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

We consider strongly-convex-strongly-concave saddle point problems assuming we have access to unbiased stochastic estimates of the gradients. We propose a stochastic accelerated primal-dual (SAPD) algorithm and show that SAPD sequence,…

最优化与控制 · 数学 2024-09-04 Xuan Zhang , Necdet Serhat Aybat , Mert Gürbüzbalaban

Distributed cooperative localization in wireless networks is a challenging problem since it typically requires solving a large-scale nonconvex and nonsmooth optimization problem. In this paper, we reformulate the classic cooperative…

最优化与控制 · 数学 2023-08-08 Mei Zhang , Zhiguo Wang , Feng Yin , Xiaojing Shen

We consider strongly-convex-strongly-concave saddle-point problems with general non-bilinear objective and different condition numbers with respect to the primal and the dual variables. First, we consider such problems with smooth composite…

We present a novel accelerated primal-dual (APD) method for solving a class of deterministic and stochastic saddle point problems (SPP). The basic idea of this algorithm is to incorporate a multi-step acceleration scheme into the…

最优化与控制 · 数学 2013-09-24 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

机器学习 · 计算机科学 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

最优化与控制 · 数学 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

In this paper, we present a distributed algorithm for solving convex, constraint-coupled, optimization problems over peer-to-peer networks. We consider a network of processors that aim to cooperatively minimize the sum of local cost…

最优化与控制 · 数学 2021-04-14 Andrea Camisa , Alessia Benevento , Giuseppe Notarstefano

We consider a general multi-agent convex optimization problem where the agents are to collectively minimize a global objective function subject to a global inequality constraint, a global equality constraint, and a global constraint set.…

最优化与控制 · 数学 2011-05-13 Minghui Zhu , Sonia Martinez

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

最优化与控制 · 数学 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

In this paper, we study the lower iteration complexity bounds for finding the saddle point of a strongly convex and strongly concave saddle point problem: $\min_x\max_yF(x,y)$. We restrict the classes of algorithms in our investigation to…

最优化与控制 · 数学 2021-06-22 Junyu Zhang , Mingyi Hong , Shuzhong Zhang

We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the $\ell_1$ setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly…

最优化与控制 · 数学 2025-11-17 Tomás González , Cristóbal Guzmán , Courtney Paquette

In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and…

多智能体系统 · 计算机科学 2016-01-18 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song

This paper presents a novel sensitivity-based distributed programming (SBDP) approach for non-convex, large-scale nonlinear programs (NLP). The algorithm relies on first-order sensitivities to cooperatively solve the central NLP in a…

最优化与控制 · 数学 2026-03-30 Maximilian Pierer von Esch , Andreas Völz , Knut Graichen

We study finite-sum distributed optimization problems involving a master node and $n-1$ local nodes under the popular $\delta$-similarity and $\mu$-strong convexity conditions. We propose two new algorithms, SVRS and AccSVRS, motivated by…

机器学习 · 计算机科学 2023-10-31 Dachao Lin , Yuze Han , Haishan Ye , Zhihua Zhang

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

最优化与控制 · 数学 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

This paper focuses on a distributed coupled constrained convex optimization problem over directed unbalanced and time-varying multi-agent networks, where the global objective function is the sum of all agents' private local objective…

最优化与控制 · 数学 2023-10-25 Kai Gong , Liwei Zhang

Federated learning (FL) approaches for saddle point problems (SPP) have recently gained in popularity due to the critical role they play in machine learning (ML). Existing works mostly target smooth unconstrained objectives in Euclidean…

机器学习 · 计算机科学 2024-09-17 Site Bai , Brian Bullins

Densest Subgraph Problem (DSP) is an important primitive problem with a wide range of applications, including fraud detection, community detection and DNA motif discovery. Edge-based density is one of the most common metrics in DSP.…

数据库 · 计算机科学 2023-10-31 Yugao Zhu , Shenghua Liu , Wenjie Feng , Xueqi Cheng

The Shortest-Path Problem in Graph of Convex Sets (SPP in GCS) is a recently developed optimization framework that blends discrete and continuous decision making. Many relevant problems in robotics, such as collision-free motion planning,…