中文
相关论文

相关论文: Stabilized Proximal-Point Methods for Federated Op…

200 篇论文

This paper proposes distributed discrete-time algorithms to cooperatively solve an additive cost optimization problem in multi-agent networks. The striking feature lies in the use of only the sign of relative state information between…

系统与控制 · 计算机科学 2018-12-11 Jiaqi Zhang , Keyou You , Tamer Başar

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Modern realities and trends in learning require more and more generalization ability of models, which leads to an increase in both models and training sample size. It is already difficult to solve such tasks in a single device mode. This is…

最优化与控制 · 数学 2024-12-03 Dmitry Bylinkin , Kirill Degtyarev , Aleksandr Beznosikov

With distributed machine learning being a prominent technique for large-scale machine learning tasks, communication complexity has become a major bottleneck for speeding up training and scaling up machine numbers. In this paper, we propose…

机器学习 · 计算机科学 2023-09-26 Pengyun Yue , Hanzhen Zhao , Cong Fang , Di He , Liwei Wang , Zhouchen Lin , Song-chun Zhu

The paper studies distributed Dictionary Learning (DL) problems where the learning task is distributed over a multi-agent network with time-varying (nonsymmetric) connectivity. This formulation is relevant, for instance, in big-data…

最优化与控制 · 数学 2016-12-23 Amir Daneshmand , Gesualdo Scutari , Francisco Facchinei

Speech dereverberation aims to alleviate the negative impact of late reverberant reflections. The weighted prediction error (WPE) method is a well-established technique known for its superior performance in dereverberation. However, in…

音频与语音处理 · 电气工程与系统科学 2023-12-07 Ziye Yang , Mengfei Zhang , Jie Chen

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

最优化与控制 · 数学 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

In this paper we consider a novel partitioned framework for distributed optimization in peer-to-peer networks. In several important applications the agents of a network have to solve an optimization problem with two key features: (i) the…

系统与控制 · 计算机科学 2018-05-23 Ivano Notarnicola , Ruggero Carli , Giuseppe Notarstefano

This paper develops a distributed primal-dual algorithm via event-triggered mechanism to solve a class of convex optimization problems subject to local set constraints, coupled equality and inequality constraints. Different from some…

最优化与控制 · 数学 2022-10-27 Yi Huang , Xianlin Zeng , Ziyang Meng , Jian Sun

We study dual-based algorithms for distributed convex optimization problems over networks, where the objective is to minimize a sum $\sum_{i=1}^{m}f_i(z)$ of functions over in a network. We provide complexity bounds for four different…

最优化与控制 · 数学 2020-03-17 César A. Uribe , Soomin Lee , Alexander Gasnikov , Angelia Nedić

We study distributed adaptive algorithms with local updates (intermittent communication). Despite the great empirical success of adaptive methods in distributed training of modern machine learning models, the theoretical benefits of local…

机器学习 · 计算机科学 2025-02-13 Ziheng Cheng , Margalit Glasgow

This paper investigates the distributed fixed point seeking problem of sum-separable stochastic operators over the multi-agent network. Based on inexact Krasnosel'ski\u{\i}--Mann iterations, the communication-efficient distributed algorithm…

最优化与控制 · 数学 2026-05-22 Fan Li , Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Tao Yang

In this paper we consider a distributed optimization scenario in which the aggregate objective function to minimize is partitioned, big-data and possibly non-convex. Specifically, we focus on a set-up in which the dimension of the decision…

分布式、并行与集群计算 · 计算机科学 2017-03-27 Ivano Notarnicola , Giuseppe Notarstefano

The Distributed Adaptive Signal Fusion (DASF) framework is a meta-algorithm for computing data-driven spatial filters in a distributed sensing platform with limited bandwidth and computational resources, such as a wireless sensor network.…

信号处理 · 电气工程与系统科学 2024-05-07 Charles Hovine , Alexander Bertrand

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

最优化与控制 · 数学 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

机器学习 · 计算机科学 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

最优化与控制 · 数学 2024-06-21 Sajad Zandi , Mehdi Korki

In this paper we introduce a class of novel distributed algorithms for solving stochastic big-data convex optimization problems over directed graphs. In the addressed set-up, the dimension of the decision variable can be extremely high and…

最优化与控制 · 数学 2020-10-06 Francesco Farina , Giuseppe Notarstefano

We consider problems where agents in a network seek a common quantity, measured independently and periodically by each agent through a local time-varying process. Numerous solvers addressing such problems have been developed in the past,…

最优化与控制 · 数学 2024-03-08 Navneet Agrawal , Renato L. G. Cavalcante , Sławomir Stańczak

We propose a distributed algorithm, termed the Directed-Distributed Projected Subgradient (D-DPS), to solve a constrained optimization problem over a multi-agent network, where the goal of agents is to collectively minimize the sum of…

最优化与控制 · 数学 2016-08-30 Chenguang Xi , Usman A. Khan