中文
相关论文

相关论文: A Distributed Frank-Wolfe Algorithm for Communicat…

200 篇论文

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

We consider the problem of communication efficient distributed optimization where multiple nodes exchange important algorithm information in every iteration to solve large problems. In particular, we focus on the stochastic variance-reduced…

机器学习 · 计算机科学 2020-03-16 Hossein S. Ghadikolaei , Sindri Magnusson

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

机器学习 · 计算机科学 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi

In this paper, we focus on an aggregative optimization problem under the communication bottleneck. The aggregative optimization is to minimize the sum of local cost functions. Each cost function depends on not only local state variables but…

最优化与控制 · 数学 2022-01-07 Ziqin Chen , Shu Liang

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

机器学习 · 计算机科学 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

The provision of communication services via portable and mobile devices, such as aerial base stations, is a crucial concept to be realized in 5G/6G networks. Conventionally, IoT/edge devices need to transmit the data directly to the base…

机器学习 · 计算机科学 2022-01-21 Sunder Ali Khowaja , Kapal Dev , Parus Khuwaja , Paolo Bellavista

Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy concerns. Both of these…

机器学习 · 统计学 2021-10-19 Constance Beguier , Mathieu Andreux , Eric W. Tramel

We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when…

最优化与控制 · 数学 2019-05-28 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

In distributed statistical learning, $N$ samples are split across $m$ machines and a learner wishes to use minimal communication to learn as well as if the examples were on a single machine. This model has received substantial interest in…

机器学习 · 计算机科学 2019-03-19 Jayadev Acharya , Christopher De Sa , Dylan J. Foster , Karthik Sridharan

Federated learning involves training statistical models in massive, heterogeneous networks. Naively minimizing an aggregate loss function in such a network may disproportionately advantage or disadvantage some of the devices. In this work,…

机器学习 · 计算机科学 2020-02-18 Tian Li , Maziar Sanjabi , Ahmad Beirami , Virginia Smith

In this paper, a distributed optimization problem is investigated via input feedforward passivity. First, an input-feedforward-passivity-based continuous-time distributed algorithm is proposed. It is shown that the error system of the…

最优化与控制 · 数学 2022-05-02 Mengmou Li , Graziano Chesi , Yiguang Hong

Split learning is a simple solution for Vertical Federated Learning (VFL), which has drawn substantial attention in both research and application due to its simplicity and efficiency. However, communication efficiency is still a crucial…

机器学习 · 计算机科学 2024-01-25 Fei Zheng , Chaochao Chen , Lingjuan Lyu , Binhui Yao

Federated clustering, an integral aspect of federated machine learning, enables multiple data sources to collaboratively cluster their data, maintaining decentralization and preserving privacy. In this paper, we introduce a novel federated…

机器学习 · 计算机科学 2023-11-20 Patrick Holzer , Tania Jacob , Shubham Kavane

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

最优化与控制 · 数学 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

In this paper, the problem of energy efficient transmission and computation resource allocation for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local…

信息论 · 计算机科学 2020-11-19 Zhaohui Yang , Mingzhe Chen , Walid Saad , Choong Seon Hong , Mohammad Shikh-Bahaei

A distributed spiral algorithm for distributed optimization in WSN is proposed. By forming a spiral-shape message passing scheme among clusters, without loss of estimation accuracy and convergence speed, the algorithm is proved to converge…

网络与互联网体系结构 · 计算机科学 2008-09-22 Zheng Sun

This letter proposes a sparse diffusion steepest-descent algorithm for one bit compressed sensing in wireless sensor networks. The approach exploits the diffusion strategy from distributed learning in the one bit compressed sensing…

机器学习 · 统计学 2016-01-05 Hadi Zayyani , Mehdi Korki , Farrokh Marvasti

We study a standard distributed optimization framework where $N$ networked nodes collaboratively minimize the sum of their local convex costs. The main body of existing work considers the described problem when the underling network is…

最优化与控制 · 数学 2018-03-22 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

Similarity and metric learning provides a principled approach to construct a task-specific similarity from weakly supervised data. However, these methods are subject to the curse of dimensionality: as the number of features grows large,…

机器学习 · 统计学 2019-09-10 Kuan Liu , Aurélien Bellet

Deep-learning (DL) has emerged as a powerful machine-learning technique for several classic problems encountered in generic wireless communications. Specifically, random Fourier Features (RFF) based deep-learning has emerged as an…

信息论 · 计算机科学 2021-01-14 Rangeet Mitra , Georges Kaddoum