中文
相关论文

相关论文: A Distributed Frank-Wolfe Algorithm for Communicat…

200 篇论文

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

机器学习 · 计算机科学 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) enables distributed clients to collaboratively train a machine learning model without sharing raw data with each other. However, it suffers the leakage of private information from uploading models. In addition, as…

分布式、并行与集群计算 · 计算机科学 2023-12-25 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Feng Shu , Haitao Zhao , Wen Chen , Hongbo Zhu

The design of decentralized learning algorithms is important in the fast-growing world in which data are distributed over participants with limited local computation resources and communication. In this direction, we propose an online…

机器学习 · 计算机科学 2022-08-02 Angan Mitra , Nguyen Kim Thang , Tuan-Anh Nguyen , Denis Trystram , Paul Youssef

Intelligent mobile platforms such as smart vehicles and drones have recently become the focus of attention for onboard deployment of machine learning mechanisms to enable low latency decisions with low risk of privacy breach. However, most…

信息论 · 计算机科学 2019-05-22 Kai Yang , Yuanming Shi , Zhi Ding

In this paper, we study communication efficient distributed algorithms for distributionally robust federated learning via periodic averaging with adaptive sampling. In contrast to standard empirical risk minimization, due to the minimax…

机器学习 · 计算机科学 2021-02-26 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Distributed optimization is fundamental to modern machine learning applications like federated learning, but existing methods often struggle with ill-conditioned problems and face stability-versus-speed tradeoffs. We introduce fractional…

机器学习 · 计算机科学 2024-12-04 Andrei Lixandru , Marcel van Gerven , Sergio Pequito

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

多智能体系统 · 计算机科学 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

In this paper, we describe a general algorithmic framework for solving linear signal or feature fusion optimization problems in a distributed setting, for example in a wireless sensor network (WSN). These problems require linearly combining…

信号处理 · 电气工程与系统科学 2023-05-12 Cem Ates Musluoglu , Alexander Bertrand

In the context of gridless sparse optimization, the Sliding Frank Wolfe algorithm recently introduced has shown interesting analytical and practical properties. Nevertheless, is application to large data, such as in the case of 3D…

图像与视频处理 · 电气工程与系统科学 2020-09-14 Jean-Baptiste Courbot , Bruno Colicchio

Wireless sensor networks consist of sensor nodes that are physically distributed over different locations. Spatial filtering procedures exploit the spatial correlation across these sensor signals to fuse them into a filtered signal…

信号处理 · 电气工程与系统科学 2022-11-04 Cem Ates Musluoglu , Alexander Bertrand

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

最优化与控制 · 数学 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

机器学习 · 计算机科学 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai

Distributed learning algorithms, such as the ones employed in Federated Learning (FL), require communication compression to reduce the cost of client uploads. The compression methods used in practice are often biased, making error feedback…

机器学习 · 计算机科学 2025-09-12 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

The growing demands of remote detection and increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication-efficient quantum algorithm that tackles…

量子物理 · 物理学 2023-04-26 Hao Tang , Boning Li , Guoqing Wang , Haowei Xu , Changhao Li , Ariel Barr , Paola Cappellaro , Ju Li

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

机器学习 · 计算机科学 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

机器学习 · 计算机科学 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

分布式、并行与集群计算 · 计算机科学 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Federated learning has become a promising distributed learning concept with extra insurance on data privacy. Extensive studies on various models of Federated learning have been done since the coinage of its term. One of the important…

分布式、并行与集群计算 · 计算机科学 2025-04-24 Amir Ali-Pour , Sadra Bekrani , Laya Samizadeh , Julien Gascon-Samson

Federated learning faces challenges due to the heterogeneity in data volumes and distributions at different clients, which can compromise model generalization ability to various distributions. Existing approaches to address this issue based…

机器学习 · 计算机科学 2024-11-13 Zhishuai Guo , Tianbao Yang