English
Related papers

Related papers: A Distributed Frank-Wolfe Algorithm for Communicat…

200 papers

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning (FL) enables distributed clients to collaboratively train a machine learning model without sharing raw data with each other. However, it suffers the leakage of private information from uploading models. In addition, as…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-25 Kang Wei , Jun Li , Chuan Ma , Ming Ding , Feng Shu , Haitao Zhao , Wen Chen , Hongbo Zhu

The design of decentralized learning algorithms is important in the fast-growing world in which data are distributed over participants with limited local computation resources and communication. In this direction, we propose an online…

Machine Learning · Computer Science 2022-08-02 Angan Mitra , Nguyen Kim Thang , Tuan-Anh Nguyen , Denis Trystram , Paul Youssef

Intelligent mobile platforms such as smart vehicles and drones have recently become the focus of attention for onboard deployment of machine learning mechanisms to enable low latency decisions with low risk of privacy breach. However, most…

Information Theory · Computer Science 2019-05-22 Kai Yang , Yuanming Shi , Zhi Ding

In this paper, we study communication efficient distributed algorithms for distributionally robust federated learning via periodic averaging with adaptive sampling. In contrast to standard empirical risk minimization, due to the minimax…

Machine Learning · Computer Science 2021-02-26 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

Distributed optimization is fundamental to modern machine learning applications like federated learning, but existing methods often struggle with ill-conditioned problems and face stability-versus-speed tradeoffs. We introduce fractional…

Machine Learning · Computer Science 2024-12-04 Andrei Lixandru , Marcel van Gerven , Sergio Pequito

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

In this paper, we describe a general algorithmic framework for solving linear signal or feature fusion optimization problems in a distributed setting, for example in a wireless sensor network (WSN). These problems require linearly combining…

Signal Processing · Electrical Eng. & Systems 2023-05-12 Cem Ates Musluoglu , Alexander Bertrand

In the context of gridless sparse optimization, the Sliding Frank Wolfe algorithm recently introduced has shown interesting analytical and practical properties. Nevertheless, is application to large data, such as in the case of 3D…

Image and Video Processing · Electrical Eng. & Systems 2020-09-14 Jean-Baptiste Courbot , Bruno Colicchio

Wireless sensor networks consist of sensor nodes that are physically distributed over different locations. Spatial filtering procedures exploit the spatial correlation across these sensor signals to fuse them into a filtered signal…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Cem Ates Musluoglu , Alexander Bertrand

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

Optimal transport (OT), which provides a distance between two probability distributions by considering their spatial locations, has been applied to widely diverse applications. Computing an OT problem requires solution of linear programming…

Machine Learning · Computer Science 2021-03-11 Takumi Fukunaga , Hiroyuki Kasai

Distributed learning algorithms, such as the ones employed in Federated Learning (FL), require communication compression to reduce the cost of client uploads. The compression methods used in practice are often biased, making error feedback…

Machine Learning · Computer Science 2025-09-12 Tomas Ortega , Chun-Yin Huang , Xiaoxiao Li , Hamid Jafarkhani

The growing demands of remote detection and increasing amount of training data make distributed machine learning under communication constraints a critical issue. This work provides a communication-efficient quantum algorithm that tackles…

Quantum Physics · Physics 2023-04-26 Hao Tang , Boning Li , Guoqing Wang , Haowei Xu , Changhao Li , Ariel Barr , Paola Cappellaro , Ju Li

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

Machine Learning · Computer Science 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Federated learning has become a promising distributed learning concept with extra insurance on data privacy. Extensive studies on various models of Federated learning have been done since the coinage of its term. One of the important…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Amir Ali-Pour , Sadra Bekrani , Laya Samizadeh , Julien Gascon-Samson

Federated learning faces challenges due to the heterogeneity in data volumes and distributions at different clients, which can compromise model generalization ability to various distributions. Existing approaches to address this issue based…

Machine Learning · Computer Science 2024-11-13 Zhishuai Guo , Tianbao Yang