English
Related papers

Related papers: A Communication-Efficient Adaptive Algorithm for F…

200 papers

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

Machine Learning · Computer Science 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

This paper addresses the distributed online control problem over a network of linear time-invariant (LTI) systems (with possibly unknown dynamics) in the presence of adversarial perturbations. There exists a global network cost that is…

Optimization and Control · Mathematics 2023-10-06 Ting-Jui Chang , Shahin Shahrampour

We consider a collaborative online learning paradigm, wherein a group of agents connected through a social network are engaged in playing a stochastic multi-armed bandit game. Each time an agent takes an action, the corresponding reward is…

Machine Learning · Computer Science 2016-07-12 Ravi Kumar Kolla , Krishna Jagannathan , Aditya Gopalan

We consider systems that require timely monitoring of sources over a communication network, where the cost of delayed information is unknown, time-varying and possibly adversarial. For the single source monitoring problem, we design…

Networking and Internet Architecture · Computer Science 2021-05-31 Vishrant Tripathi , Eytan Modiano

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Aurélien Bellet , Yingyu Liang , Alireza Bagheri Garakani , Maria-Florina Balcan , Fei Sha

We introduce efficient algorithms which achieve nearly optimal regrets for the problem of stochastic online shortest path routing with end-to-end feedback. The setting is a natural application of the combinatorial stochastic bandits…

Machine Learning · Computer Science 2018-12-20 Ruihao Zhu , Eytan Modiano

Federated learning (FL) is a promising learning paradigm that can tackle the increasingly prominent isolated data islands problem while keeping users' data locally with privacy and security guarantees. However, FL could result in…

Information Theory · Computer Science 2022-03-30 Peng Yang , Yuning Jiang , Ting Wang , Yong Zhou , Yuanming Shi , Colin N. Jones

Motivated by applications in service systems, we consider queueing systems where each customer must be handled by a server with the right skill set. We focus on optimizing the routing of customers to servers in order to maximize the total…

Machine Learning · Computer Science 2024-12-16 Sanne van Kempen , Jaron Sanders , Fiona Sloothaak , Maarten G. Wolf

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

Machine Learning · Statistics 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

This paper presents a novel approach to enhance communication efficiency in federated learning through clipped uniform quantization. By leveraging optimal clipping thresholds and client-specific adaptive quantization schemes, the proposed…

Machine Learning · Computer Science 2024-12-17 Zavareh Bozorgasl , Hao Chen

This paper considers the distributed online convex-concave optimization with constraint sets over a multiagent network, in which each agent autonomously generates a series of decision pairs through a designable mechanism to cooperatively…

Optimization and Control · Mathematics 2025-08-14 Wentao Zhang , Baoyong Zhang , Deming Yuan , Shengyuan Xu , Vincent K. N. Lau

Online meta-learning is emerging as an enabling technique for achieving edge intelligence in the IoT ecosystem. Nevertheless, to learn a good meta-model for within-task fast adaptation, a single agent alone has to learn over many tasks, and…

Machine Learning · Computer Science 2020-12-22 Sen Lin , Mehmet Dedeoglu , Junshan Zhang

In this paper, we consider model-free federated reinforcement learning for tabular episodic Markov decision processes. Under the coordination of a central server, multiple agents collaboratively explore the environment and learn an optimal…

Machine Learning · Statistics 2025-03-11 Zhong Zheng , Haochen Zhang , Lingzhou Xue

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

Machine Learning · Computer Science 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

This work presents a new method for enhancing communication efficiency in stochastic Federated Learning that trains over-parameterized random networks. In this setting, a binary mask is optimized instead of the model weights, which are kept…

Machine Learning · Computer Science 2024-03-01 Mohamad Mestoukirdi , Omid Esrafilian , David Gesbert , Qianrui Li , Nicolas Gresset

Online learning and model reference adaptive control have many interesting intersections. One area where they differ however is in how the algorithms are analyzed and what objective or metric is used to discriminate "good" algorithms from…

Systems and Control · Electrical Eng. & Systems 2025-01-24 Travis E. Gibson , Sawal Acharya

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this…

Machine Learning · Computer Science 2020-02-07 Lijun Zhang , Shiyin Lu , Tianbao Yang

We address the problem of learning in an online setting where the learner repeatedly observes features, selects among a set of actions, and receives reward for the action taken. We provide the first efficient algorithm with an optimal…

Machine Learning · Computer Science 2011-06-17 Miroslav Dudik , Daniel Hsu , Satyen Kale , Nikos Karampatziakis , John Langford , Lev Reyzin , Tong Zhang

This paper investigates efficient distributed training of a Federated Learning~(FL) model over a wireless network of wireless devices. The communication iterations of the distributed training algorithm may be substantially deteriorated or…