English
Related papers

Related papers: Incentivized Communication for Federated Bandits

200 papers

To enhance the efficiency and practicality of federated bandit learning, recent advances have introduced incentives to motivate communication among clients, where a client participates only when the incentive offered by the server outweighs…

Machine Learning · Computer Science 2024-02-08 Zhepei Wei , Chuanhao Li , Tianze Ren , Haifeng Xu , Hongning Wang

The rapid proliferation of decentralized learning systems mandates the need for differentially-private cooperative learning. In this paper, we study this in context of the contextual linear bandit: we consider a collection of agents…

Machine Learning · Computer Science 2020-10-23 Abhimanyu Dubey , Alex Pentland

We study federated contextual linear bandits, where $M$ agents cooperate with each other to solve a global contextual linear bandit problem with the help of a central server. We consider the asynchronous setting, where all agents work…

Machine Learning · Computer Science 2022-07-08 Jiafan He , Tianhao Wang , Yifei Min , Quanquan Gu

Federated optimization studies the problem of collaborative function optimization among multiple clients (e.g. mobile devices or organizations) under the coordination of a central server. Since the data is collected separately by each…

Machine Learning · Computer Science 2023-11-06 Chuanhao Li , Chong Liu , Yu-Xiang Wang

This paper considers the contextual multi-armed bandit (CMAB) problem with fairness and privacy guarantees in a federated environment. We consider merit-based exposure as the desired fair outcome, which provides exposure to each action in…

Machine Learning · Computer Science 2024-02-07 Sambhav Solanki , Shweta Jain , Sujit Gujar

We study the problem of federated contextual combinatorial cascading bandits, where $|\mathcal{U}|$ agents collaborate under the coordination of a central server to provide tailored recommendations to the $|\mathcal{U}|$ corresponding…

Machine Learning · Computer Science 2024-02-27 Hantao Yang , Xutong Liu , Zhiyong Wang , Hong Xie , John C. S. Lui , Defu Lian , Enhong Chen

The demand for collaborative and private bandit learning across multiple agents is surging due to the growing quantity of data generated from distributed systems. Federated bandit learning has emerged as a promising framework for private,…

Machine Learning · Computer Science 2024-03-04 Ethan Blaser , Chuanhao Li , Hongning Wang

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

Machine Learning · Statistics 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

Contextual bandit algorithms have been recently studied under the federated learning setting to satisfy the demand of keeping data decentralized and pushing the learning of bandit models to the client side. But limited by the required…

Machine Learning · Computer Science 2022-10-14 Chuanhao Li , Hongning Wang

As the adoption of federated learning increases for learning from sensitive data local to user devices, it is natural to ask if the learning can be done using implicit signals generated as users interact with the applications of interest,…

Machine Learning · Computer Science 2023-03-21 Alekh Agarwal , H. Brendan McMahan , Zheng Xu

Conversational recommender systems have emerged as a potent solution for efficiently eliciting user preferences. These systems interactively present queries associated with "key terms" to users and leverage user feedback to estimate user…

Machine Learning · Computer Science 2024-08-13 Zhuohua Li , Maoli Liu , John C. S. Lui

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

Machine Learning · Computer Science 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

By exploiting the computing power and local data of distributed clients, federated learning (FL) features ubiquitous properties such as reduction of communication overhead and preserving data privacy. In each communication round of FL, the…

Information Theory · Computer Science 2020-07-21 Wenchao Xia , Tony Q. S. Quek , Kun Guo , Wanli Wen , Howard H. Yang , Hongbo Zhu

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

Machine Learning · Computer Science 2021-10-05 Chuanhao Li , Hongning Wang

In intelligent Internet of Things (IoT) systems, edge servers within a network exchange information with their neighbors and collect data from sensors to complete delivered tasks. In this paper, we propose a multiplayer multi-armed bandit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-19 Ziqun Chen , Kechao Cai , Jinbei Zhang , Zhigang Yu

The performance of large language models (LLMs) is highly sensitive to the input prompt, making prompt optimization a critical task. However, real-world application is hindered by three major challenges: (1) the black-box nature of powerful…

Machine Learning · Computer Science 2025-09-30 Pingchen Lu , Zhi Hong , Zhiwei Shang , Zhiyong Wang , Yikun Ban , Yao Shu , Min Zhang , Shuang Qiu , Zhongxiang Dai

In cooperative bandits, a framework that captures essential features of collective sequential decision making, agents can minimize group regret, and thereby improve performance, by leveraging shared information. However, sharing information…

Machine Learning · Statistics 2021-10-12 Udari Madhushani , Naomi Leonard

We study the problem of federated stochastic multi-arm contextual bandits with unknown contexts, in which M agents are faced with different bandits and collaborate to learn. The communication model consists of a central server and the…

Machine Learning · Computer Science 2024-01-31 Jiabin Lin , Shana Moothedath

There is a rapid increase in the cooperative learning paradigm in online learning settings, i.e., federated learning (FL). Unlike most FL settings, there are many situations where the agents are competitive. Each agent would like to learn…

Machine Learning · Computer Science 2023-05-30 Sambhav Solanki , Samhita Kanaparthy , Sankarshan Damle , Sujit Gujar

Due to communication constraints and intermittent client availability in federated learning, only a subset of clients can participate in each training round. While most prior works assume uniform and unbiased client selection, recent work…

Machine Learning · Computer Science 2020-12-16 Yae Jee Cho , Samarth Gupta , Gauri Joshi , Osman Yağan
‹ Prev 1 2 3 10 Next ›