English
Related papers

Related papers: (Private) Kernelized Bandits with Distributed Bias…

200 papers

In this paper, we study the problem of global reward maximization with only partial distributed feedback. This problem is motivated by several real-world applications (e.g., cellular network configuration, dynamic pricing, and policy…

Machine Learning · Computer Science 2024-03-22 Fengjiao Li , Xingyu Zhou , Bo Ji

Black box optimisation of an unknown function from expensive and noisy evaluations is a ubiquitous problem in machine learning, academic research and industrial production. An abstraction of the problem can be formulated as a kernel based…

Machine Learning · Statistics 2023-02-02 Sattar Vakili , Danyal Ahmed , Alberto Bernacchia , Ciara Pike-Burke

Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed…

Machine Learning · Computer Science 2023-12-11 Ayush Rai , Shaoshuai Mou

We consider the problem of contextual kernel bandits with stochastic contexts, where the underlying reward function belongs to a known Reproducing Kernel Hilbert Space. We study this problem under an additional constraint of Differential…

Machine Learning · Statistics 2025-07-21 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

The dueling bandit problem, an essential variation of the traditional multi-armed bandit problem, has become significantly prominent recently due to its broad applications in online advertising, recommendation systems, information…

Machine Learning · Computer Science 2025-04-08 Bongsoo Yi , Yue Kang , Yao Li

Stochastic linear bandits are a natural and well-studied model for structured exploration/exploitation problems and are widely used in applications such as online marketing and recommendation. One of the main challenges faced by…

Decision-making problems of sequential nature, where decisions made in the past may have an impact on the future, are used to model many practically important applications. In some real-world applications, feedback about a decision is…

Machine Learning · Computer Science 2023-03-02 Ronald C. van den Broek , Rik Litjens , Tobias Sagis , Luc Siecker , Nina Verbeeke , Pratik Gajane

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

Machine Learning · Computer Science 2018-06-07 Seth Neel , Aaron Roth

We consider the problem of contextual kernel bandits with stochastic contexts, where the underlying reward function belongs to a known Reproducing Kernel Hilbert Space (RKHS). We study this problem under the additional constraint of joint…

Machine Learning · Statistics 2025-01-14 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

We tackle the communication efficiency challenge of learning kernelized contextual bandits in a distributed setting. Despite the recent advances in communication-efficient distributed bandit learning, existing solutions are restricted to…

Machine Learning · Computer Science 2022-10-14 Chuanhao Li , Huazheng Wang , Mengdi Wang , Hongning Wang

We consider distributed kernel bandits where $N$ agents aim to collaboratively maximize an unknown reward function that lies in a reproducing kernel Hilbert space. Each agent sequentially queries the function to obtain noisy observations at…

Machine Learning · Computer Science 2024-02-21 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

In this paper, we consider the problem of black-box optimization with noisy feedback revealed in batches, where the unknown function to optimize has a bounded norm in some Reproducing Kernel Hilbert Space (RKHS). We refer to this as the…

Machine Learning · Statistics 2026-03-16 Chenkai Ma , Keqin Chen , Jonathan Scarlett

This paper studies federated linear contextual bandits under the notion of user-level differential privacy (DP). We first introduce a unified federated bandits framework that can accommodate various definitions of DP in the sequential…

Machine Learning · Computer Science 2023-06-14 Ruiquan Huang , Huanyu Zhang , Luca Melis , Milan Shen , Meisam Hajzinia , Jing Yang

In this work, we study sequential choice bandits with feedback. We propose bandit algorithms for a platform that personalizes users' experience to maximize its rewards. For each action directed to a given user, the platform is given a…

Machine Learning · Statistics 2021-01-06 Anshuka Rangi , Massimo Franceschetti , Long Tran-Thanh

In this paper, we formulate a Collaborative Pure Exploration in Kernel Bandit problem (CoPE-KB), which provides a novel model for multi-agent multi-task decision making under limited communication and general reward functions, and is…

Machine Learning · Computer Science 2023-03-17 Yihan Du , Wei Chen , Yuko Kuroki , Longbo Huang

We study collaborative learning among distributed clients facilitated by a central server. Each client is interested in maximizing a personalized objective function that is a weighted sum of its local objective and a global objective. Each…

Machine Learning · Statistics 2023-04-18 Sudeep Salgia , Sattar Vakili , Qing Zhao

We consider the standard $K$-armed bandit problem under a distributed trust model of differential privacy (DP), which enables to guarantee privacy without a trustworthy server. Under this trust model, previous work largely focus on…

Machine Learning · Computer Science 2022-06-14 Sayak Ray Chowdhury , Xingyu Zhou

We consider the well-studied dueling bandit problem, where a learner aims to identify near-optimal actions using pairwise comparisons, under the constraint of differential privacy. We consider a general class of utility-based preference…

Machine Learning · Computer Science 2024-03-25 Aadirupa Saha , Hilal Asi

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

Machine Learning · Statistics 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

We provide two distributed confidence ball algorithms for solving linear bandit problems in peer to peer networks with limited communication capabilities. For the first, we assume that all the peers are solving the same linear bandit…

Machine Learning · Computer Science 2016-06-08 Nathan Korda , Balazs Szorenyi , Shuai Li
‹ Prev 1 2 3 10 Next ›