English
Related papers

Related papers: Collaborative Pure Exploration in Kernel Bandit

200 papers

We propose a new supervised learning algorithm, for classification and regression problems where two or more preliminary predictors are available. We introduce \texttt{KernelCobra}, a non-linear learning strategy for combining an arbitrary…

Machine Learning · Computer Science 2020-02-05 Benjamin Guedj , Bhargav Srinivasa Desikan

In continuum-armed bandit problems where the underlying function resides in a reproducing kernel Hilbert space (RKHS), namely, the kernelised bandit problems, an important open problem remains of how well learning algorithms can adapt if…

Machine Learning · Statistics 2023-04-28 Yusha Liu , Aarti Singh

We study contextual bandits with finitely many actions in which the reward of each arm follows a single-index model with an arm-specific index parameter and an unknown nonparametric link function. We consider a regime in which arms…

Machine Learning · Statistics 2026-03-20 Sakshi Arya , Satarupa Bhattacharjee , Bharath K. Sriperumbudur

We consider online learning for minimizing regret in unknown, episodic Markov decision processes (MDPs) with continuous states and actions. We develop variants of the UCRL and posterior sampling algorithms that employ nonparametric Gaussian…

Machine Learning · Computer Science 2019-01-04 Sayak Ray Chowdhury , Aditya Gopalan

We propose a cumulative oversampling (CO) method for online learning. Our key idea is to sample parameter estimations from the updated belief space once in each round (similar to Thompson Sampling), and utilize the cumulative samples up to…

Machine Learning · Computer Science 2020-09-17 Shatian Wang , Shuoguang Yang , Zhen Xu , Van-Anh Truong

How should a firm allocate its limited interviewing resources to select the optimal cohort of new employees from a large set of job applicants? How should that firm allocate cheap but noisy resume screenings and expensive but in-depth…

Machine Learning · Computer Science 2019-03-15 Candice Schumann , Samsara N. Counts , Jeffrey S. Foster , John P. Dickerson

We consider sequential decision making under uncertainty, where the goal is to optimize over a large decision space using noisy comparative feedback. This problem can be formulated as a $K$-armed Dueling Bandits problem where $K$ is the…

Machine Learning · Computer Science 2017-07-11 Yanan Sui , Yisong Yue , Joel W. Burdick

We consider the problem where $N$ agents collaboratively interact with an instance of a stochastic $K$ arm bandit problem for $K \gg N$. The agents aim to simultaneously minimize the cumulative regret over all the agents for a total of $T$…

Machine Learning · Computer Science 2021-02-18 Mridul Agarwal , Vaneet Aggarwal , Kamyar Azizzadenesheli

We study a general clustering setting in which we have $n$ elements to be clustered, and we aim to perform as few queries as possible to an oracle that returns a noisy sample of the weighted similarity between two elements. Our setting…

Machine Learning · Statistics 2024-11-05 Yuko Kuroki , Atsushi Miyauchi , Francesco Bonchi , Wei Chen

Ensemble learning plays a crucial role in practical applications of online learning due to its enhanced classification performance and adaptable adjustment mechanisms. However, most weight allocation strategies in ensemble learning are…

Machine Learning · Computer Science 2025-03-21 Songqiao Hu , Zeyi Liu , Xiao He

This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation…

Machine Learning · Computer Science 2023-10-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

Federated Learning (FL) with quantization and deliberately added noise over wireless networks is a promising approach to preserve user differential privacy (DP) while reducing wireless resources. Specifically, an FL process can be fused…

Several learning problems involve solving min-max problems, e.g., empirical distributional robust learning or learning with non-standard aggregated losses. More specifically, these problems are convex-linear problems where the minimization…

Machine Learning · Computer Science 2021-06-07 Christophe Roux , Elias Wirth , Sebastian Pokutta , Thomas Kerdreux

Efficient exploration is critical in cooperative deep Multi-Agent Reinforcement Learning (MARL). In this work, we propose an exploration method that effectively encourages cooperative exploration based on the idea of sequential…

Machine Learning · Computer Science 2023-07-17 Xutong Zhao , Yangchen Pan , Chenjun Xiao , Sarath Chandar , Janarthanan Rajendran

Despite the prevalence of collaborative filtering in recommendation systems, there has been little theoretical development on why and how well it works, especially in the "online" setting, where items are recommended to users over time. We…

Machine Learning · Computer Science 2014-11-25 Guy Bresler , George H. Chen , Devavrat Shah

We introduce the Cooperative Multi-Agent Path Finding (Co-MAPF) problem, an extension to the classical MAPF problem, where cooperative behavior is incorporated. In this setting, a group of autonomous agents operate in a shared environment…

Multiagent Systems · Computer Science 2021-05-25 Nir Greshler , Ofir Gordon , Oren Salzman , Nahum Shimkin

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

Many real-world problems like Social Influence Maximization face the dilemma of choosing the best $K$ out of $N$ options at a given time instant. This setup can be modeled as a combinatorial bandit which chooses $K$ out of $N$ arms at each…

Machine Learning · Computer Science 2021-10-12 Mridul Agarwal , Vaneet Aggarwal , Christopher J. Quinn , Abhishek K. Umrawal

We study the problem of federated contextual combinatorial cascading bandits, where $|\mathcal{U}|$ agents collaborate under the coordination of a central server to provide tailored recommendations to the $|\mathcal{U}|$ corresponding…

Machine Learning · Computer Science 2024-02-27 Hantao Yang , Xutong Liu , Zhiyong Wang , Hong Xie , John C. S. Lui , Defu Lian , Enhong Chen

We study the heavy-tailed stochastic bandit problem in the cooperative multi-agent setting, where a group of agents interact with a common bandit problem, while communicating on a network with delays. Existing algorithms for the stochastic…

Machine Learning · Computer Science 2020-08-17 Abhimanyu Dubey , Alex Pentland