中文
相关论文

相关论文: Transfer Learning for Contextual Multi-armed Bandi…

200 篇论文

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

机器学习 · 计算机科学 2022-10-18 Viktor Bengs , Eyke Hüllermeier

Model selection in supervised learning provides costless guarantees as if the model that best balances bias and variance was known a priori. We study the feasibility of similar guarantees for cumulative regret minimization in the stochastic…

机器学习 · 计算机科学 2023-10-25 Sanath Kumar Krishnamurthy , Adrienne Margaret Propp , Susan Athey

In this paper, we propose a constant word (RAM model) algorithm for regret minimisation for both finite and infinite Stochastic Multi-Armed Bandit (MAB) instances. Most of the existing regret minimisation algorithms need to remember the…

机器学习 · 计算机科学 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

机器学习 · 统计学 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

机器学习 · 计算机科学 2022-02-15 Aadirupa Saha , Pierre Gaillard

It has been shown (Amuru et al. 2015) that online learning algorithms can be effectively used to select optimal physical layer parameters for jamming against digital modulation schemes without a priori knowledge of the victim's transmission…

机器学习 · 计算机科学 2022-07-07 Charles E. Thornton , R. Michael Buehrer

Transfer learning for extremely low resource languages is a challenging task as there is no large scale monolingual corpora for pre training or sufficient annotated data for fine tuning. We follow the work of MetaXL which suggests using…

计算与语言 · 计算机科学 2023-06-02 Liat Bezalel , Eyal Orgad

Nonparametric contextual bandit is an important model of sequential decision making problems. Under $\alpha$-Tsybakov margin condition, existing research has established a regret bound of $\tilde{O}\left(T^{1-\frac{\alpha+1}{d+2}}\right)$…

机器学习 · 计算机科学 2025-05-09 Puning Zhao , Rongfei Fan , Shaowei Wang , Li Shen , Qixin Zhang , Zong Ke , Tianhang Zheng

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

机器学习 · 统计学 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

计量经济学 · 经济学 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

We study the problem of information sharing and cooperation in Multi-Player Multi-Armed bandits. We propose the first algorithm that achieves logarithmic regret for this problem when the collision reward is unknown. Our results are based on…

机器学习 · 计算机科学 2022-10-04 Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

The shapes of functions provide highly interpretable summaries of their trajectories. This article develops a novel transfer learning methodology to tackle the challenge of data scarcity in functional linear models. The methodology…

统计方法学 · 统计学 2025-10-16 Shuhao Jiao , Ian W. Mckeague

Most bandit policies are designed to either minimize regret in any problem instance, making very few assumptions about the underlying environment, or in a Bayesian sense, assuming a prior distribution over environment parameters. The former…

机器学习 · 计算机科学 2021-01-07 Branislav Kveton , Martin Mladenov , Chih-Wei Hsu , Manzil Zaheer , Csaba Szepesvari , Craig Boutilier

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

We consider the problem of using observational bandit feedback data from multiple heterogeneous data sources to learn a personalized decision policy that robustly generalizes across diverse target settings. To achieve this, we propose a…

机器学习 · 计算机科学 2024-10-14 Aldo Gael Carranza , Susan Athey

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

机器学习 · 统计学 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing…

机器学习 · 计算机科学 2022-02-03 Praneet Dutta , Joe Cheuk , Jonathan S Kim , Massimo Mascaro

We study the adversarial multi-armed bandit problem in a setting where the player incurs a unit cost each time he switches actions. We prove that the player's $T$-round minimax regret in this setting is $\widetilde{\Theta}(T^{2/3})$,…

机器学习 · 计算机科学 2013-11-21 Ofer Dekel , Jian Ding , Tomer Koren , Yuval Peres

In this paper we propose the multi-objective contextual bandit problem with similarity information. This problem extends the classical contextual bandit problem with similarity information by introducing multiple and possibly conflicting…

机器学习 · 统计学 2018-03-13 Eralp Turğay , Doruk Öner , Cem Tekin