中文
相关论文

相关论文: Pairwise Elimination with Instance-Dependent Guara…

200 篇论文

We study the problem of contextual combinatorial semi-bandits, where input contexts are mapped into subsets of size $m$ of a collection of $K$ possible actions. In each round, the learner observes the realized reward of the predicted…

机器学习 · 计算机科学 2026-02-24 Liad Erez , Tomer Koren

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

When multi-armed bandit (MAB) algorithms allocate pulls among competing arms, the resulting allocation can exhibit huge variation. This is particularly harmful in modern applications such as learning-enhanced platform operations and…

机器学习 · 计算机科学 2026-02-10 Yilun Chen , Jiaqi Lu

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

In this paper, we study censored Semi-Bandits, a novel variant of the semi-bandits problem. The learner is assumed to have a fixed amount of resources, which it allocates to the arms at each time step. The loss observed from an arm is…

机器学习 · 计算机科学 2020-03-26 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

One of the key drivers of complexity in the classical (stochastic) multi-armed bandit (MAB) problem is the difference between mean rewards in the top two arms, also known as the instance gap. The celebrated Upper Confidence Bound (UCB)…

机器学习 · 计算机科学 2021-10-27 Anand Kalvit , Assaf Zeevi

We study the stochastic multi-armed bandit (MAB) problem in the presence of side-observations across actions that occur as a result of an underlying network structure. In our model, a bipartite graph captures the relationship between…

机器学习 · 计算机科学 2017-07-14 Swapna Buccapatnam , Fang Liu , Atilla Eryilmaz , Ness B. Shroff

Multi-armed bandit (MAB) algorithms are efficient approaches to reduce the opportunity cost of online experimentation and are used by companies to find the best product from periodically refreshed product catalogs. However, these algorithms…

机器学习 · 计算机科学 2024-12-19 Mohsen Bayati , Junyu Cao , Wanning Chen

We study distributed cooperative decision-making under the explore-exploit tradeoff in the multiarmed bandit (MAB) problem. We extend the state-of-the-art frequentist and Bayesian algorithms for single-agent MAB problems to cooperative…

系统与控制 · 计算机科学 2019-09-18 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

We study the explore-exploit tradeoff in distributed cooperative decision-making using the context of the multiarmed bandit (MAB) problem. For the distributed cooperative MAB problem, we design the cooperative UCB algorithm that comprises…

系统与控制 · 计算机科学 2019-09-17 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

We consider a stochastic multi-armed bandit setting and study the problem of constrained regret minimization over a given time horizon. Each arm is associated with an unknown, possibly multi-dimensional distribution, and the merit of an arm…

机器学习 · 计算机科学 2023-01-05 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Stochastic multi-armed bandits (MABs) provide a fundamental reinforcement learning model to study sequential decision making in uncertain environments. The upper confidence bounds (UCB) algorithm gave birth to the renaissance of bandit…

机器学习 · 计算机科学 2024-06-11 Ambrus Tamás , Szabolcs Szentpéteri , Balázs Csanád Csáji

In sequential decision-making scenarios i.e., mobile health recommendation systems revenue management contextual multi-armed bandit algorithms have garnered attention for their performance. But most of the existing algorithms are built on…

机器学习 · 计算机科学 2023-01-24 Mubarrat Chowdhury , Elkhan Ismayilzada , Khalequzzaman Sayem , Gi-Soo Kim

We consider the combinatorial multi-armed bandit (CMAB) problem, where the reward function is nonlinear. In this setting, the agent chooses a batch of arms on each round and receives feedback from each arm of the batch. The reward that the…

机器学习 · 计算机科学 2020-06-09 Nadav Merlis , Shie Mannor

In budget-limited multi-armed bandit (MAB) problems, the learner's actions are costly and constrained by a fixed budget. Consequently, an optimal exploitation policy may not be to pull the optimal arm repeatedly, as is the case in other…

人工智能 · 计算机科学 2012-04-10 Long Tran-Thanh , Archie Chapman , Alex Rogers , Nicholas R. Jennings

Multi-player multi-armed bandit is an increasingly relevant decision-making problem, motivated by applications to cognitive radio systems. Most research for this problem focuses exclusively on the settings that players have \textit{full…

机器学习 · 计算机科学 2022-12-14 Guojun Xiong , Jian Li

We address multi-armed bandits (MAB) where the objective is to maximize the cumulative reward under a probabilistic linear constraint. For a few real-world instances of this problem, constrained extensions of the well-known Thompson…

机器学习 · 计算机科学 2020-05-14 Vidit Saxena , Joseph E. Gonzalez , Joakim Jaldén

In this paper, we study the multi-objective bandits (MOB) problem, where a learner repeatedly selects one arm to play and then receives a reward vector consisting of multiple objectives. MOB has found many real-world applications as varied…

机器学习 · 计算机科学 2019-05-31 Shiyin Lu , Guanghui Wang , Yao Hu , Lijun Zhang

In the classic multi-armed bandits problem, the goal is to have a policy for dynamically operating arms that each yield stochastic rewards with unknown means. The key metric of interest is regret, defined as the gap between the expected…

最优化与控制 · 数学 2010-11-23 Yi Gai , Bhaskar Krishnamachari , Rahul Jain