中文
相关论文

相关论文: DART: aDaptive Accept RejecT for non-linear top-K …

200 篇论文

We study the problem of regret minimization in a multi-armed bandit setup where the agent is allowed to play multiple arms at each round by spreading the resources usually allocated to only one arm. At each iteration the agent selects a…

机器学习 · 计算机科学 2021-06-01 Matias I. Müller , Cristian R. Rojas

The Combinatorial Multi-Armed Bandit problem is a sequential decision-making problem in which an agent selects a set of arms on each round, observes feedback for each of these arms and aims to maximize a known reward function of the arms it…

机器学习 · 计算机科学 2020-07-17 Nadav Merlis , Shie Mannor

We consider the adversarial combinatorial multi-armed bandit (CMAB) problem, whose decision set can be exponentially large with respect to the number of given arms. To avoid dealing with such large decision sets directly, we propose an…

数据结构与算法 · 计算机科学 2017-07-27 Shinsaku Sakaue , Masakazu Ishihata , Shin-ichi Minato

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

机器学习 · 计算机科学 2015-07-20 Aleksandr Vorobev , Gleb Gusev

Recently, several studies (Zhou et al., 2021a; Zhang et al., 2021b; Kim et al., 2021; Zhou and Gu, 2022) have provided variance-dependent regret bounds for linear contextual bandits, which interpolates the regret for the worst-case regime…

机器学习 · 计算机科学 2023-02-22 Heyang Zhao , Jiafan He , Dongruo Zhou , Tong Zhang , Quanquan Gu

We study a $K$-armed non-stationary bandit model where rewards change smoothly, as captured by H\"{o}lder class assumptions on rewards as functions of time. Such smooth changes are parametrized by a H\"{o}lder exponent $\beta$ and…

机器学习 · 统计学 2025-02-27 Joe Suk

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

机器学习 · 计算机科学 2018-12-04 Jun Geng , Lifeng Lai

This paper investigates stochastic multi-armed bandit algorithms that are robust to adversarial attacks, where an attacker can first observe the learner's action and {then} alter their reward observation. We study two cases of this model,…

机器学习 · 计算机科学 2024-08-19 Xuchuang Wang , Jinhang Zuo , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

机器学习 · 统计学 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

Motivated by a natural problem in online model selection with bandit information, we introduce and analyze a best arm identification problem in the rested bandit setting, wherein arm expected losses decrease with the number of times the arm…

机器学习 · 统计学 2020-12-08 Leonardo Cella , Claudio Gentile , Massimiliano Pontil

We consider the problem of identifying the best arm in stochastic Multi-Armed Bandits (MABs) using a fixed sampling budget. Characterizing the minimal instance-specific error probability for this problem constitutes one of the important…

机器学习 · 计算机科学 2024-02-21 Po-An Wang , Ruo-Chun Tzeng , Alexandre Proutiere

We study the problem of \emph{dynamic regret minimization} in $K$-armed Dueling Bandits under non-stationary or time varying preferences. This is an online learning setup where the agent chooses a pair of items at each round and observes…

机器学习 · 计算机科学 2022-06-14 Aadirupa Saha , Shubham Gupta

We present an algorithm, "constrained successive accept or reject (CSAR)," for the problem of identifying the subset of top feasible-arms from a given finite set of arms with the limited sampling-budget equal to a given time-horizon when…

最优化与控制 · 数学 2025-01-22 Hyeong Soo Chang

This study investigates the problem of $K$-armed linear contextual bandits, an instance of the multi-armed bandit problem, under an adversarial corruption. At each round, a decision-maker observes an independent and identically distributed…

机器学习 · 计算机科学 2023-12-29 Masahiro Kato , Shinji Ito

We study dynamic regret minimization in unconstrained adversarial linear bandit problems. In this setting, a learner must minimize the cumulative loss relative to an arbitrary sequence of comparators…

机器学习 · 计算机科学 2026-03-30 Alberto Rumi , Andrew Jacobsen , Nicolò Cesa-Bianchi , Fabio Vitale

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

机器学习 · 计算机科学 2023-08-17 Mengfan Xu , Diego Klabjan

The contextual combinatorial semi-bandit problem with linear payoff functions is a decision-making problem in which a learner chooses a set of arms with the feature vectors in each round under given constraints so as to maximize the sum of…

We consider a novel multi-armed bandit framework where the rewards obtained by pulling the arms are functions of a common latent random variable. The correlation between arms due to the common random source can be used to design a…

机器学习 · 统计学 2019-01-31 Samarth Gupta , Gauri Joshi , Osman Yağan

This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms…

机器学习 · 计算机科学 2022-06-15 Shinji Ito , Taira Tsuchiya , Junya Honda