中文
相关论文

相关论文: Merit-based Fair Combinatorial Semi-Bandit with Un…

200 篇论文

We study the multi-armed bandit problem with adversarially chosen delays in the Best-of-Both-Worlds (BoBW) framework, which aims to achieve near-optimal performance in both stochastic and adversarial environments. While prior work has made…

机器学习 · 计算机科学 2025-10-21 Ofir Schlisselberg , Tal Lancewicki , Peter Auer , Yishay Mansour

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

机器学习 · 计算机科学 2024-05-21 Han Qi , Guo Fei , Li Zhu

The Combinatorial Multi-Armed Bandit problem is a sequential decision-making problem in which an agent selects a set of arms on each round, observes feedback for each of these arms and aims to maximize a known reward function of the arms it…

机器学习 · 计算机科学 2020-07-17 Nadav Merlis , Shie Mannor

We study fairness in linear bandit problems. Starting from the notion of meritocratic fairness introduced in Joseph et al. [2016], we carry out a more refined analysis of a more general problem, achieving better performance guarantees with…

机器学习 · 计算机科学 2017-06-30 Matthew Joseph , Michael Kearns , Jamie Morgenstern , Seth Neel , Aaron Roth

Increasingly, recommender systems are tasked with improving users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a bandit problem with delayed rewards. There is an apparent trade-off in…

机器学习 · 计算机科学 2025-01-15 Kelly W. Zhang , Thomas Baldwin-McDonald , Kamil Ciosek , Lucas Maystre , Daniel Russo

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

机器学习 · 计算机科学 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

We present a modified tuning of the algorithm of Zimmert and Seldin [2020] for adversarial multiarmed bandits with delayed feedback, which in addition to the minimax optimal adversarial regret guarantee shown by Zimmert and Seldin…

机器学习 · 计算机科学 2022-07-01 Saeed Masoudian , Julian Zimmert , Yevgeny Seldin

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

In this paper, we study censored Semi-Bandits, a novel variant of the semi-bandits problem. The learner is assumed to have a fixed amount of resources, which it allocates to the arms at each time step. The loss observed from an arm is…

机器学习 · 计算机科学 2020-03-26 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

This paper addresses the problem of unknown delays in adversarial multi-armed bandit (MAB) with multiple play. Existing work on similar game setting focused on only the case where the learner selects an arm in each round. However, there are…

机器学习 · 计算机科学 2020-10-02 Olusola T. Odeyomi

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

机器学习 · 统计学 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

In $K$-armed dueling bandits, the learner receives preference feedback between arms, and the regret of an arm is defined in terms of its suboptimality to a $\textit{winner}$ arm. The $\textit{non-stationary}$ variant of the problem,…

机器学习 · 计算机科学 2024-10-01 Joe Suk , Arpit Agarwal

Significant work has been recently dedicated to the stochastic delayed bandit setting because of its relevance in applications. The applicability of existing algorithms is however restricted by the fact that strong assumptions are often…

机器学习 · 统计学 2020-06-19 Anne Gael Manegueu , Claire Vernade , Alexandra Carpentier , Michal Valko

This paper presents a class of Dynamic Multi-Armed Bandit problems where the reward can be modeled as the noisy output of a time varying linear stochastic dynamic system that satisfies some boundedness constraints. The class allows many…

机器学习 · 计算机科学 2017-10-10 T. W. U. Madhushani , D. H. S. Maithripala , N. E. Leonard

In this paper, we study the stochastic combinatorial multi-armed bandit problem under semi-bandit feedback. While much work has been done on algorithms that optimize the expected reward for linear as well as some general reward functions,…

机器学习 · 计算机科学 2021-12-03 Shaarad Ayyagari , Ambedkar Dukkipati

This paper explores a new form of the linear bandit problem in which the algorithm receives the usual stochastic rewards as well as stochastic feedback about which features are relevant to the rewards, the latter feedback being the novel…

机器学习 · 计算机科学 2019-03-13 Urvashi Oswal , Aniruddha Bhargava , Robert Nowak

We introduce a novel extension of the canonical multi-armed bandit problem that incorporates an additional strategic innovation: abstention. In this enhanced framework, the agent is not only tasked with selecting an arm at each time step,…

机器学习 · 计算机科学 2026-03-24 Junwen Yang , Tianyuan Jin , Vincent Y. F. Tan

We improve the efficiency of algorithms for stochastic \emph{combinatorial semi-bandits}. In most interesting problems, state-of-the-art algorithms take advantage of structural properties of rewards, such as \emph{independence}. However,…

机器学习 · 统计学 2019-06-24 Pierre Perrault , Vianney Perchet , Michal Valko