中文
相关论文

相关论文: Regret Minimization in Stochastic Contextual Dueli…

200 篇论文

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

机器学习 · 计算机科学 2022-02-15 Aadirupa Saha , Pierre Gaillard

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

机器学习 · 计算机科学 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

We study the $K$-armed dueling bandit problem, a variation of the standard stochastic bandit problem where the feedback is limited to relative comparisons of a pair of arms. We introduce a tight asymptotic regret lower bound that is based…

机器学习 · 统计学 2015-06-30 Junpei Komiyama , Junya Honda , Hisashi Kashima , Hiroshi Nakagawa

We study the problem of \emph{dynamic regret minimization} in $K$-armed Dueling Bandits under non-stationary or time varying preferences. This is an online learning setup where the agent chooses a pair of items at each round and observes…

机器学习 · 计算机科学 2022-06-14 Aadirupa Saha , Shubham Gupta

We consider the regret minimization task in a dueling bandits problem with context information. In every round of the sequential decision problem, the learner makes a context-dependent selection of two choice alternatives (arms) to be…

机器学习 · 计算机科学 2022-10-14 Viktor Bengs , Aadirupa Saha , Eyke Hüllermeier

We introduce the problem of regret minimization in Adversarial Dueling Bandits. As in classic Dueling Bandits, the learner has to repeatedly choose a pair of items and observe only a relative binary `win-loss' feedback for this pair, but…

机器学习 · 计算机科学 2020-10-29 Aadirupa Saha , Tomer Koren , Yishay Mansour

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

机器学习 · 计算机科学 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

We consider the problem of reward maximization in the dueling bandit setup along with constraints on resource consumption. As in the classic dueling bandits, at each round the learner has to choose a pair of items from a set of $K$ items…

机器学习 · 计算机科学 2023-12-29 Rohan Deb , Aadirupa Saha

This study investigates the problem of $K$-armed linear contextual bandits, an instance of the multi-armed bandit problem, under an adversarial corruption. At each round, a decision-maker observes an independent and identically distributed…

机器学习 · 计算机科学 2023-12-29 Masahiro Kato , Shinji Ito

We study the $K$-armed dueling bandit problem, a variation of the traditional multi-armed bandit problem in which feedback is obtained in the form of pairwise comparisons. Previous learning algorithms have focused on the $\textit{fully…

机器学习 · 计算机科学 2022-09-27 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan

The $K$-armed dueling bandit problem, where the feedback is in the form of noisy pairwise comparisons, has been widely studied. Previous works have only focused on the sequential setting where the policy adapts after every comparison.…

机器学习 · 计算机科学 2022-02-23 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan

The dueling bandit is a learning framework wherein the feedback information in the learning process is restricted to a noisy comparison between a pair of actions. In this research, we address a dueling bandit problem based on a cost…

机器学习 · 统计学 2017-12-13 Wataru Kumagai

We consider a contextual bandit problem with $S$ contexts and $K$ actions. In each round $t=1,2,\dots$, the learner observes a random context and chooses an action based on its past experience. The learner then observes a random reward…

机器学习 · 计算机科学 2023-11-29 Chung-Wei Lee , Qinghua Liu , Yasin Abbasi-Yadkori , Chi Jin , Tor Lattimore , Csaba Szepesvári

In many applications, e.g. in healthcare and e-commerce, the goal of a contextual bandit may be to learn an optimal treatment assignment policy at the end of the experiment. That is, to minimize simple regret. However, this objective…

机器学习 · 计算机科学 2023-11-06 Sanath Kumar Krishnamurthy , Ruohan Zhan , Susan Athey , Emma Brunskill

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

机器学习 · 计算机科学 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low

We consider the kernelized contextual bandit problem with a large feature space. This problem involves $K$ arms, and the goal of the forecaster is to maximize the cumulative rewards through learning the relationship between the contexts and…

机器学习 · 统计学 2025-05-21 Shogo Iwazaki , Junpei Komiyama , Masaaki Imaizumi

Multi-dueling bandits, where a learner selects $m \geq 2$ arms per round and observes only the winner, arise naturally in many applications including ranking and recommendation systems, yet a fundamental question has remained open: can a…

机器学习 · 计算机科学 2026-05-19 S Akash , Pratik Gajane , Jawar Singh

Learning from human feedback plays an important role in aligning generative models, such as large language models (LLM). However, the effectiveness of this approach can be influenced by adversaries, who may intentionally provide misleading…

机器学习 · 计算机科学 2025-11-13 Qiwei Di , Jiafan He , Quanquan Gu

We study a sequential decision problem where the learner faces a sequence of $K$-armed bandit tasks. The task boundaries might be known (the bandit meta-learning setting), or unknown (the non-stationary bandit setting). For a given integer…

We study the non-stationary stochastic multi-armed bandit problem, where the reward statistics of each arm may change several times during the course of learning. The performance of a learning algorithm is evaluated in terms of their…

机器学习 · 计算机科学 2022-03-09 Yasin Abbasi-Yadkori , Andras Gyorgy , Nevena Lazic
‹ 上一页 1 2 3 10 下一页 ›