中文
相关论文

相关论文: Dueling Bandits with Qualitative Feedback

200 篇论文

We present algorithms for reducing the Dueling Bandits problem to the conventional (stochastic) Multi-Armed Bandits problem. The Dueling Bandits problem is an online model of learning with ordinal feedback of the form "A is preferred to B"…

机器学习 · 计算机科学 2014-05-15 Nir Ailon , Thorsten Joachims , Zohar Karnin

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

机器学习 · 计算机科学 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low

Multi-Armed-Bandit frameworks have often been used by researchers to assess educational interventions, however, recent work has shown that it is more beneficial for a student to provide qualitative feedback through preference elicitation…

机器学习 · 计算机科学 2021-11-02 Nayan Saxena , Pan Chen , Emmy Liu

In machine learning, the notion of multi-armed bandits refers to a class of online learning problems, in which an agent is supposed to simultaneously explore and exploit a given set of choice alternatives in the course of a sequential…

机器学习 · 计算机科学 2021-07-13 Viktor Bengs , Robert Busa-Fekete , Adil El Mesaoudi-Paul , Eyke Hüllermeier

We study a general multi-dueling bandit problem, where an agent compares multiple options simultaneously and aims to minimize the regret due to selecting suboptimal arms. This setting generalizes the traditional two-dueling bandit problem…

机器学习 · 计算机科学 2022-11-21 Yihan Du , Siwei Wang , Longbo Huang

Multi-armed bandit(MAB) problem is a reinforcement learning framework where an agent tries to maximise her profit by proper selection of actions through absolute feedback for each action. The dueling bandits problem is a variation of MAB…

机器学习 · 计算机科学 2019-02-08 Nischal Agrawal , Prasanna Chaporkar

The dueling bandit problem, an essential variation of the traditional multi-armed bandit problem, has become significantly prominent recently due to its broad applications in online advertising, recommendation systems, information…

机器学习 · 计算机科学 2025-04-08 Bongsoo Yi , Yue Kang , Yao Li

Contextual dueling bandits form a cornerstone of preference-based decision-making, with critical applications in recommender systems and large language model alignment. However, standard algorithms rely on the idealized assumption of…

机器学习 · 计算机科学 2026-05-27 Xiangyi Wang , Pingchen Lu , Jie Mao , Mingze Kong , Zhi Hong , Zhiyong Wang , Zhongxiang Dai

Research on the multi-armed bandit problem has studied the trade-off of exploration and exploitation in depth. However, there are numerous applications where the cardinal absolute-valued feedback model (e.g. ratings from one to five) is not…

机器学习 · 计算机科学 2018-12-12 Lennard Hilgendorf

We study dueling bandits with weak utility-based regret when preferences over arms have a total order and carry observable feature vectors. The order is assumed to be determined by these feature vectors, an unknown preference vector, and a…

机器学习 · 计算机科学 2017-06-16 Bangrui Chen , Peter I. Frazier

The dueling bandits problem is an online learning framework for learning from pairwise preference feedback, and is particularly well-suited for modeling settings that elicit subjective or implicit human feedback. In this paper, we study the…

机器学习 · 计算机科学 2017-05-02 Yanan Sui , Vincent Zhuang , Joel W. Burdick , Yisong Yue

Various approaches have emerged for multi-armed bandits in distributed systems. The multiplayer dueling bandit problem, common in scenarios with only preference-based information like human feedback, introduces challenges related to…

机器学习 · 计算机科学 2025-04-24 Or Raveh , Junya Honda , Masashi Sugiyama

The $K$-armed dueling bandit problem, where the feedback is in the form of noisy pairwise comparisons, has been widely studied. Previous works have only focused on the sequential setting where the policy adapts after every comparison.…

机器学习 · 计算机科学 2022-02-23 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

机器学习 · 计算机科学 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

We introduce the problem of sleeping dueling bandits with stochastic preferences and adversarial availabilities (DB-SPAA). In almost all dueling bandit applications, the decision space often changes over time; eg, retail store management,…

机器学习 · 计算机科学 2021-07-07 Aadirupa Saha , Pierre Gaillard

We consider sequential decision making under uncertainty, where the goal is to optimize over a large decision space using noisy comparative feedback. This problem can be formulated as a $K$-armed Dueling Bandits problem where $K$ is the…

机器学习 · 计算机科学 2017-07-11 Yanan Sui , Yisong Yue , Joel W. Burdick

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

机器学习 · 计算机科学 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

The Thresholding Bandit Problem (TBP) aims to find the set of arms with mean rewards greater than a given threshold. We consider a new setting of TBP, where in addition to pulling arms, one can also \emph{duel} two arms and get the arm with…

机器学习 · 计算机科学 2020-06-16 Yichong Xu , Xi Chen , Aarti Singh , Artur Dubrawski

This paper investigates the fusion of absolute (reward) and relative (dueling) feedback in stochastic bandits, where both feedback types are gathered in each decision round. We derive a regret lower bound, demonstrating that an efficient…

机器学习 · 计算机科学 2025-04-23 Xuchuang Wang , Qirun Zeng , Jinhang Zuo , Xutong Liu , Mohammad Hajiesmaili , John C. S. Lui , Adam Wierman

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

机器学习 · 计算机科学 2022-02-15 Aadirupa Saha , Pierre Gaillard
‹ 上一页 1 2 3 10 下一页 ›