中文
相关论文

相关论文: Bandit Max-Min Fair Allocation

200 篇论文

Dueling bandits are widely used to model preferential feedback prevalent in many applications such as recommendation systems and ranking. In this paper, we study the Borda regret minimization problem for dueling bandits, which aims to…

机器学习 · 计算机科学 2023-09-27 Yue Wu , Tao Jin , Hao Lou , Farzad Farnoud , Quanquan Gu

Reinforcement learning addresses the dilemma between exploration to find profitable actions and exploitation to act according to the best observations already made. Bandit problems are one such class of problems in stateless environments…

机器学习 · 计算机科学 2012-02-20 Ananda Narayanan B , Balaraman Ravindran

The Combinatorial Multi-Armed Bandit problem is a sequential decision-making problem in which an agent selects a set of arms on each round, observes feedback for each of these arms and aims to maximize a known reward function of the arms it…

机器学习 · 计算机科学 2020-07-17 Nadav Merlis , Shie Mannor

We introduce a novel extension of the canonical multi-armed bandit problem that incorporates an additional strategic innovation: abstention. In this enhanced framework, the agent is not only tasked with selecting an arm at each time step,…

机器学习 · 计算机科学 2026-03-24 Junwen Yang , Tianyuan Jin , Vincent Y. F. Tan

We improve the efficiency of algorithms for stochastic \emph{combinatorial semi-bandits}. In most interesting problems, state-of-the-art algorithms take advantage of structural properties of rewards, such as \emph{independence}. However,…

机器学习 · 统计学 2019-06-24 Pierre Perrault , Vianney Perchet , Michal Valko

In this paper, we introduce a multi-armed bandit problem termed max-min grouped bandits, in which the arms are arranged in possibly-overlapping groups, and the goal is to find the group whose worst arm has the highest mean reward. This…

机器学习 · 统计学 2022-03-16 Zhenlin Wang , Jonathan Scarlett

This paper studies semiparametric contextual bandits, a generalization of the linear stochastic bandit problem where the reward for an action is modeled as a linear function of known action features confounded by an non-linear…

机器学习 · 统计学 2018-07-17 Akshay Krishnamurthy , Zhiwei Steven Wu , Vasilis Syrgkanis

We propose a simple model selection approach for algorithms in stochastic bandit and reinforcement learning problems. As opposed to prior work that (implicitly) assumes knowledge of the optimal regret, we only require that each base…

机器学习 · 计算机科学 2020-12-25 Aldo Pacchiano , Christoph Dann , Claudio Gentile , Peter Bartlett

We study an interesting variant of the stochastic multi-armed bandit problem, called the Fair-SMAB problem, where each arm is required to be pulled for at least a given fraction of the total available rounds. We investigate the interplay…

机器学习 · 计算机科学 2020-02-06 Vishakha Patil , Ganesh Ghalme , Vineet Nair , Y. Narahari

The multi-armed bandits' framework is the most common platform to study strategies for sequential decision-making problems. Recently, the notion of fairness has attracted a lot of attention in the machine learning community. One can impose…

机器学习 · 计算机科学 2020-12-25 Shaarad A. R , Ambedkar Dukkipati

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

机器学习 · 计算机科学 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

机器学习 · 统计学 2021-03-26 Min-hwan Oh , Garud Iyengar

We introduce the problem of regret minimization in Adversarial Dueling Bandits. As in classic Dueling Bandits, the learner has to repeatedly choose a pair of items and observe only a relative binary `win-loss' feedback for this pair, but…

机器学习 · 计算机科学 2020-10-29 Aadirupa Saha , Tomer Koren , Yishay Mansour

In a multi-armed bandit (MAB) problem a gambler needs to choose at each round of play one of K arms, each characterized by an unknown reward distribution. Reward realizations are only observed when an arm is selected, and the gambler's…

机器学习 · 计算机科学 2019-06-11 Omar Besbes , Yonatan Gur , Assaf Zeevi

We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have…

机器学习 · 计算机科学 2013-04-02 Jean-Yves Audibert , Sébastien Bubeck , Gábor Lugosi

We tackle a new emerging problem, which is finding an optimal monopartite matching in a weighted graph. The semi-bandit version, where a full matching is sampled at each iteration, has been addressed by \cite{ADMA}, creating an algorithm…

机器学习 · 计算机科学 2022-08-03 Camille-Sovanneary Gauthier , Romaric Gaudel , Elisa Fromont

Contextual multi-armed bandit has shown to be an effective tool in recommender systems. In this paper, we study a novel problem of multi-facet bandits involving a group of bandits, each characterizing the users' needs from one unique…

机器学习 · 计算机科学 2021-07-02 Yikun Ban , Jingrui He , Curtiss B. Cook

We consider maximizing an unknown monotonic, submodular set function $f: 2^{[n]} \rightarrow [0,1]$ with cardinality constraint under stochastic bandit feedback. At each time $t=1,\dots,T$ the learner chooses a set $S_t \subset [n]$ with…

机器学习 · 计算机科学 2024-12-13 Artin Tajdini , Lalit Jain , Kevin Jamieson

We study the sequential resource allocation problem where a decision maker repeatedly allocates budgets between resources. Motivating examples include allocating limited computing time or wireless spectrum bands to multiple users (i.e.,…

机器学习 · 计算机科学 2021-05-11 Jinhang Zuo , Carlee Joe-Wong

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

机器学习 · 计算机科学 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai