中文
相关论文

相关论文: The price of unfairness in linear bandits with bia…

200 篇论文

We consider a multi-armed bandit problem where payoffs are a linear function of an observed stochastic contextual variable. In the scenario where there exists a gap between optimal and suboptimal rewards, several algorithms have been…

数据结构与算法 · 计算机科学 2014-07-08 José Bento , Stratis Ioannidis , S. Muthukrishnan , Jinyun Yan

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

机器学习 · 计算机科学 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

机器学习 · 计算机科学 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

We consider stochastic multi-armed bandit problems with complex actions over a set of basic arms, where the decision maker plays a complex action rather than a basic arm in each round. The reward of the complex action is some function of…

机器学习 · 统计学 2013-11-05 Aditya Gopalan , Shie Mannor , Yishay Mansour

In this paper, we treat linear quadratic team decision problems, where a team of agents minimizes a convex quadratic cost function over $T$ time steps subject to possibly distinct linear measurements of the state of nature. We assume that…

最优化与控制 · 数学 2022-12-23 Olle Kjellqvist , Ather Gattami

Multiplayer bandits have recently been extensively studied because of their application to cognitive radio networks. While the literature mostly considers synchronous players, radio networks (e.g. for IoT) tend to have asynchronous devices.…

机器学习 · 计算机科学 2023-06-01 Hugo Richard , Etienne Boursier , Vianney Perchet

Motivated by models of human decision making proposed to explain commonly observed deviations from conventional expected value preferences, we formulate two stochastic multi-armed bandit problems with distorted probabilities on the reward…

机器学习 · 计算机科学 2023-11-01 Ravi Kumar Kolla , Prashanth L. A. , Aditya Gopalan , Krishna Jagannathan , Michael Fu , Steve Marcus

In bandit settings, optimizing long-term regret metrics requires exploration, which corresponds to sometimes taking myopically sub-optimal actions. When a long-lived principal merely recommends actions to be executed by a sequence of…

计算机科学与博弈论 · 计算机科学 2026-02-25 Ramya Ramalingam , Osbert Bastani , Aaron Roth

We consider best arm identification in the multi-armed bandit problem. Assuming certain continuity conditions of the prior, we characterize the rate of the Bayesian simple regret. Differing from Bayesian regret minimization (Lai, 1987), the…

机器学习 · 计算机科学 2023-07-27 Junpei Komiyama , Kaito Ariu , Masahiro Kato , Chao Qin

We consider a cooperative multiplayer bandit learning problem where the players are only allowed to agree on a strategy beforehand, but cannot communicate during the learning process. In this problem, each player simultaneously selects an…

机器学习 · 计算机科学 2023-11-13 William Chang , Yuanhao Lu

This paper considers an online multi-player resource-sharing game with bandit feedback. Multiple players choose from a finite collection of resources in a time slotted system. In each time slot, each resource brings a random reward that is…

计算机科学与博弈论 · 计算机科学 2025-02-18 Mevan Wijewardena , Michael. J Neely

Causal knowledge about the relationships among decision variables and a reward variable in a bandit setting can accelerate the learning of an optimal decision. Current works often assume the causal graph is known, which may not always be…

机器学习 · 统计学 2024-11-07 Muhammad Qasim Elahi , Mahsa Ghasemi , Murat Kocaoglu

We consider a stochastic multi-armed bandit (MAB) problem motivated by ``large'' action spaces, and endowed with a population of arms containing exactly $K$ arm-types, each characterized by a distinct mean reward. The decision maker is…

机器学习 · 计算机科学 2023-01-19 Anand Kalvit , Assaf Zeevi

We consider Contextual Bandits with Concave Rewards (CBCR), a multi-objective bandit problem where the desired trade-off between the rewards is defined by a known concave objective function, and the reward vector depends on an observed…

机器学习 · 计算机科学 2023-03-01 Virginie Do , Elvis Dohmatob , Matteo Pirotta , Alessandro Lazaric , Nicolas Usunier

We tackle a new emerging problem, which is finding an optimal monopartite matching in a weighted graph. The semi-bandit version, where a full matching is sampled at each iteration, has been addressed by \cite{ADMA}, creating an algorithm…

机器学习 · 计算机科学 2022-08-03 Camille-Sovanneary Gauthier , Romaric Gaudel , Elisa Fromont

In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to…

机器学习 · 计算机科学 2021-03-02 Andrew Wagenmaker , Julian Katz-Samuels , Kevin Jamieson

In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified by the inner…

机器学习 · 统计学 2023-05-30 Osama A. Hanna , Lin F. Yang , Christina Fragouli

We introduce the problem of regret minimization in adversarial multi-dueling bandits. While adversarial preferences have been studied in dueling bandits, they have not been explored in multi-dueling bandits. In this setting, the learner is…

机器学习 · 计算机科学 2024-06-27 Pratik Gajane

We introduce a novel online learning framework that unifies and generalizes pre-established models, such as delayed and corrupted feedback, to encompass adversarial environments where action feedback evolves over time. In this setting, the…

机器学习 · 计算机科学 2024-05-28 Yogev Bar-On , Yishay Mansour

The Greedy algorithm is the simplest heuristic in sequential decision problem that carelessly takes the locally optimal choice at each round, disregarding any advantages of exploring and/or information gathering. Theoretically, it is known…

机器学习 · 计算机科学 2021-01-05 Matthieu Jedor , Jonathan Louëdec , Vianney Perchet