中文
相关论文

相关论文: Simple Combinatorial Algorithms for Combinatorial …

200 篇论文

We consider the problem of online combinatorial optimization under semi-bandit feedback, where a learner has to repeatedly pick actions from a combinatorial decision set in order to minimize the total losses associated with its decisions.…

机器学习 · 计算机科学 2015-06-11 Gergely Neu

This paper investigates stochastic and adversarial combinatorial multi-armed bandit problems. In the stochastic setting under semi-bandit feedback, we derive a problem-specific regret lower bound, and discuss its scaling with the dimension…

机器学习 · 计算机科学 2015-11-09 Richard Combes , M. Sadegh Talebi , Alexandre Proutiere , Marc Lelarge

We study the problem of multi-agent multi-armed bandits with adversarial corruption in a heterogeneous setting, where each agent accesses a subset of arms. The adversary can corrupt the reward observations for all agents. Agents share these…

机器学习 · 计算机科学 2024-11-14 Fatemeh Ghaffari , Xuchuang Wang , Jinhang Zuo , Mohammad Hajiesmaili

We study the problem of stochastic bandits with adversarial corruptions in the cooperative multi-agent setting, where $V$ agents interact with a common $K$-armed bandit problem, and each pair of agents can communicate with each other to…

机器学习 · 计算机科学 2021-06-09 Junyan Liu , Shuai Li , Dapeng Li

We investigate the regret-minimisation problem in a multi-armed bandit setting with arbitrary corruptions. Similar to the classical setup, the agent receives rewards generated independently from the distribution of the arm chosen at each…

机器学习 · 统计学 2023-09-29 Shubhada Agrawal , Timothée Mathieu , Debabrota Basu , Odalric-Ambrym Maillard

We study the linear contextual bandit problem in the presence of adversarial corruption, where the reward at each round is corrupted by an adversary, and the corruption level (i.e., the sum of corruption magnitudes over the horizon) is…

机器学习 · 计算机科学 2022-07-12 Jiafan He , Dongruo Zhou , Tong Zhang , Quanquan Gu

Strategic behavior against sequential learning methods, such as "click framing" in real recommendation systems, have been widely observed. Motivated by such behavior we study the problem of combinatorial multi-armed bandits (CMAB) under…

机器学习 · 计算机科学 2021-11-22 Jing Dong , Ke Li , Shuai Li , Baoxiang Wang

We present an algorithm that achieves almost optimal pseudo-regret bounds against adversarial and stochastic bandits. Against adversarial bandits the pseudo-regret is $O(K\sqrt{n \log n})$ and against stochastic bandits the pseudo-regret is…

机器学习 · 计算机科学 2016-05-30 Peter Auer , Chao-Kai Chiang

We derive improved regret bounds for the Tsallis-INF algorithm of Zimmert and Seldin (2021). We show that in adversarial regimes with a $(\Delta,C,T)$ self-bounding constraint the algorithm achieves $\mathcal{O}\left(\left(\sum_{i\neq i^*}…

机器学习 · 计算机科学 2021-09-14 Saeed Masoudian , Yevgeny Seldin

In this paper we study the adversarial combinatorial bandit with a known non-linear reward function, extending existing work on adversarial linear combinatorial bandit. {The adversarial combinatorial bandit with general non-linear reward is…

机器学习 · 统计学 2021-01-06 Xi Chen , Yanjun Han , Yining Wang

We study the problem of $K$-armed dueling bandit for both stochastic and adversarial environments, where the goal of the learner is to aggregate information through relative preferences of pair of decisions points queried in an online…

机器学习 · 计算机科学 2022-02-15 Aadirupa Saha , Pierre Gaillard

Combinatorial multi-armed bandits provide a fundamental online decision-making environment where a decision-maker interacts with an environment across $T$ time steps, each time selecting an action and learning the cost of that action. The…

机器学习 · 计算机科学 2026-04-13 Gerdus Benadè , Rathish Das , Thomas Lavastida

The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been…

机器学习 · 计算机科学 2022-02-24 Xiaojin Zhang , Shuai Li , Weiwen Liu , Shengyu Zhang

We propose a new algorithm for adversarial multi-armed bandits with unrestricted delays. The algorithm is based on a novel hybrid regularizer applied in the Follow the Regularized Leader (FTRL) framework. It achieves…

机器学习 · 计算机科学 2020-06-17 Julian Zimmert , Yevgeny Seldin

A stochastic combinatorial semi-bandit is an online learning problem where at each step a learning agent chooses a subset of ground items subject to constraints, and then observes stochastic weights of these items and receives their sum as…

机器学习 · 计算机科学 2017-06-08 Branislav Kveton , Zheng Wen , Azin Ashkan , Csaba Szepesvari

We introduce the first best-of-both-worlds algorithm for contextual combinatorial semi-bandits that simultaneously guarantees $\widetilde{\mathcal{O}}(\sqrt{T})$ regret in the adversarial regime and $\widetilde{\mathcal{O}}(\ln T)$ regret…

机器学习 · 统计学 2026-03-27 Mengmeng Li , Philipp J. Schneider , Jelisaveta Aleksić , Daniel Kuhn

Combinatorial bandits extend the classical bandit framework to settings where the learner selects multiple arms in each round, motivated by applications such as online recommendation and assortment optimization. While extensions of upper…

机器学习 · 计算机科学 2025-10-29 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

Recently a multi-agent variant of the classical multi-armed bandit was proposed to tackle fairness issues in online learning. Inspired by a long line of work in social choice and economics, the goal is to optimize the Nash social welfare…

机器学习 · 计算机科学 2022-09-27 Matthew Jones , Huy Lê Nguyen , Thy Nguyen

We study a new type of K-armed bandit problem where the expected return of one arm may depend on the returns of other arms. We present a new algorithm for this general class of problems and show that under certain circumstances it is…

机器学习 · 计算机科学 2014-11-12 Tor Lattimore , Remi Munos

We study best-of-both-worlds algorithms for bandits with switching cost, recently addressed by Rouyer, Seldin and Cesa-Bianchi, 2021. We introduce a surprisingly simple and effective algorithm that simultaneously achieves minimax optimal…

机器学习 · 计算机科学 2022-11-03 Idan Amir , Guy Azov , Tomer Koren , Roi Livni