English
Related papers

Related papers: Blocked Collaborative Bandits: Online Collaborativ…

200 papers

We introduce a novel framework called combinatorial logistic bandits (CLogB), where in each round, a subset of base arms (called the super arm) is selected, with the outcome of each base arm being binary and its expectation following a…

Machine Learning · Computer Science 2025-05-15 Xutong Liu , Xiangxiang Dai , Xuchuang Wang , Mohammad Hajiesmaili , John C. S. Lui

In this paper, we introduce Ballooning Multi-Armed Bandits (BL-MAB), a novel extension of the classical stochastic MAB model. In the BL-MAB model, the set of available arms grows (or balloons) over time. In contrast to the classical MAB…

Machine Learning · Computer Science 2021-02-23 Ganesh Ghalme , Swapnil Dhamal , Shweta Jain , Sujit Gujar , Y. Narahari

This paper considers a multi-armed bandit (MAB) problem in which multiple mobile agents receive rewards by sampling from a collection of spatially dispersed stochastic processes, called bandits. The goal is to formulate a decentralized…

Machine Learning · Computer Science 2020-04-01 Pathmanathan Pankayaraj , D. H. S. Maithripala , J. M. Berg

We consider the problem of online combinatorial optimization under semi-bandit feedback, where a learner has to repeatedly pick actions from a combinatorial decision set in order to minimize the total losses associated with its decisions.…

Machine Learning · Computer Science 2015-06-11 Gergely Neu

We study the linear contextual bandit problem with finite action sets. When the problem dimension is $d$, the time horizon is $T$, and there are $n \leq 2^{d/2}$ candidate actions per time period, we (1) show that the minimax expected…

Machine Learning · Statistics 2020-08-20 Yingkai Li , Yining Wang , Yuan Zhou

This paper presents a new algorithm for neural contextual bandits (CBs) that addresses the challenge of delayed reward feedback, where the reward for a chosen action is revealed after a random, unknown delay. This scenario is common in…

Machine Learning · Computer Science 2025-04-17 Mohammadali Moghimi , Sharu Theresa Jose , Shana Moothedath

We study a multiplayer stochastic multi-armed bandit problem in which players cannot communicate, and if two or more players pull the same arm, a collision occurs and the involved players receive zero reward. We consider the challenging…

Machine Learning · Statistics 2020-03-23 Etienne Boursier , Emilie Kaufmann , Abbas Mehrabian , Vianney Perchet

Experimentation with interference poses a significant challenge in contemporary online platforms. Prior research on experimentation with interference has concentrated on the final output of a policy. The cumulative performance, while…

Machine Learning · Computer Science 2024-07-17 Su Jia , Peter Frazier , Nathan Kallus

We study the combinatorial semi-bandit problem under matroid constraints. The regret achieved by recent approaches is optimal, in the sense that it matches the lower bound. Yet, time complexity remains an issue for large matroids or for…

Machine Learning · Computer Science 2025-12-02 Aurélien Delage , Romaric Gaudel

I present the first algorithm for stochastic finite-armed bandits that simultaneously enjoys order-optimal problem-dependent regret and worst-case regret. Besides the theoretical results, the new algorithm is simple, efficient and…

Machine Learning · Computer Science 2016-02-25 Tor Lattimore

We study finite-armed semiparametric bandits, where each arm's reward combines a linear component with an unknown, potentially adversarial shift. This model strictly generalizes classical linear bandits and reflects complexities common in…

Machine Learning · Statistics 2025-06-18 Seok-Jin Kim , Gi-Soo Kim , Min-hwan Oh

We present algorithms for reducing the Dueling Bandits problem to the conventional (stochastic) Multi-Armed Bandits problem. The Dueling Bandits problem is an online model of learning with ordinal feedback of the form "A is preferred to B"…

Machine Learning · Computer Science 2014-05-15 Nir Ailon , Thorsten Joachims , Zohar Karnin

We study the problem of learning 'good' interventions in a stochastic environment modeled by its underlying causal graph. Good interventions refer to interventions that maximize rewards. Specifically, we consider the setting of a…

Machine Learning · Computer Science 2024-01-17 Fateme Jamshidi , Jalal Etesami , Negar Kiyavash

We tackle a new emerging problem, which is finding an optimal monopartite matching in a weighted graph. The semi-bandit version, where a full matching is sampled at each iteration, has been addressed by \cite{ADMA}, creating an algorithm…

Machine Learning · Computer Science 2022-08-03 Romaric Gaudel , Matthieu Rodet

We introduce a bandit framework for stochastic matching under the multinomial logit (MNL) choice model. In our setting, $N$ agents on one side are assigned to $K$ arms on the other side, where each arm stochastically selects an agent from…

Machine Learning · Statistics 2026-01-30 Jung-hun Kim , Min-hwan Oh

We study the linear bandit problem under limited adaptivity, known as the batched linear bandit. While existing approaches can achieve near-optimal regret in theory, they are often computationally prohibitive or underperform in practice. We…

Machine Learning · Statistics 2025-08-12 Sanghoon Yu , Min-hwan Oh

We consider the problem of multiple users targeting the arms of a single multi-armed stochastic bandit. The motivation for this problem comes from cognitive radio networks, where selfish users need to coexist without any side communication…

Machine Learning · Computer Science 2014-04-23 Orly Avner , Shie Mannor

We consider a budgeted combinatorial multi-armed bandit setting where, in every round, the algorithm selects a super-arm consisting of one or more arms. The goal is to minimize the total expected regret after all rounds within a limited…

Machine Learning · Computer Science 2022-02-17 Debojit Das , Shweta Jain , Sujit Gujar

In combinatorial semi-bandits, a learner repeatedly selects from a combinatorial decision set of arms, receives the realized sum of rewards, and observes the rewards of the individual selected arms as feedback. In this paper, we extend this…

Machine Learning · Computer Science 2025-09-17 Yuxiao Wen

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

Machine Learning · Statistics 2021-03-26 Min-hwan Oh , Garud Iyengar
‹ Prev 1 8 9 10 Next ›