English
Related papers

Related papers: A Contextual Combinatorial Bandit Approach to Nego…

200 papers

We consider the combinatorial volatile Gaussian process (GP) semi-bandit problem. Each round, an agent is provided a set of available base arms and must select a subset of them to maximize the long-term cumulative reward. We study the…

Machine Learning · Computer Science 2025-02-13 Jack Sandberg , Niklas Åkerblom , Morteza Haghir Chehreghani

Thanks to the power of representation learning, neural contextual bandit algorithms demonstrate remarkable performance improvement against their classical counterparts. But because their exploration has to be performed in the entire neural…

Machine Learning · Computer Science 2022-03-22 Yiling Jia , Weitong Zhang , Dongruo Zhou , Quanquan Gu , Hongning Wang

Online recommendation/advertising is ubiquitous in web business. Image displaying is considered as one of the most commonly used formats to interact with customers. Contextual multi-armed bandit has shown success in the application of…

Machine Learning · Computer Science 2022-02-11 Yikun Ban , Jingrui He

Existing risk-aware multi-armed bandit models typically focus on risk measures of individual options such as variance. As a result, they cannot be directly applied to important real-world online decision making problems with correlated…

Machine Learning · Computer Science 2023-05-12 Yihan Du , Siwei Wang , Zhixuan Fang , Longbo Huang

A stochastic combinatorial semi-bandit is an online learning problem where at each step a learning agent chooses a subset of ground items subject to combinatorial constraints, and then observes stochastic weights of these items and receives…

Machine Learning · Computer Science 2017-02-01 Zheng Wen , Branislav Kveton , Azin Ashkan

We formulate a new problem at the intersectionof semi-supervised learning and contextual bandits,motivated by several applications including clini-cal trials and ad recommendations. We demonstratehow Graph Convolutional Network (GCN), a…

Machine Learning · Computer Science 2020-10-26 Sohini Upadhyay , Mikhail Yurochkin , Mayank Agarwal , Yasaman Khazaeni , DjallelBouneffouf

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

Machine Learning · Statistics 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

Contextual bandits have emerged as a cornerstone in reinforcement learning, enabling systems to make decisions with partial feedback. However, as contexts grow in complexity, traditional bandit algorithms can face challenges in adequately…

Machine Learning · Computer Science 2023-11-07 Ali Baheri , Cecilia O. Alm

Contextual multi-armed bandits are a popular choice to model sequential decision-making. E.g., in a healthcare application we may perform various tests to asses a patient condition (exploration) and then decide on the best treatment to give…

Machine Learning · Computer Science 2025-04-08 Mirco Mutti , Jeongyeol Kwon , Shie Mannor , Aviv Tamar

The linear contextual bandit literature is mostly focused on the design of efficient learning algorithms for a given representation. However, a contextual bandit problem may admit multiple linear representations, each one with different…

Machine Learning · Computer Science 2021-04-09 Matteo Papini , Andrea Tirinzoni , Marcello Restelli , Alessandro Lazaric , Matteo Pirotta

Many sequential decision-making problems in communication networks can be modeled as contextual bandit problems, which are natural extensions of the well-known multi-armed bandit problem. In contextual bandit problems, at each time, an…

Machine Learning · Computer Science 2016-05-10 Pranav Sakulkar , Bhaskar Krishnamachari

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

Machine Learning · Statistics 2020-02-27 Aniket Anand Deshmukh , Srinagesh Sharma , James W. Cutler , Mark Moldwin , Clayton Scott

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

Machine Learning · Computer Science 2018-06-04 Cem Tekin , Eralp Turgay

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

Virtual support agents have grown in popularity as a way for businesses to provide better and more accessible customer service. Some challenges in this domain include ambiguous user queries as well as changing support topics and user…

Machine Learning · Computer Science 2021-12-07 Sandra Sajeev , Jade Huang , Nikos Karampatziakis , Matthew Hall , Sebastian Kochman , Weizhu Chen

In light of the COVID-19 pandemic, it is an open challenge and critical practical problem to find a optimal way to dynamically prescribe the best policies that balance both the governmental resources and epidemic control in different…

Machine Learning · Computer Science 2022-04-28 Baihan Lin , Djallel Bouneffouf

We study a Combinatorial Multi-Bandit Problem motivated by applications in energy systems management. Given multiple probabilistic multi-arm bandits with unknown outcome distributions, the task is to optimize the value of a combinatorial…

Machine Learning · Computer Science 2020-11-05 Tobias Jacobs , Mischa Schmidt , Sébastien Nicolas , Anett Schülke

We propose a novel combinatorial stochastic-greedy bandit (SGB) algorithm for combinatorial multi-armed bandit problems when no extra information other than the joint reward of the selected set of $n$ arms at each time step $t\in [T]$ is…

Machine Learning · Computer Science 2023-12-14 Fares Fourati , Christopher John Quinn , Mohamed-Slim Alouini , Vaneet Aggarwal

Contextual multi-armed bandit has shown to be an effective tool in recommender systems. In this paper, we study a novel problem of multi-facet bandits involving a group of bandits, each characterizing the users' needs from one unique…

Machine Learning · Computer Science 2021-07-02 Yikun Ban , Jingrui He , Curtiss B. Cook

It is challenging but important to save annotation efforts in streaming data acquisition to maintain data quality for supervised learning base learners. We propose an ensemble active learning method to actively acquire samples for…

Machine Learning · Computer Science 2023-10-12 Yingyan Zeng , Xiaoyu Chen , Ran Jin