中文
相关论文

相关论文: An Efficient Algorithm for Deep Stochastic Context…

200 篇论文

Stochastic linear contextual bandit algorithms have substantial applications in practice, such as recommender systems, online advertising, clinical trials, etc. Recent works show that optimal bandit algorithms are vulnerable to adversarial…

机器学习 · 统计学 2023-01-31 Qin Ding , Cho-Jui Hsieh , James Sharpnack

Bandit problems with linear or concave reward have been extensively studied, but relatively few works have studied bandits with non-concave reward. This work considers a large family of bandit problems where the unknown underlying reward…

机器学习 · 计算机科学 2021-07-12 Baihe Huang , Kaixuan Huang , Sham M. Kakade , Jason D. Lee , Qi Lei , Runzhe Wang , Jiaqi Yang

We consider contextual linear bandits over networks, a class of sequential decision-making problems where learning occurs simultaneously across multiple locations and the reward distributions share structural similarities while also…

机器学习 · 计算机科学 2025-08-26 Chuyun Deng , Huiwen Jia

Contextual bandits provide an effective way to model the dynamic data problem in ML by leveraging online (incremental) learning to continuously adjust the predictions based on changing environment. We explore details on contextual bandits,…

机器学习 · 计算机科学 2020-09-24 Dattaraj Rao

Contextual bandits algorithms aim to choose the optimal arm with the highest reward out of a set of candidates based on the contextual information. Various bandit algorithms have been applied to real-world applications due to their ability…

机器学习 · 计算机科学 2023-08-22 Yunzhe Qi , Yikun Ban , Jingrui He

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

We study a variant of the contextual bandit problem where an agent can intervene through a set of stochastic expert policies. Given a fixed context, each expert samples actions from a fixed conditional distribution. The agent seeks to…

机器学习 · 计算机科学 2024-10-29 Nihal Sharma , Rajat Sen , Soumya Basu , Karthikeyan Shanmugam , Sanjay Shakkottai

In this study, we propose a new method for constructing UCB-type algorithms for stochastic multi-armed bandits based on general convex optimization methods with an inexact oracle. We derive the regret bounds corresponding to the convergence…

机器学习 · 计算机科学 2024-02-13 Yuriy Dorn , Aleksandr Katrutsa , Ilgam Latypov , Andrey Pudovikov

We consider the problem of contextual bandits with stochastic experts, which is a variation of the traditional stochastic contextual bandit with experts problem. In our problem setting, we assume access to a class of stochastic experts,…

机器学习 · 统计学 2021-03-04 Rajat Sen , Karthikeyan Shanmugam , Nihal Sharma , Sanjay Shakkottai

We study stage-wise conservative linear stochastic bandits: an instance of bandit optimization, which accounts for (unknown) safety constraints that appear in applications such as online advertising and medical trials. At each stage, the…

机器学习 · 计算机科学 2020-10-02 Ahmadreza Moradipari , Christos Thrampoulidis , Mahnoosh Alizadeh

We introduce a new and completely online contextual bandit algorithm called Gated Linear Contextual Bandits (GLCB). This algorithm is based on Gated Linear Networks (GLNs), a recently introduced deep learning architecture with properties…

机器学习 · 计算机科学 2020-11-23 Eren Sezener , Marcus Hutter , David Budden , Jianan Wang , Joel Veness

This paper presents a new contextual bandit algorithm, NeuralBandit, which does not need hypothesis on stationarity of contexts and rewards. Several neural networks are trained to modelize the value of rewards knowing the context. Two…

神经与进化计算 · 计算机科学 2014-09-30 Robin Allesiardo , Raphael Feraud , Djallel Bouneffouf

The stochastic contextual bandit problem, which models the trade-off between exploration and exploitation, has many real applications, including recommender systems, online advertising and clinical trials. As many other machine learning…

机器学习 · 统计学 2022-06-14 Qin Ding , Yue Kang , Yi-Wei Liu , Thomas C. M. Lee , Cho-Jui Hsieh , James Sharpnack

We study contextual bandits with nonlinear and path-dependent rewards through a novel signature-transform-based approach. Leveraging the universal nonlinearity property of signatures, we approximate continuous path-dependent reward…

机器学习 · 计算机科学 2026-05-12 Xin Guo , Grace He , Xinyu Li

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

机器学习 · 计算机科学 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

We study the problem of estimating the expected reward of the optimal policy in the stochastic disjoint linear bandit setting. We prove that for certain settings it is possible to obtain an accurate estimate of the optimal policy value even…

机器学习 · 计算机科学 2019-12-17 Weihao Kong , Gregory Valiant , Emma Brunskill

In today's technology environment, information is abundant, dynamic, and heterogeneous in nature. Automated filtering and prioritization of information is based on the distinction between whether the information adds substantial value…

机器学习 · 计算机科学 2022-02-01 Jade Freeman , Michael Rawson

In critical care settings, timely and accurate predictions can significantly impact patient outcomes, especially for conditions like sepsis, where early intervention is crucial. We aim to model patient-specific reward functions in a…

机器学习 · 计算机科学 2025-03-24 Anni Zhou , Raheem Beyah , Rishikesan Kamaleswaran

In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits…

机器学习 · 计算机科学 2024-04-09 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

We study contextual bandits in the stochastic i.i.d.\ setting, where a learner observes contexts drawn from an unknown distribution, selects actions from a finite set $A$, and aims to identify an approximately optimal policy from a given…

机器学习 · 计算机科学 2026-05-29 Liad Erez , Fan Chen , Alon Cohen , Tomer Koren , Yishay Mansour , Shay Moran , Alexander Rakhlin