中文
相关论文

相关论文: Neural Risk-sensitive Satisficing in Contextual Ba…

200 篇论文

This study introduces ContextWIN, a novel architecture that extends the Neural Whittle Index Network (NeurWIN) model to address Restless Multi-Armed Bandit (RMAB) problems with a context-aware approach. By integrating a mixture of experts…

机器学习 · 计算机科学 2024-10-15 Zhanqiu Guo , Wayne Wang

We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been widely used in recommendation systems to generate…

机器学习 · 计算机科学 2024-10-30 Parand A. Alamdari , Yanshuai Cao , Kevin H. Wilson

Large language models (LLMs) exhibit diverse response behaviors, costs, and strengths, making it challenging to select the most suitable LLM for a given user query. We study the problem of adaptive multi-LLM selection in an online setting,…

机器学习 · 计算机科学 2025-06-24 Manhin Poon , XiangXiang Dai , Xutong Liu , Fang Kong , John C. S. Lui , Jinhang Zuo

Artificial behavioral agents are often evaluated based on their consistent behaviors and performance to take sequential actions in an environment to maximize some notion of cumulative reward. However, human decision making in real life…

人工智能 · 计算机科学 2021-12-28 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf , Jenna Reinen , Irina Rish

We tackle the problem of online reward maximisation over a large finite set of actions described by their contexts. We focus on the case when the number of actions is too big to sample all of them even once. However we assume that we have…

机器学习 · 计算机科学 2013-09-27 Michal Valko , Nathaniel Korda , Remi Munos , Ilias Flaounas , Nelo Cristianini

The stochastic contextual bandit problem, which models the trade-off between exploration and exploitation, has many real applications, including recommender systems, online advertising and clinical trials. As many other machine learning…

机器学习 · 统计学 2022-06-14 Qin Ding , Yue Kang , Yi-Wei Liu , Thomas C. M. Lee , Cho-Jui Hsieh , James Sharpnack

A large number of online services provide automated recommendations to help users to navigate through a large collection of items. New items (products, videos, songs, advertisements) are suggested on the basis of the user's past history and…

机器学习 · 计算机科学 2013-01-10 Yash Deshpande , Andrea Montanari

In this paper we adapt the nearest neighbour rule to the contextual bandit problem. Our algorithm handles the fully adversarial setting in which no assumptions at all are made about the data-generation process. When combined with a…

机器学习 · 计算机科学 2024-03-11 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis

Conservative Contextual Bandits (CCBs) address safety in sequential decision making by requiring that an agent's policy, along with minimizing regret, also satisfies a safety constraint: the performance is not worse than a baseline policy…

机器学习 · 计算机科学 2024-12-10 Rohan Deb , Mohammad Ghavamzadeh , Arindam Banerjee

Motivated by applications in online bidding and sleeping bandits, we examine the problem of contextual bandits with cross learning, where the learner observes the loss associated with the action across all possible contexts, not just the…

机器学习 · 计算机科学 2025-01-27 Ruiyuan Huang , Zengfeng Huang

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

机器学习 · 统计学 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang

Safety is a desirable property that can immensely increase the applicability of learning algorithms in real-world decision-making problems. It is much easier for a company to deploy an algorithm that is safe, i.e., guaranteed to perform at…

机器学习 · 统计学 2017-03-07 Abbas Kazerouni , Mohammad Ghavamzadeh , Yasin Abbasi-Yadkori , Benjamin Van Roy

A key goal in stochastic contextual linear bandits is to efficiently learn a near-optimal policy. Prior algorithms for this problem learn a policy by strategically sampling actions but naively (passively) sampling contexts from the…

机器学习 · 计算机科学 2026-05-26 Emma Brunskill , Ishani Karmarkar , Zhaoqi Li

In this paper, we propose a novel neural exploration strategy in contextual bandits, EE-Net, distinct from the standard UCB-based and TS-based approaches. Contextual multi-armed bandits have been studied for decades with various…

机器学习 · 计算机科学 2022-05-16 Yikun Ban , Yuchen Yan , Arindam Banerjee , Jingrui He

In this paper, we study utilizing neural networks for the exploitation and exploration of contextual multi-armed bandits. Contextual multi-armed bandits have been studied for decades with various applications. To solve the…

机器学习 · 计算机科学 2026-04-07 Yikun Ban , Yuchen Yan , Arindam Banerjee , Jingrui He

In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits…

机器学习 · 计算机科学 2024-04-09 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

This paper introduces a novel contextual bandit algorithm for personalized pricing under utility fairness constraints in scenarios with uncertain demand, achieving an optimal regret upper bound. Our approach, which incorporates dynamic…

机器学习 · 统计学 2023-11-29 Xi Chen , David Simchi-Levi , Yining Wang

We study a novel variant of the multi-armed bandit problem, where at each time step, the player observes an independently sampled context that determines the arms' mean rewards. However, playing an arm blocks it (across all contexts) for a…

机器学习 · 计算机科学 2020-06-18 Soumya Basu , Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

We consider the problem of contextual kernel bandits with stochastic contexts, where the underlying reward function belongs to a known Reproducing Kernel Hilbert Space (RKHS). We study this problem under the additional constraint of joint…

机器学习 · 统计学 2025-01-14 Nikola Pavlovic , Sudeep Salgia , Qing Zhao

Bandit optimization is a difficult problem, especially if the reward model is high-dimensional. When rewards are modeled by neural networks, sublinear regret has only been shown under strong assumptions, usually when the network is…

机器学习 · 计算机科学 2025-01-14 Mikhail Terekhov