中文
相关论文

相关论文: Relational Boosted Bandits

200 篇论文

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

机器学习 · 计算机科学 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

We consider contextual linear bandits over networks, a class of sequential decision-making problems where learning occurs simultaneously across multiple locations and the reward distributions share structural similarities while also…

机器学习 · 计算机科学 2025-08-26 Chuyun Deng , Huiwen Jia

Intelligent agents equipped with causal knowledge can optimize their action spaces to avoid unnecessary exploration. The structural causal bandit framework provides a graphical characterization for identifying actions that are unable to…

机器学习 · 计算机科学 2025-11-25 Min Woo Park , Sanghack Lee

Contextual bandits algorithms aim to choose the optimal arm with the highest reward out of a set of candidates based on the contextual information. Various bandit algorithms have been applied to real-world applications due to their ability…

机器学习 · 计算机科学 2023-08-22 Yunzhe Qi , Yikun Ban , Jingrui He

Contextual bandits (CB) are online sequential decision-making problems under partial feedback that underpin many adaptive services. There is a growing demand to deploy CB agents directly on-device, under strict constraints on memory,…

机器学习 · 计算机科学 2026-05-14 Marco Angioli , Kevin Johansson , Antonello Rosato , Amy Loutfi , Denis Kleyko

Dialog response selection is an important step towards natural response generation in conversational agents. Existing work on neural conversational models mainly focuses on offline supervised learning using a large set of context-response…

计算与语言 · 计算机科学 2017-11-27 Bing Liu , Tong Yu , Ian Lane , Ole J. Mengshoel

Contextual bandits have the same exploration-exploitation trade-off as standard multi-armed bandits. On adding positive externalities that decay with time, this problem becomes much more difficult as wrong decisions at the start are hard to…

机器学习 · 计算机科学 2019-11-15 Harsh Deshpande , Vishal Jain , Sharayu Moharir

Domain name registrars and URL shortener service providers place advertisements on the parked domains (Internet domain names which are not in service) in order to generate profits. As the web contents have been removed, it is critical to…

信息检索 · 计算机科学 2013-07-16 Shuai Yuan , Jun Wang , Maurice van der Meer

Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing…

机器学习 · 计算机科学 2022-02-03 Praneet Dutta , Joe Cheuk , Jonathan S Kim , Massimo Mascaro

A major research direction in contextual bandits is to develop algorithms that are computationally efficient, yet support flexible, general-purpose function approximation. Algorithms based on modeling rewards have shown strong empirical…

机器学习 · 计算机科学 2021-07-14 Dylan J. Foster , Claudio Gentile , Mehryar Mohri , Julian Zimmert

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…

In production systems, contextual bandit approaches often rely on direct reward models that take both action and context as input. However, these models can suffer from confounding, making it difficult to isolate the effect of the action…

机器学习 · 计算机科学 2025-09-16 Alexandre Gilotte , Otmane Sakhi , Imad Aouali , Benjamin Heymann

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

数据结构与算法 · 计算机科学 2014-05-21 Aleksandrs Slivkins

Contextual multinomial logit (MNL) bandits capture many real-world assortment recommendation problems such as online retailing/advertising. However, prior work has only considered (generalized) linear value functions, which greatly limits…

机器学习 · 计算机科学 2024-02-20 Mengxiao Zhang , Haipeng Luo

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

机器学习 · 计算机科学 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

In stochastic contextual bandits, an agent sequentially makes actions from a time-dependent action set based on past experience to minimize the cumulative regret. Like many other machine learning algorithms, the performance of bandits…

机器学习 · 计算机科学 2024-04-09 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

Most existing approaches in Context-Aware Recommender Systems (CRS) focus on recommending relevant items to users taking into account contextual information, such as time, location, or social aspects. However, few of them have considered…

信息检索 · 计算机科学 2014-04-01 Djallel Bouneffouf

Conversational contextual bandits elicit user preferences by occasionally querying for explicit feedback on key-terms to accelerate learning. However, there are aspects of existing approaches which limit their performance. First,…

机器学习 · 计算机科学 2023-10-03 Zhiyong Wang , Xutong Liu , Shuai Li , John C. S. Lui

We study budget-constrained contextual bandits with adversarial contexts, where each action yields a random reward and incurs a random cost. We adopt the standard realizability assumption: conditioned on the observed context, rewards and…

机器学习 · 计算机科学 2026-05-08 Dhruv Sarkar , Abhishek Sinha

With the recent advances of conversational recommendations, the recommender system is able to actively and dynamically elicit user preference via conversational interactions. To achieve this, the system periodically queries users'…

信息检索 · 计算机科学 2022-08-23 Zhihui Xie , Tong Yu , Canzhe Zhao , Shuai Li