中文
相关论文

相关论文: IBCB: Efficient Inverse Batched Contextual Bandit …

200 篇论文

Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This bias becomes particularly problematic over time as a few items are repeatedly…

信息检索 · 计算机科学 2024-08-09 Masoud Mansoury , Bamshad Mobasher , Herke van Hoof

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

机器学习 · 计算机科学 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

We present an adaptive learning Intelligent Tutoring System, which uses model-based reinforcement learning in the form of contextual bandits to assign learning activities to students. The model is trained on the trajectories of thousands of…

计算与语言 · 计算机科学 2022-07-29 Robert Belfer , Ekaterina Kochmar , Iulian Vlad Serban

Bandit algorithms sequentially accumulate data using adaptive sampling policies, offering flexibility for real-world applications. However, excessive sampling can be costly, motivating the devolopment of early stopping methods and reliable…

统计理论 · 数学 2025-02-06 Zihan Cui

We consider the problem of contextual multi-armed bandits in the setting of hypothesis transfer learning. That is, we assume having access to a previously learned model on an unobserved set of contexts, and we leverage it in order to…

机器学习 · 计算机科学 2022-11-15 Steven Bilaj , Sofien Dhouib , Setareh Maghsudi

We introduce a new and completely online contextual bandit algorithm called Gated Linear Contextual Bandits (GLCB). This algorithm is based on Gated Linear Networks (GLNs), a recently introduced deep learning architecture with properties…

机器学习 · 计算机科学 2020-11-23 Eren Sezener , Marcus Hutter , David Budden , Jianan Wang , Joel Veness

Learning for animals or humans is the process that leads to behaviors better adapted to the environment. This process highly depends on the individual that learns and is usually observed only through the individual's actions. This article…

Bottleneck identification is a challenging task in network analysis, especially when the network is not fully specified. To address this task, we develop a unified online learning framework based on combinatorial semi-bandits that performs…

机器学习 · 计算机科学 2023-03-07 Fazeleh Hoseini , Niklas Åkerblom , Morteza Haghir Chehreghani

In stochastic contextual bandit (SCB) problems, an agent selects an action based on certain observed context to maximize the cumulative reward over iterations. Recently there have been a few studies using a deep neural network (DNN) to…

机器学习 · 计算机科学 2021-04-23 Tan Zhu , Guannan Liang , Chunjiang Zhu , Haining Li , Jinbo Bi

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

计量经济学 · 经济学 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

We propose a new sequential decision-making setting, combining key aspects of two established online learning problems with bandit feedback. The optimal action to play at any given moment is contingent on an underlying changing state which…

机器学习 · 计算机科学 2023-11-07 Alexander Galozy , Slawomir Nowaczyk , Mattias Ohlsson

We present conservative distributed multi-task learning in stochastic linear contextual bandits with heterogeneous agents. This extends conservative linear bandits to a distributed setting where M agents tackle different but related tasks…

机器学习 · 计算机科学 2025-04-29 Jiabin Lin , Shana Moothedath

We propose an efficient Context-Aware clustering of Bandits (CAB) algorithm, which can capture collaborative effects. CAB can be easily deployed in a real-world recommendation system, where multi-armed bandits have been shown to perform…

机器学习 · 计算机科学 2017-02-28 Shuai Li , Purushottam Kar

We consider the contextual combinatorial bandit setting where in each round, the learning agent, e.g., a recommender system, selects a subset of "arms," e.g., products, and observes rewards for both the individual base arms, which are a…

机器学习 · 计算机科学 2025-04-22 Baran Atalar , Carlee Joe-Wong

Using graph neural networks for large graphs is challenging since there is no clear way of constructing mini-batches. To solve this, previous methods have relied on sampling or graph clustering. While these approaches often lead to good…

机器学习 · 计算机科学 2022-12-20 Johannes Gasteiger , Chendi Qian , Stephan Günnemann

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

机器学习 · 计算机科学 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

While classical formulations of multi-armed bandit problems assume that each arm's reward is independent and stationary, real-world applications often involve non-stationary environments and interdependencies between arms. In particular,…

机器学习 · 计算机科学 2025-06-19 Ryoma Sato , Shinji Ito

AI systems that learn through reward feedback about the actions they take are increasingly deployed in domains that have significant impact on our daily life. However, in many cases the online rewards should not be the only guiding…

人工智能 · 计算机科学 2018-09-18 Avinash Balakrishnan , Djallel Bouneffouf , Nicholas Mattei , Francesca Rossi

Personalized recommendations for new users, also known as the cold-start problem, can be formulated as a contextual bandit problem. Existing contextual bandit algorithms generally rely on features alone to capture user variability. Such…

机器学习 · 计算机科学 2016-04-25 Li Zhou , Emma Brunskill

Contextual bandits are a common problem faced by machine learning practitioners in domains as diverse as hypothesis testing to product recommendations. There have been a lot of approaches in exploiting rich data representations for…

计算机视觉与模式识别 · 计算机科学 2020-03-20 Aniket Anand Deshmukh , Abhimanu Kumar , Levi Boyles , Denis Charles , Eren Manavoglu , Urun Dogan