中文
相关论文

相关论文: Top-K Ranking Deep Contextual Bandits for Informat…

200 篇论文

In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While…

机器学习 · 计算机科学 2020-10-08 Dylan J. Foster , Alexander Rakhlin , David Simchi-Levi , Yunzong Xu

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric recommendations has…

信息检索 · 计算机科学 2023-12-22 Yikun Ban , Yunzhe Qi , Jingrui He

We consider the problem of learning to choose actions using contextual information when provided with limited feedback in the form of relative pairwise comparisons. We study this problem in the dueling-bandits framework of Yue et al.…

机器学习 · 计算机科学 2015-06-16 Miroslav Dudík , Katja Hofmann , Robert E. Schapire , Aleksandrs Slivkins , Masrour Zoghi

Contextual bandit algorithms provide principled online learning solutions to balance the exploitation-exploration trade-off in various applications such as recommender systems. However, the learning speed of the traditional contextual…

机器学习 · 计算机科学 2020-01-28 Xiaoying Zhang , Hong Xie , Hang Li , John C. S. Lui

An individual's decisions are often guided by those of his or her peers, i.e., neighbors in a social network. Presumably, being privy to the experiences of others aids in learning and decision making, but how much advantage does an…

机器学习 · 计算机科学 2017-04-17 L. Elisa Celis , Farnood Salehi

The multi-armed bandit problem is a core framework for sequential decision-making under uncertainty, but classical algorithms often fail in environments with hidden, time-varying states that confound reward estimation and optimal action…

机器学习 · 计算机科学 2026-02-19 Jikai Jin , Kenneth Hung , Sanath Kumar Krishnamurthy , Baoyi Shi , Congshan Zhang

While contextual bandit has a mature theory, effectively leveraging different feedback patterns to enhance the pace of learning remains unclear. Bandits with feedback graphs, which interpolates between the full information and bandit…

机器学习 · 计算机科学 2023-10-30 Mengxiao Zhang , Yuheng Zhang , Olga Vrousgou , Haipeng Luo , Paul Mineiro

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

机器学习 · 计算机科学 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

Contextual bandit learning is increasingly favored in modern large-scale recommendation systems. To better utlize the contextual information and available user or item features, the integration of neural networks have been introduced to…

机器学习 · 计算机科学 2024-06-05 Hongbo Guo , Zheqing Zhu

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

Recommendation systems when employed in markets play a dual role: they assist users in selecting their most desired items from a large pool and they help in allocating a limited number of items to the users who desire them the most. Despite…

机器学习 · 计算机科学 2022-08-01 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran

Contextual multi-armed bandit (MAB) achieves cutting-edge performance on a variety of problems. When it comes to real-world scenarios such as recommendation system and online advertising, however, it is essential to consider the resource…

机器学习 · 计算机科学 2020-04-07 Mengyue Yang , Qingyang Li , Zhiwei Qin , Jieping Ye

We study the $K$-armed contextual dueling bandit problem, a sequential decision making setting in which the learner uses contextual information to make two decisions, but only observes \emph{preference-based feedback} suggesting that one…

机器学习 · 计算机科学 2021-11-25 Aadirupa Saha , Akshay Krishnamurthy

Learning to rank is a key component of many e-commerce search engines. In learning to rank, one is interested in optimising the global ordering of a list of items according to their utility for users.Popular approaches learn a scoring…

We study here the problem of learning the exploration exploitation trade-off in the contextual bandit problem with linear reward function setting. In the traditional algorithms that solve the contextual bandit problem, the exploration is a…

机器学习 · 计算机科学 2020-05-06 Djallel Bouneffouf , Emmanuelle Claeys

In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information,…

机器学习 · 计算机科学 2023-11-01 Reda Alami , Mohammed Mahfoud , Mastane Achab

Contextual bandits are incredibly useful in many practical problems. We go one step further by devising a more realistic problem that combines: (1) contextual bandits with dense arm features, (2) non-linear reward functions, and (3) a…

机器学习 · 计算机科学 2026-03-18 Wei Min Loh , Sajib Kumer Sinha , Ankur Agarwal , Pascal Poupart

Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This bias becomes particularly problematic over time as a few items are repeatedly…

信息检索 · 计算机科学 2024-08-09 Masoud Mansoury , Bamshad Mobasher , Herke van Hoof

Contextual multi-armed bandits are classical models in reinforcement learning for sequential decision-making associated with individual information. A widely-used policy for bandits is Thompson Sampling, where samples from a data-driven…

机器学习 · 统计学 2021-11-30 Hongju Park , Mohamad Kazem Shirani Faradonbeh

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

计算机科学与博弈论 · 计算机科学 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins