English
Related papers

Related papers: Calibrated Recommendations with Contextual Bandits

200 papers

The recent advances of conversational recommendations provide a promising way to efficiently elicit users' preferences via conversational interactions. To achieve this, the recommender system conducts conversations with users, asking their…

Information Retrieval · Computer Science 2022-09-14 Jinhang Zuo , Songwen Hu , Tong Yu , Shuai Li , Handong Zhao , Carlee Joe-Wong

A large number of statistical decision problems in the social sciences and beyond can be framed as a (contextual) multi-armed bandit problem. However, it is notoriously hard to develop and evaluate policies that tackle these types of…

Human-Computer Interaction · Computer Science 2018-09-05 Jules Kruijswijk , Robin van Emden , Petri Parvinen , Maurits Kaptein

The contextual bandit problem is a theoretically justified framework with wide applications in various fields. While the previous study on this problem usually requires independence between noise and contexts, our work considers a more…

Machine Learning · Computer Science 2022-09-08 Xueping Gong , Jiheng Zhang

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

Machine Learning · Computer Science 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

We design and implement an adaptive experiment (a ``contextual bandit'') to learn a targeted treatment assignment policy, where the goal is to use a participant's survey responses to determine which charity to expose them to in a donation…

Generative conversational interfaces powered by large language models (LLMs) typically stream output token-by-token at a rate determined by computational budget, often neglecting actual human reading speeds and the cognitive load associated…

Human-Computer Interaction · Computer Science 2025-07-25 Chang Xiao , Brenda Yang

We propose a contextual-bandit approach for demand side management by offering price incentives. More precisely, a target mean consumption is set at each round and the mean consumption is modeled as a complex function of the distribution of…

Machine Learning · Computer Science 2019-05-14 Margaux Brégère , Pierre Gaillard , Yannig Goude , Gilles Stoltz

News consumption behavior is shaped by the coupling between temporal dynamics and content selection. This study proposes a multi-scale temporal-content framework and validates it on two large real-world news datasets, MIND and Adressa.…

Social and Information Networks · Computer Science 2026-05-01 Jipeng Tan , Mengye Yang , Zhanghao Li , Yong Min

Delivering treatment recommendations via pervasive electronic devices such as mobile phones has the potential to be a viable and scalable treatment medium for long-term health behavior management. But active experimentation of treatment…

Information Retrieval · Computer Science 2020-08-24 Mawulolo K. Ameko , Miranda L. Beltzer , Lihua Cai , Mehdi Boukhechba , Bethany A. Teachman , Laura E. Barnes

In this paper, we address the stochastic contextual linear bandit problem, where a decision maker is provided a context (a random set of actions drawn from a distribution). The expected reward of each action is specified by the inner…

Machine Learning · Statistics 2023-05-30 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Contextual bandits with linear payoffs, which are also known as linear bandits, provide a powerful alternative for solving practical problems of sequential decisions, e.g., online advertisements. In the era of big data, contextual data…

Machine Learning · Computer Science 2019-03-21 Xiaotian Yu

State-of-the-art music recommendation systems are based on collaborative filtering, which predicts a user's interest from his listening habits and similarities with other users' profiles. These approaches are agnostic to the song content,…

Information Retrieval · Computer Science 2021-02-10 Paul Magron , Cédric Févotte

Contextual bandits serve as a fundamental model for many sequential decision making tasks. The most popular theoretically justified approaches are based on the optimism principle. While these algorithms can be practical, they are known to…

Machine Learning · Computer Science 2020-03-17 Botao Hao , Tor Lattimore , Csaba Szepesvari

Contextual bandits have become an increasingly popular solution for personalized recommender systems. Despite their growing use, the interpretability of these systems remains a significant challenge, particularly for the often non-expert…

Machine Learning · Computer Science 2024-09-24 Andrew Maher , Matia Gobbo , Lancelot Lachartre , Subash Prabanantham , Rowan Swiers , Puli Liyanagama

In many recommendation applications such as news recommendation, the items that can be rec- ommended come and go at a very fast pace. This is a challenge for recommender systems (RS) to face this setting. Online learning algorithms seem to…

Machine Learning · Statistics 2014-05-15 Olivier Nicol , Jérémie Mary , Philippe Preux

Conversational recommender systems proactively query users with relevant "key terms" and leverage the feedback to elicit users' preferences for personalized recommendations. Conversational contextual bandits, a prevalent approach in this…

Machine Learning · Computer Science 2025-05-28 Maoli Liu , Zhuohua Li , Xiangxiang Dai , John C. S. Lui

We consider the model selection task in the stochastic contextual bandit setting. Suppose we are given a collection of base contextual bandit algorithms. We provide a master algorithm that combines them and achieves the same performance, up…

Machine Learning · Computer Science 2020-06-09 Aurélien F. Bibaut , Antoine Chambaz , Mark J. van der Laan

We study bandit learning in matching markets, where players and arms constitute the two market sides, and the players' utilities are linear in the arm contexts. In each round, new arms arrive with observable contexts. Then, the algorithm…

Machine Learning · Computer Science 2026-05-28 Shiyun Lin , Simon Mauras , Vianney Perchet , Nadav Merlis

Contextual bandit learning is increasingly favored in modern large-scale recommendation systems. To better utlize the contextual information and available user or item features, the integration of neural networks have been introduced to…

Machine Learning · Computer Science 2024-06-05 Hongbo Guo , Zheqing Zhu

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually…

Information Retrieval · Computer Science 2019-07-04 Yong Liu , Yingtai Xiao , Qiong Wu , Chunyan Miao , Juyong Zhang