English
Related papers

Related papers: Exposure-Aware Recommendation using Contextual Ban…

200 papers

Cascading bandits have gained popularity in recent years due to their applicability to recommendation systems and online advertising. In the cascading bandit model, at each timestep, an agent recommends an ordered subset of items (called an…

Machine Learning · Computer Science 2024-04-09 Yihan Du , R. Srikant , Wei Chen

Recommender systems are a ubiquitous feature of online platforms. Increasingly, they are explicitly tasked with increasing users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a…

Machine Learning · Computer Science 2023-07-21 Thomas M. McDonald , Lucas Maystre , Mounia Lalmas , Daniel Russo , Kamil Ciosek

Contextual bandit algorithms are at the core of many applications, including recommender systems, clinical trials, and optimal portfolio selection. One of the most popular problems studied in the contextual bandit literature is to maximize…

Machine Learning · Computer Science 2023-10-24 Siddhant Chaudhary , Abhishek Sinha

Contextual bandit algorithms are extremely popular and widely used in recommendation systems to provide online personalised recommendations. A recurrent assumption is the stationarity of the reward function, which is rather unrealistic in…

Machine Learning · Statistics 2020-04-29 Giuseppe Di Benedetto , Vito Bellini , Giovanni Zappella

Recommender systems relying on contextual multi-armed bandits continuously improve relevant item recommendations by taking into account the contextual information. The objective of bandit algorithms is to learn the best arm (e.g., best item…

Machine Learning · Computer Science 2025-12-10 Ahmed Sayeed Faruk , Elena Zheleva

Contextual Bandits find important use cases in various real-life scenarios such as online advertising, recommendation systems, healthcare, etc. However, most of the algorithms use flat feature vectors to represent context whereas, in the…

Machine Learning · Computer Science 2021-06-29 Kaushik Roy , Qi Zhang , Manas Gaur , Amit Sheth

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

Machine Learning · Computer Science 2016-01-26 Daniel Barsky , Koby Crammer

Recommender system usually faces popularity bias issues: from the data perspective, items exhibit uneven (long-tail) distribution on the interaction frequency; from the method perspective, collaborative filtering methods are prone to…

Information Retrieval · Computer Science 2021-05-14 Yang Zhang , Fuli Feng , Xiangnan He , Tianxin Wei , Chonggang Song , Guohui Ling , Yongdong Zhang

We introduce a Multi-User Contextual Cascading Bandit model, a new combinatorial bandit framework that captures realistic online advertising scenarios where multiple users interact with sequentially displayed items simultaneously. Unlike…

Machine Learning · Computer Science 2025-08-26 Jiho Park , Huiwen Jia

Recommendation systems are a key modern application of machine learning, but they have the downside that they often draw upon sensitive user information in making their predictions. We show how to address this deficiency by basing a…

Machine Learning · Computer Science 2021-12-03 Naveen Durvasula , Franklyn Wang , Scott Duke Kominers

Contextual bandits serve as a fundamental algorithmic framework for optimizing recommendation decisions online. Though extensive attention has been paid to tailoring contextual bandits for recommendation applications, the "herding effects"…

Machine Learning · Computer Science 2024-08-29 Luyue Xu , Liming Wang , Hong Xie , Mingqiang Zhou

We propose a contextual bandit based model to capture the learning and social welfare goals of a web platform in the presence of myopic users. By using payments to incentivize these agents to explore different items/recommendations, we show…

Machine Learning · Computer Science 2020-01-23 Priyank Agrawal , Theja Tulabandhula

Often, recommendation systems employ continuous training, leading to a self-feedback loop bias in which the system becomes biased toward its previous recommendations. Recent studies have attempted to mitigate this bias by collecting small…

Machine Learning · Computer Science 2023-10-10 S. M. F. Sani , Seyed Abbas Hosseini , Hamid R. Rabiee

Psychological research shows that enjoyment of many goods is subject to satiation, with short-term satisfaction declining after repeated exposures to the same item. Nevertheless, proposed algorithms for powering recommender systems seldom…

Machine Learning · Computer Science 2021-10-28 Liu Leqi , Fatma Kilinc-Karzan , Zachary C. Lipton , Alan L. Montgomery

Related Item Recommendations (RIRs) are ubiquitous in most online platforms today, including e-commerce and content streaming sites. These recommendations not only help users compare items related to a given item, but also play a major role…

Information Retrieval · Computer Science 2022-04-04 Abhisek Dash , Abhijnan Chakraborty , Saptarshi Ghosh , Animesh Mukherjee , Krishna P. Gummadi

Mobile Context-Aware Recommender Systems can be naturally modelled as an exploration/exploitation trade-off (exr/exp) problem, where the system has to choose between maximizing its expected rewards dealing with its current knowledge…

Information Retrieval · Computer Science 2014-08-12 Djallel Bouneffouf

We address the cold start problem in recommendation systems assuming no contextual information is available neither about users, nor items. We consider the case in which we only have access to a set of ratings of items by users. Most of the…

Machine Learning · Computer Science 2014-07-11 Jérémie Mary , Romaric Gaudel , Preux Philippe

In digital health and EdTech, recommendation systems face a significant challenge: users often choose impulsively, in ways that conflict with the platform's long-term payoffs. This misalignment makes it difficult to effectively learn to…

Machine Learning · Computer Science 2024-02-22 Arpit Agarwal , Rad Niazadeh , Prathamesh Patil

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric recommendations has…

Information Retrieval · Computer Science 2023-12-22 Yikun Ban , Yunzhe Qi , Jingrui He