English
Related papers

Related papers: Counterfactual Multi-player Bandits for Explainabl…

200 papers

Multi-armed bandits (MAB) provide a principled online learning approach to attain the balance between exploration and exploitation. Due to the superior performance and low feedback learning without the learning to act in multiple…

Information Retrieval · Computer Science 2022-10-25 Shenghao Xu

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually…

Information Retrieval · Computer Science 2019-07-04 Yong Liu , Yingtai Xiao , Qiong Wu , Chunyan Miao , Juyong Zhang

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

Machine Learning · Computer Science 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

In online recommendation, customers arrive in a sequential and stochastic manner from an underlying distribution and the online decision model recommends a chosen item for each arriving individual based on some strategy. We study how to…

Machine Learning · Computer Science 2021-09-23 Wen Huang , Lu Zhang , Xintao Wu

In many digital contexts such as online news and e-tailing with many new users and items, recommendation systems face several challenges: i) how to make initial recommendations to users with little or no response history (i.e., cold-start…

Information Retrieval · Computer Science 2023-02-28 Boya Xu , Yiting Deng , Carl Mela

Single-player contextual bandits are a well-studied problem in reinforcement learning that has seen applications in various fields such as advertising, healthcare, and finance. In light of the recent work on \emph{information asymmetric}…

Machine Learning · Computer Science 2025-03-13 William Chang , Yuanhao Lu

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

Machine Learning · Computer Science 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

Counterfactual explanations shed light on the decisions of black-box models by explaining how an input can be altered to obtain a favourable decision from the model (e.g., when a loan application has been rejected). However, as noted…

Machine Learning · Computer Science 2023-12-13 Francesco Leofante , Nico Potyka

The design of personalized incentives or recommendations to improve user engagement is gaining prominence as digital platform providers continually emerge. We propose a multi-armed bandit framework for matching incentives to users, whose…

Machine Learning · Computer Science 2018-07-09 Tanner Fiez , Shreyas Sekar , Liyuan Zheng , Lillian J. Ratliff

We introduce a Multi-User Contextual Cascading Bandit model, a new combinatorial bandit framework that captures realistic online advertising scenarios where multiple users interact with sequentially displayed items simultaneously. Unlike…

Machine Learning · Computer Science 2025-08-26 Jiho Park , Huiwen Jia

Understanding why specific items are recommended to users can significantly increase their trust and satisfaction in the system. While neural recommenders have become the state-of-the-art in recent years, the complexity of deep models still…

Information Retrieval · Computer Science 2021-05-12 Khanh Hiep Tran , Azin Ghazimatin , Rishiraj Saha Roy

This paper presents a concise review of Contextual Multi-Armed Bandit (CMAB) methods and introduces an experimental framework for scalable, interpretable offer selection, addressing the challenge of fast-changing offers. The approach models…

Machine Learning · Computer Science 2025-05-23 Nikola Tankovic , Robert Sajina

With the prevalence of deep learning based embedding approaches, recommender systems have become a proven and indispensable tool in various information filtering applications. However, many of them remain difficult to diagnose what aspects…

Information Retrieval · Computer Science 2021-10-29 Yao Zhou , Haonan Wang , Jingrui He , Haixun Wang

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

Data Structures and Algorithms · Computer Science 2014-05-21 Aleksandrs Slivkins

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

Multi-armed bandits (MAB) and causal MABs (CMAB) are established frameworks for decision-making problems. The majority of prior work typically studies and solves individual MAB and CMAB in isolation for a given problem and associated data.…

Existing risk-aware multi-armed bandit models typically focus on risk measures of individual options such as variance. As a result, they cannot be directly applied to important real-world online decision making problems with correlated…

Machine Learning · Computer Science 2023-05-12 Yihan Du , Siwei Wang , Zhixuan Fang , Longbo Huang

The contextual multi-armed bandit (MAB) problem is crucial in sequential decision-making. A line of research, known as online clustering of bandits, extends contextual MAB by grouping similar users into clusters, utilizing shared features…

Machine Learning · Computer Science 2025-01-03 Zhuohua Li , Maoli Liu , Xiangxiang Dai , John C. S. Lui

Personalized recommender systems suffuse modern life, shaping what media we read and what products we consume. Algorithms powering such systems tend to consist of supervised learning-based heuristics, such as latent factor models with a…

Information Retrieval · Computer Science 2023-04-19 Liu Leqi , Giulio Zhou , Fatma Kılınç-Karzan , Zachary C. Lipton , Alan L. Montgomery

We consider the problem of personalised news recommendation where each user consumes news in a sequential fashion. Existing personalised news recommendation methods focus on exploiting user interests and ignores exploration in…

Information Retrieval · Computer Science 2022-06-30 Mengyan Zhang , Thanh Nguyen-Tang , Fangzhao Wu , Zhenyu He , Xing Xie , Cheng Soon Ong
‹ Prev 1 2 3 10 Next ›