English
Related papers

Related papers: Local Clustering in Contextual Multi-Armed Bandits

200 papers

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

Machine Learning · Computer Science 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

The contextual multi-armed bandit (MAB) problem is crucial in sequential decision-making. A line of research, known as online clustering of bandits, extends contextual MAB by grouping similar users into clusters, utilizing shared features…

Machine Learning · Computer Science 2025-01-03 Zhuohua Li , Maoli Liu , Xiangxiang Dai , John C. S. Lui

We propose an efficient Context-Aware clustering of Bandits (CAB) algorithm, which can capture collaborative effects. CAB can be easily deployed in a real-world recommendation system, where multi-armed bandits have been shown to perform…

Machine Learning · Computer Science 2017-02-28 Shuai Li , Purushottam Kar

We investigate a novel cluster-of-bandit algorithm CAB for collaborative recommendation tasks that implements the underlying feedback sharing mechanism by estimating the neighborhood of users in a context-dependent manner. CAB makes sharp…

Machine Learning · Computer Science 2017-02-28 Claudio Gentile , Shuai Li , Purushottam Kar , Alexandros Karatzoglou , Evans Etrue , Giovanni Zappella

Contextual multi-armed bandit (MAB) is an important sequential decision-making problem in recommendation systems. A line of works, called the clustering of bandits (CLUB), utilize the collaborative effect over users and dramatically improve…

Machine Learning · Computer Science 2022-09-01 Xutong Liu , Haoru Zhao , Tong Yu , Shuai Li , John C. S. Lui

The contextual bandit has been identified as a powerful framework to formulate the recommendation process as a sequential decision-making process, where each item is regarded as an arm and the objective is to minimize the regret of $T$…

Machine Learning · Computer Science 2024-09-30 Yikun Ban , Yunzhe Qi , Tianxin Wei , Lihui Liu , Jingrui He

The contextual linear bandit is an important online learning problem where given arm features, a learning agent selects an arm at each round to maximize the cumulative rewards in the long run. A line of works, called the clustering of…

Machine Learning · Computer Science 2023-10-11 Zhiyong Wang , Jize Xie , Xutong Liu , Shuai Li , John C. S. Lui

We investigate an efficient context-dependent clustering technique for recommender systems based on exploration-exploitation strategies through multi-armed bandits over multiple users. Our algorithm dynamically groups users based on their…

Machine Learning · Statistics 2016-05-03 Shuai Li , Claudio Gentile , Alexandros Karatzoglou

Contextual multi-armed bandit is a fundamental learning framework for making a sequence of decisions, e.g., advertising recommendations for a sequence of arriving users. Recent works have shown that clustering these users based on the…

Machine Learning · Computer Science 2025-10-28 Jingyuan Liu , Zeyu Zhang , Xuchuang Wang , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili , Carlee Joe-Wong

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

Data Structures and Algorithms · Computer Science 2014-05-21 Aleksandrs Slivkins

Classical collaborative filtering, and content-based filtering methods try to learn a static recommendation model given training data. These approaches are far from ideal in highly dynamic recommendation domains such as news recommendation…

Machine Learning · Computer Science 2016-06-01 Shuai Li , Alexandros Karatzoglou , Claudio Gentile

In this work, we study recommendation systems modelled as contextual multi-armed bandit (MAB) problems. We propose a graph-based recommendation system that learns and exploits the geometry of the user space to create meaningful clusters in…

Information Retrieval · Computer Science 2018-08-02 Kaige Yang , Laura Toni

We consider a multi-armed bandit setting that is inspired by real-world applications in e-commerce. In our setting, there are a few types of users, each with a specific response to the different arms. When a user enters the system, his type…

Machine Learning · Computer Science 2015-03-20 Loc Bui , Ramesh Johari , Shie Mannor

Personalized recommendation based on multi-arm bandit (MAB) algorithms has shown to lead to high utility and efficiency as it can dynamically adapt the recommendation strategy based on feedback. However, unfairness could incur in…

Machine Learning · Computer Science 2020-10-26 Wen Huang , Kevin Labille , Xintao Wu , Dongwon Lee , Neil Heffernan

Contextual multi-armed bandits (CMAB) have been widely used for learning to filter and prioritize information according to a user's interest. In this work, we analyze top-K ranking under the CMAB framework where the top-K arms are chosen…

Machine Learning · Computer Science 2022-01-31 Michael Rawson , Jade Freeman

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

Contextual bandit algorithms are commonly used in recommender systems, where content popularity can change rapidly. These algorithms continuously learn latent mappings between users and items, based on contexts associated with them both.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-17 Kanak Mahadik , Qingyun Wu , Shuai Li , Amit Sabne

Virtual support agents have grown in popularity as a way for businesses to provide better and more accessible customer service. Some challenges in this domain include ambiguous user queries as well as changing support topics and user…

Machine Learning · Computer Science 2021-12-07 Sandra Sajeev , Jade Huang , Nikos Karampatziakis , Matthew Hall , Sebastian Kochman , Weizhu Chen

We introduce a Multi-User Contextual Cascading Bandit model, a new combinatorial bandit framework that captures realistic online advertising scenarios where multiple users interact with sequentially displayed items simultaneously. Unlike…

Machine Learning · Computer Science 2025-08-26 Jiho Park , Huiwen Jia

Most existing approaches in Context-Aware Recommender Systems (CRS) focus on recommending relevant items to users taking into account contextual information, such as time, location, or social aspects. However, few of them have considered…

Information Retrieval · Computer Science 2014-04-01 Djallel Bouneffouf
‹ Prev 1 2 3 10 Next ›