English
Related papers

Related papers: Cluster Based Deep Contextual Reinforcement Learni…

200 papers

Contextual dueling bandit is used to model the bandit problems, where a learner's goal is to find the best arm for a given context using observed noisy human preference feedback over the selected arms for the past contexts. However,…

Machine Learning · Computer Science 2025-04-17 Arun Verma , Zhongxiang Dai , Xiaoqiang Lin , Patrick Jaillet , Bryan Kian Hsiang Low

Interactive recommender systems that enable the interactions between users and the recommender system have attracted increasing research attentions. Previous methods mainly focus on optimizing recommendation accuracy. However, they usually…

Information Retrieval · Computer Science 2019-07-04 Yong Liu , Yingtai Xiao , Qiong Wu , Chunyan Miao , Juyong Zhang

Contextual multi-armed bandits (CMAB) have been widely used for learning to filter and prioritize information according to a user's interest. In this work, we analyze top-K ranking under the CMAB framework where the top-K arms are chosen…

Machine Learning · Computer Science 2022-01-31 Michael Rawson , Jade Freeman

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on…

Information Retrieval · Computer Science 2021-08-11 Praveen Kumar Bodigutla

We consider an online decision making setting known as contextual bandit problem, and propose an approach for improving contextual bandit performance by using an adaptive feature extraction (representation learning) based on online…

Artificial Intelligence · Computer Science 2020-09-15 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Irina Rish

Preference-based feedback is important for many applications where direct evaluation of a reward function is not feasible. A notable recent example arises in reinforcement learning from human feedback on large language models. For many of…

Machine Learning · Computer Science 2023-07-24 Viraj Mehta , Ojash Neopane , Vikramjeet Das , Sen Lin , Jeff Schneider , Willie Neiswanger

Social Reinforcement Learning methods, which model agents in large networks, are useful for fake news mitigation, personalized teaching/healthcare, and viral marketing, but it is challenging to incorporate inter-agent dependencies into the…

Machine Learning · Computer Science 2020-03-25 Mahak Goindani , Jennifer Neville

Contextual multi-armed bandit is a fundamental learning framework for making a sequence of decisions, e.g., advertising recommendations for a sequence of arriving users. Recent works have shown that clustering these users based on the…

Machine Learning · Computer Science 2025-10-28 Jingyuan Liu , Zeyu Zhang , Xuchuang Wang , Xutong Liu , John C. S. Lui , Mohammad Hajiesmaili , Carlee Joe-Wong

Given a network, allocating resources at clusters level, rather than at each node, enhances efficiency in resource allocation and usage. In this paper, we study the problem of finding fully connected disjoint clusters to minimize the…

Machine Learning · Computer Science 2024-02-16 Benedikt Schesch , Marco Caserta

The combination of multiple-input multiple-output (MIMO) systems and intelligent reflecting surfaces (IRSs) is foreseen as a critical enabler of beyond 5G (B5G) and 6G. In this work, two different approaches are considered for the joint…

Information Theory · Computer Science 2024-01-31 Dariel Pereira-Ruisánchez , Óscar Fresnedo , Darian Pérez-Adán , Luis Castedo

We consider the contextual combinatorial bandit setting where in each round, the learning agent, e.g., a recommender system, selects a subset of "arms," e.g., products, and observes rewards for both the individual base arms, which are a…

Machine Learning · Computer Science 2025-04-22 Baran Atalar , Carlee Joe-Wong

Unlike traditional recommendation tasks, finite user time budgets introduce a critical resource constraint, requiring the recommender system to balance item relevance and evaluation cost. For example, in a mobile shopping interface, users…

Machine Learning · Computer Science 2026-04-15 Sayak Chakrabarty , Souradip Pal

With the development of deep learning techniques, supervised learning has achieved performances surpassing those of humans. Researchers have designed numerous corresponding models for different data modalities, achieving excellent results…

Artificial Intelligence · Computer Science 2023-08-29 Qiang Li , Qiuyang Ma , Weizhi Nie , Anan Liu

Collaborative bandit learning, i.e., bandit algorithms that utilize collaborative filtering techniques to improve sample efficiency in online interactive recommendation, has attracted much research attention as it enjoys the best of both…

Machine Learning · Computer Science 2021-04-16 Chuanhao Li , Qingyun Wu , Hongning Wang

Recommender Systems have been the cornerstone of online retailers. Traditionally they were based on rules, relevance scores, ranking algorithms, and supervised learning algorithms, but now it is feasible to use reinforcement learning…

Information Retrieval · Computer Science 2021-10-08 Lucas Farris

Performance metrics-driven context caching has a profound impact on throughput and response time in distributed context management systems for real-time context queries. This paper proposes a reinforcement learning based approach to…

Systems and Control · Electrical Eng. & Systems 2023-02-10 Shakthi Weerasinghe , Arkady Zaslavsky , Seng W. Loke , Amin Abken , Alireza Hassani

We study identifying user clusters in contextual multi-armed bandits (MAB). Contextual MAB is an effective tool for many real applications, such as content recommendation and online advertisement. In practice, user dependency plays an…

Machine Learning · Computer Science 2023-03-27 Yikun Ban , Jingrui He

Temporal point process is an expressive tool for modeling event sequences over time. In this paper, we take a reinforcement learning view whereby the observed sequences are assumed to be generated from a mixture of latent policies. The…

Machine Learning · Computer Science 2019-07-01 Weichang Wu , Junchi Yan , Xiaokang Yang , Hongyuan Zha

Recommender systems trained in a continuous learning fashion are plagued by the feedback loop problem, also known as algorithmic bias. This causes a newly trained model to act greedily and favor items that have already been engaged by…

Machine Learning · Computer Science 2020-08-04 Dalin Guo , Sofia Ira Ktena , Ferenc Huszar , Pranay Kumar Myana , Wenzhe Shi , Alykhan Tejani

We consider a novel variant of the contextual bandit problem (i.e., the multi-armed bandit with side-information, or context, available to a decision-maker) where the reward associated with each context-based decision may not always be…

Machine Learning · Computer Science 2020-07-21 Djallel Bouneffouf , Sohini Upadhyay , Yasaman Khazaeni