English
Related papers

Related papers: Improving Sequential Query Recommendation with Imm…

200 papers

Large language models (LLMs) have emerged as a cutting-edge approach in sequential recommendation, leveraging historical interactions to model dynamic user preferences. Current methods mainly focus on learning processed recommendation data…

Information Retrieval · Computer Science 2025-07-15 Weicong Qin , Yi Xu , Weijie Yu , Chenglei Shen , Xiao Zhang , Ming He , Jianping Fan , Jun Xu

We study a novel variant of the parameterized bandits problem in which the learner can observe additional auxiliary feedback that is correlated with the observed reward. The auxiliary feedback is readily available in many real-life…

Machine Learning · Computer Science 2023-11-07 Arun Verma , Zhongxiang Dai , Yao Shu , Bryan Kian Hsiang Low

Sequential recommender models are essential components of modern industrial recommender systems. These models learn to predict the next items a user is likely to interact with based on his/her interaction history on the platform. Most…

Information Retrieval · Computer Science 2023-03-28 Bo Chang , Alexandros Karatzoglou , Yuyan Wang , Can Xu , Ed H. Chi , Minmin Chen

We propose and design recommendation systems that incentivize efficient exploration. Agents arrive sequentially, choose actions and receive rewards, drawn from fixed but unknown action-specific distributions. The recommendation system…

Computer Science and Game Theory · Computer Science 2026-04-02 Nicole Immorlica , Jieming Mao , Aleksandrs Slivkins , Zhiwei Steven Wu

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user…

Machine Learning · Statistics 2022-08-23 Gi-Soo Kim , Hyun-Joon Yang , Jane P. Kim

Recommender systems relying on contextual multi-armed bandits continuously improve relevant item recommendations by taking into account the contextual information. The objective of bandit algorithms is to learn the best arm (e.g., best item…

Machine Learning · Computer Science 2025-12-10 Ahmed Sayeed Faruk , Elena Zheleva

We address the problem of online sequential decision making, i.e., balancing the trade-off between exploiting the current knowledge to maximize immediate performance and exploring the new information to gain long-term benefits using the…

Machine Learning · Computer Science 2022-09-20 Kartik Anand Pant , Amod Hegde , K. V. Srinivas

Previous efforts in recommendation of candidates for talent search followed the general pattern of receiving an initial search criteria and generating a set of candidates utilizing a pre-trained model. Traditionally, the generated…

Artificial Intelligence · Computer Science 2018-09-19 Sahin Cem Geyik , Vijay Dialani , Meng Meng , Ryan Smith

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by applications in clinical trials and recommendation systems, we assume that two arms are connected if and only if they are similar (i.e.,…

Machine Learning · Computer Science 2025-09-18 Han Qi , Fei Guo , Li Zhu , Qiaosheng Zhang

There are two variants of the classical multi-armed bandit (MAB) problem that have received considerable attention from machine learning researchers in recent years: contextual bandits and simple regret minimization. Contextual bandits are…

Machine Learning · Statistics 2020-02-27 Aniket Anand Deshmukh , Srinagesh Sharma , James W. Cutler , Mark Moldwin , Clayton Scott

With the rapid development of recommender systems, there is increasing side information that can be employed to improve the recommendation performance. Specially, we focus on the utilization of the associated \emph{textual data} of items…

Information Retrieval · Computer Science 2024-02-29 Lanling Xu , Zhen Tian , Bingqian Li , Junjie Zhang , Jinpeng Wang , Mingchen Cai , Wayne Xin Zhao

Sequential recommendation aims to identify and recommend the next few items for a user that the user is most likely to purchase/review, given the user's purchase/rating trajectories. It becomes an effective tool to help users select…

Information Retrieval · Computer Science 2021-01-05 Bo Peng , Zhiyun Ren , Srinivasan Parthasarathy , Xia Ning

Motivated by the challenges of edge inference, we study a variant of the cascade bandit model in which each arm corresponds to an inference model with an associated accuracy and error probability. We analyse four decision-making…

Machine Learning · Computer Science 2026-03-30 R Sri Prakash , Nikhil Karamchandani , Sharayu Moharir

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

Machine Learning · Computer Science 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

Recommender systems must balance personalization, diversity, and robustness to cold-start scenarios to remain effective in dynamic content environments. This paper introduces an adaptive, exploration-based recommendation framework that…

Information Retrieval · Computer Science 2025-03-26 Edoardo Bianchi

Restless multi-armed bandits (RMAB) has been widely used to model constrained sequential decision making problems, where the state of each restless arm evolves according to a Markov chain and each state transition generates a scalar reward.…

Machine Learning · Computer Science 2025-07-18 Guojun Xiong , Ujwal Dinesha , Debajoy Mukherjee , Jian Li , Srinivas Shakkottai

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

Machine Learning · Computer Science 2016-01-26 Daniel Barsky , Koby Crammer

Sequential decision-making is central to sustainable agricultural management and precision agriculture, where resource inputs must be optimized under uncertainty and over time. However, such decisions must often be made with limited…

Machine Learning · Statistics 2026-02-24 Sakshi Arya , Wentao Lin

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

A core element in decision-making under uncertainty is the feedback on the quality of the performed actions. However, in many applications, such feedback is restricted. For example, in recommendation systems, repeatedly asking the user to…

Machine Learning · Computer Science 2021-07-13 Yonathan Efroni , Nadav Merlis , Aadirupa Saha , Shie Mannor
‹ Prev 1 8 9 10 Next ›