English
Related papers

Related papers: Learning User Preferences in Non-Stationary Enviro…

200 papers

We study the problem of online learning in two-sided non-stationary matching markets, where the objective is to converge to a stable match. In particular, we consider the setting where one side of the market, the arms, has fixed known set…

Machine Learning · Computer Science 2023-01-16 Deepan Muthirayan , Chinmay Maheshwari , Pramod P. Khargonekar , Shankar Sastry

Random walks have been successfully used to measure user or object similarities in collaborative filtering (CF) recommender systems, which is of high accuracy but low diversity. A key challenge of CF system is that the reliably accurate…

Data Analysis, Statistics and Probability · Physics 2012-01-31 Jian-Guo Liu , Kerui Shi , Qiang Guo

An effective online recommendation system should jointly capture users' long-term and short-term preferences in both users' internal behaviors (from the target recommendation task) and external behaviors (from other tasks). However, it is…

Information Retrieval · Computer Science 2021-11-29 Ruobing Xie , Yalong Wang , Rui Wang , Yuanfu Lu , Yuanhang Zou , Feng Xia , Leyu Lin

In modern fashion e-commerce platforms, where customers can browse thousands to millions of products, recommender systems are useful tools to navigate and narrow down the vast assortment. In this scenario, complementary recommendations…

Information Retrieval · Computer Science 2019-08-23 Jui-Chieh Wu , José Antonio Sánchez Rodríguez , Humberto Jesús Corona Pampín

We investigate an efficient context-dependent clustering technique for recommender systems based on exploration-exploitation strategies through multi-armed bandits over multiple users. Our algorithm dynamically groups users based on their…

Machine Learning · Statistics 2016-05-03 Shuai Li , Claudio Gentile , Alexandros Karatzoglou

Large Language Models (LLMs) have demonstrated exceptional capabilities in generalizing to new tasks in a zero-shot or few-shot manner. However, the extent to which LLMs can comprehend user preferences based on their previous behavior…

Information Retrieval · Computer Science 2023-05-12 Wang-Cheng Kang , Jianmo Ni , Nikhil Mehta , Maheswaran Sathiamoorthy , Lichan Hong , Ed Chi , Derek Zhiyuan Cheng

Generative models have shown great promise in collaborative filtering by capturing the underlying distribution of user interests and preferences. However, existing approaches struggle with inaccurate posterior approximations and…

Information Retrieval · Computer Science 2025-09-08 Chengkai Liu , Yangtian Zhang , Jianling Wang , Rex Ying , James Caverlee

We consider a non stationary multi-armed bandit in which the population preferences are positively and negatively reinforced by the observed rewards. The objective of the algorithm is to shape the population preferences to maximize the…

Machine Learning · Computer Science 2024-03-04 Viraj Nadkarni , D. Manjunath , Sharayu Moharir

In many online platforms, customers' decisions are substantially influenced by product rankings as most customers only examine a few top-ranked products. Concurrently, such platforms also use the same data corresponding to customers'…

Machine Learning · Computer Science 2020-09-14 Negin Golrezaei , Vahideh Manshadi , Jon Schneider , Shreyas Sekar

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

For a real-world decision-making problem, the reward function often needs to be engineered or learned. A popular approach is to utilize human feedback to learn a reward function for training. The most straightforward way to do so is to ask…

Machine Learning · Computer Science 2023-10-31 Xiang Ji , Huazheng Wang , Minshuo Chen , Tuo Zhao , Mengdi Wang

Collaborative filtering (CF), as a fundamental approach for recommender systems, is usually built on the latent factor model with learnable parameters to predict users' preferences towards items. However, designing a proper CF model for a…

Information Retrieval · Computer Science 2021-06-15 Chen Gao , Quanming Yao , Depeng Jin , Yong Li

Recommender systems help users find relevant items of interest, for example on e-commerce or media streaming sites. Most academic research is concerned with approaches that personalize the recommendations according to long-term user…

Information Retrieval · Computer Science 2018-10-31 Malte Ludewig , Dietmar Jannach

Recommender systems aim to fulfill the user's daily demands. While most existing research focuses on maximizing the user's engagement with the system, it has recently been pointed out that how frequently the users come back for the service…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Bin Yang , Zhenghai Xue , Qingpeng Cai , Xiangyu Zhao , Zijian Zhang , Lantao Hu , Han Li , Peng Jiang

Deep learning has shown impressive results in a variety of time series forecasting tasks, where modeling the conditional distribution of the future given the past is the essence. However, when this conditional distribution is…

Machine Learning · Computer Science 2024-02-27 Siqi Liu , Andreas Lehrmann

A recent study has shown that diffusion models are well-suited for modeling the generative process of user-item interactions in recommender systems due to their denoising nature. However, existing diffusion model-based recommender systems…

Information Retrieval · Computer Science 2024-04-23 Yu Hou , Jin-Duk Park , Won-Yong Shin

Recommender systems learn from past user behavior to predict future user preferences. Intuitively, it has been established that the most recent interactions are more indicative of future preferences than older interactions. Many…

Information Retrieval · Computer Science 2025-08-07 Joey De Pauw , Bart Goethals

We study a sequential resource allocation problem where a decision maker selects subsets of agents at each period to maximize overall outcomes without prior knowledge of individual-level effects. Our framework applies to settings such as…

Machine Learning · Computer Science 2025-08-29 Katherine B. Adams , Justin J. Boutilier , Qinyang He , Yonatan Mintz

We study the problem of preserving privacy while still providing high utility in sequential decision making scenarios in a changing environment. We consider abruptly changing environment: the environment remains constant during periods and…

Machine Learning · Computer Science 2023-01-03 Pratik Gajane

Recommender systems are used with the purpose of suggesting contents and resources to the users in a social network. These systems use ranks or tags each user assign to different resources to predict or make suggestions to users. Lately,…

Social and Information Networks · Computer Science 2021-05-05 Hossein Monshizadeh Naeen , Mehrdad Jalali