English
Related papers

Related papers: Learning from a Learning User for Optimal Recommen…

200 papers

We analyze the problem of learning a single user's preferences in an active learning setting, sequentially and adaptively querying the user over a finite time horizon. Learning is conducted via choice-based queries, where the user selects…

Machine Learning · Statistics 2017-02-27 Stephen N. Pallone , Peter I. Frazier , Shane G. Henderson

User queries in e-commerce search are often vague, short, and underspecified, making it difficult for retrieval systems to match them accurately against structured product catalogs. This challenge is amplified by the one-to-many nature of…

Information Retrieval · Computer Science 2025-09-11 Yipeng Zhang , Bowen Liu , Xiaoshuang Zhang , Aritra Mandal , Canran Xu , Zhe Wu

In real-world scenarios, most platforms collect both large-scale, naturally noisy implicit feedback and small-scale yet highly relevant explicit feedback. Due to the issue of data sparsity, implicit feedback is often the default choice for…

Information Retrieval · Computer Science 2023-05-29 Yingqiang Ge , Mostafa Rahmani , Athirai Irissappane , Jose Sepulveda , James Caverlee , Fei Wang

Accounting for the fact that users have different sequential patterns, the main drawback of state-of-the-art recommendation strategies is that a fixed sequence length of user-item interactions is required as input to train the models. This…

Information Retrieval · Computer Science 2021-08-04 Stefanos Antaris , Dimitrios Rafailidis

Recommendation is the task of improving customer experience through personalized recommendation based on users' past feedback. In this paper, we investigate the most common scenario: the user-item (U-I) matrix of implicit feedback. Even…

Machine Learning · Computer Science 2017-07-21 Peng Yang , Peilin Zhao , Xin Gao , Yong Liu

Recommender Systems (RecSys) have become indispensable in numerous applications, profoundly influencing our everyday experiences. Despite their practical significance, academic research in RecSys often abstracts the formulation of research…

Information Retrieval · Computer Science 2024-06-25 Aixin Sun

Today, most large-scale conversational AI agents (e.g. Alexa, Siri, or Google Assistant) are built using manually annotated data to train the different components of the system. Typically, the accuracy of the ML models in these components…

Machine Learning · Computer Science 2019-11-07 Pragaash Ponnusamy , Alireza Roshan Ghias , Chenlei Guo , Ruhi Sarikaya

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik

The amount of content on online music streaming platforms is immense, and most users only access a tiny fraction of this content. Recommender systems are the application of choice to open up the collection to these users. Collaborative…

Information Retrieval · Computer Science 2017-08-23 Cedric De Boom , Rohan Agrawal , Samantha Hansen , Esh Kumar , Romain Yon , Ching-Wei Chen , Thomas Demeester , Bart Dhoedt

Recommendation algorithms are known to suffer from popularity bias; a few popular items are recommended frequently while the majority of other items are ignored. These recommendations are then consumed by the users, their reaction will be…

Information Retrieval · Computer Science 2020-07-28 Masoud Mansoury , Himan Abdollahpouri , Mykola Pechenizkiy , Bamshad Mobasher , Robin Burke

This paper is concerned with the robust tracking control of linear uncertain systems, whose unknown system parameters and disturbances are bounded within ellipsoidal sets. We propose an adaptive robust control that can actively learn the…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Xuehui Ma , Shiliang Zhang , Yushuai Li , Fucai Qian , Tingwen Huang

Most recommender systems recommend a list of items. The user examines the list, from the first item to the last, and often chooses the first attractive item and does not examine the rest. This type of user behavior can be modeled by the…

Machine Learning · Computer Science 2016-07-01 Shi Zong , Hao Ni , Kenny Sung , Nan Rosemary Ke , Zheng Wen , Branislav Kveton

Recommender systems are crucial for personalizing user experiences but often depend on implicit feedback data, which can be noisy and misleading. Existing denoising studies involve incorporating auxiliary information or learning strategies…

Information Retrieval · Computer Science 2025-02-14 Shuyao Wang , Zhi Zheng , Yongduo Sui , Hui Xiong

Collaborative filtering is the process of making recommendations regarding the potential preference of a user, for example shopping on the Internet, based on the preference ratings of the user and a number of other users for various items.…

Information Retrieval · Computer Science 2013-01-14 Rita Sharma , David L Poole

Reinforcement learning (RL) has gained popularity in the realm of recommender systems due to its ability to optimize long-term rewards and guide users in discovering relevant content. However, the successful implementation of RL in…

Information Retrieval · Computer Science 2024-08-21 Nathan Corecco , Giorgio Piatti , Luca A. Lanzendörfer , Flint Xiaofeng Fan , Roger Wattenhofer

Learning Path Recommendation is the heart of adaptive learning, the educational paradigm of an Interactive Educational System (IES) providing a personalized learning experience based on the student's history of learning activities. In…

Human-Computer Interaction · Computer Science 2020-05-11 Youngduck Choi , Yoonho Na , Youngjik Yoon , Jonghun Shin , Chan Bae , Hongseok Suh , Byungsoo Kim , Jaewe Heo

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Recommender systems widely use implicit feedback such as click data because of its general availability. Although the presence of clicks signals the users' preference to some extent, the lack of such clicks does not necessarily indicate a…

Machine Learning · Statistics 2022-06-16 Yuta Saito , Suguru Yaginuma , Yuta Nishino , Hayato Sakata , Kazuhide Nakata

Modern recommender systems face a critical challenge in complying with privacy regulations like the 'right to be forgotten': removing a user's data without disrupting recommendations for others. Traditional unlearning methods address this…

Information Retrieval · Computer Science 2025-11-11 Haichao Zhang , Chong Zhang , Peiyu Hu , Shi Qiu , Jia Wang