English
Related papers

Related papers: Learning from a Learning User for Optimal Recommen…

200 papers

We address the problem of learning in an online setting where the learner repeatedly observes features, selects among a set of actions, and receives reward for the action taken. We provide the first efficient algorithm with an optimal…

Machine Learning · Computer Science 2011-06-17 Miroslav Dudik , Daniel Hsu , Satyen Kale , Nikos Karampatziakis , John Langford , Lev Reyzin , Tong Zhang

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

In the last decade we have observed a mass increase of information, in particular information that is shared through smartphones. Consequently, the amount of information that is available does not allow the average user to be aware of all…

Information Retrieval · Computer Science 2017-07-04 Akshay Kumar Chaturvedi , Filipa Peleja , Ana Freire

We address the problem of active online assortment optimization problem with preference feedback, which is a framework for modeling user choices and subsetwise utility maximization. The framework is useful in various real-world applications…

Machine Learning · Computer Science 2024-03-01 Aadirupa Saha , Pierre Gaillard

Recent research revealed a considerable lack of reliability for user feedback when interacting with adaptive systems, often denoted as user noise or human uncertainty. Moreover, this lack of reliability holds striking impacts for the…

Human-Computer Interaction · Computer Science 2018-05-01 Kevin Jasberg , Sergej Sizov

Recently, Large Language Model (LLM)-empowered recommender systems have revolutionized personalized recommendation frameworks and attracted extensive attention. Despite the remarkable success, existing LLM-empowered RecSys have been…

Information Retrieval · Computer Science 2025-04-04 Liangbo Ning , Wenqi Fan , Qing Li

In some reinforcement learning problems an agent may be provided with a set of input policies, perhaps learned from prior experience or provided by advisors. We present a reinforcement learning with policy advice (RLPA) algorithm which…

Machine Learning · Statistics 2013-07-19 Mohammad Gheshlaghi Azar , Alessandro Lazaric , Emma Brunskill

Reinforcement learning (RL) has shown great success in solving many challenging tasks via use of deep neural networks. Although using deep learning for RL brings immense representational power, it also causes a well-known…

Machine Learning · Computer Science 2022-04-18 Sahir , Ercüment İlhan , Srijita Das , Matthew E. Taylor

The implicit feedback (e.g., clicks) in real-world recommender systems is often prone to severe noise caused by unintentional interactions, such as misclicks or curiosity-driven behavior. A common approach to denoising this feedback is…

Information Retrieval · Computer Science 2025-04-01 Zongwei Wang , Min Gao , Junliang Yu , Yupeng Hou , Shazia Sadiq , Hongzhi Yin

Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This bias becomes particularly problematic over time as a few items are repeatedly…

Information Retrieval · Computer Science 2024-08-09 Masoud Mansoury , Bamshad Mobasher , Herke van Hoof

Reinforcement Learning-based Recommender Systems (RLRS) have shown promise across a spectrum of applications, from e-commerce platforms to streaming services. Yet, they grapple with challenges, notably in crafting reward functions and…

Information Retrieval · Computer Science 2024-03-27 Siyu Wang , Xiaocong Chen , Lina Yao

Learning user preferences for products based on their past purchases or reviews is at the cornerstone of modern recommendation engines. One complication in this learning task is that some users are more likely to purchase products or review…

Information Retrieval · Computer Science 2023-03-08 Wanning Chen , Mohsen Bayati

Connecting conversation with external domain knowledge is vital for conversational recommender systems (CRS) to correctly understand user preferences. However, existing solutions either require domain-specific engineering, which limits…

Information Retrieval · Computer Science 2025-09-29 Dayu Yang , Hui Fang

Conventional recommendation systems (RSs) are typically optimized to enhance performance metrics uniformly across all training samples. This makes it hard for data-driven RSs to cater to a diverse set of users due to the varying properties…

Information Retrieval · Computer Science 2024-05-03 Kirandeep Kaur , Chirag Shah

Algorithmic recourse suggests actions to individuals who have been adversely affected by automated decision-making, helping them to achieve the desired outcome. Knowing the recourse, however, does not guarantee that users can implement it…

Machine Learning · Computer Science 2025-08-18 Yueqing Xuan , Kacper Sokol , Mark Sanderson , Jeffrey Chan

Optimization of experimental materials synthesis and characterization through active learning methods has been growing over the last decade, with examples ranging from measurements of diffraction on combinatorial alloys at synchrotrons, to…

Users' reviews contain valuable information which are not taken into account in most recommender systems. According to the latest studies in this field, using review texts could not only improve the performance of recommendation, but it can…

Information Retrieval · Computer Science 2020-03-17 Parisa Abolfath Beygi Dezfouli , Saeedeh Momtazi , Mehdi Dehghan

We consider the problem of learning preferences over trajectories for mobile manipulators such as personal robots and assembly line robots. The preferences we learn are more intricate than simple geometric constraints on trajectories; they…

Robotics · Computer Science 2016-01-06 Ashesh Jain , Shikhar Sharma , Thorsten Joachims , Ashutosh Saxena

The design of algorithms that generate personalized ranked item lists is a central topic of research in the field of recommender systems. In the past few years, in particular, approaches based on deep learning (neural) techniques have…

Information Retrieval · Computer Science 2021-01-08 Maurizio Ferrari Dacrema , Simone Boglio , Paolo Cremonesi , Dietmar Jannach

For tackling the well known cold-start user problem in model-based recommender systems, one approach is to recommend a few items to a cold-start user and use the feedback to learn a profile. The learned profile can then be used to make good…

Information Retrieval · Computer Science 2017-03-02 Sampoorna Biswas , Laks V. S. Lakshmanan , Senjuti Basu Ray