English
Related papers

Related papers: ELIXIR: Learning from User Feedback on Explanation…

200 papers

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

Information Retrieval · Computer Science 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

This paper studies recommender systems with knowledge graphs, which can effectively address the problems of data sparsity and cold start. Recently, a variety of methods have been developed for this problem, which generally try to learn…

Information Retrieval · Computer Science 2022-01-10 Weiping Song , Zhijian Duan , Ziqing Yang , Hao Zhu , Ming Zhang , Jian Tang

User-item interaction histories are pivotal for sequential recommendation systems but often include noise, such as unintended clicks or actions that fail to reflect genuine user preferences. To address this, we propose Learned Item…

Information Retrieval · Computer Science 2025-11-27 Haidong Xin , Zhenghao Liu , Sen Mei , Yukun Yan , Shi Yu , Shuo Wang , Zulong Chen , Yu Gu , Ge Yu , Chenyan Xiong

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

Computation and Language · Computer Science 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

As users often express their preferences with binary behavior data~(implicit feedback), such as clicking items or buying products, implicit feedback based Collaborative Filtering~(CF) models predict the top ranked items a user might like by…

Information Retrieval · Computer Science 2021-05-27 Lei Chen , Le Wu , Kun Zhang , Richang Hong , Meng Wang

Interface icons are prevalent in various digital applications. Due to limited time and budgets, many designers rely on informal evaluation, which often results in poor usability icons. In this paper, we propose a unique human-in-the-loop…

Graphics · Computer Science 2023-05-30 I-Chao Shen , Fu-Yin Cherng , Takeo Igarashi , Wen-Chieh Lin , Bing-Yu Chen

Interactive user interfaces need to continuously evolve based on the interactions that a user has (or does not have) with the system. This may require constant exploration of various options that the system may have for the user and…

Machine Learning · Computer Science 2018-12-04 Honglei Liu , Anuj Kumar , Wenhai Yang , Benoit Dumoulin

Information retrieval (IR) systems need to constantly update their knowledge as target objects and user queries change over time. Due to the power-law nature of linguistic data, learning lexical concepts is a problem resisting standard…

Artificial Intelligence · Computer Science 2019-11-01 Jacopo Tagliabue , Reuben Cohn-Gordon

Modern recommendation systems ought to benefit by probing for and learning from delayed feedback. Research has tended to focus on learning from a user's response to a single recommendation. Such work, which leverages methods of supervised…

Information Retrieval · Computer Science 2023-08-01 Zheqing Zhu , Benjamin Van Roy

The emerging meta- and multi-verse landscape is yet another step towards the more prevalent use of already ubiquitous online markets. In such markets, recommender systems play critical roles by offering items of interest to the users,…

Information Retrieval · Computer Science 2022-09-28 Ehsan Gholami , Mohammad Motamedi , Ashwin Aravindakshan

We introduce Frank, a human-in-the-loop system for co-evolutionary hybrid decision-making aiding the user to label records from an un-labeled dataset. Frank employs incremental learning to ``evolve'' in parallel with the user's decisions,…

Human-Computer Interaction · Computer Science 2025-03-11 Federico Mazzoni , Riccardo Guidotti , Alessio Malizia

Learning of preference models from human feedback has been central to recent advances in artificial intelligence. Motivated by the cost of obtaining high-quality human annotations, we study efficient human preference elicitation for…

Machine Learning · Computer Science 2026-02-17 Subhojyoti Mukherjee , Anusha Lalitha , Kousha Kalantari , Aniket Deshmukh , Ge Liu , Yifei Ma , Branislav Kveton

Accommodating human preferences is essential for creating AI agents that deliver personalized and effective interactions. Recent work has shown the potential for LLMs to infer preferences from user interactions, but they often produce broad…

Artificial Intelligence · Computer Science 2024-10-10 Stephane Aroca-Ouellette , Natalie Mackraz , Barry-John Theobald , Katherine Metcalf

Large language models (LLMs) have shown strong potential in recommendation tasks due to their strengths in language understanding, reasoning and knowledge integration. These capabilities are especially beneficial for review-based…

Computation and Language · Computer Science 2025-09-03 Kaiwen Wei , Jinpeng Gao , Jiang Zhong , Yuming Yang , Fengmao Lv , Zhenyang Li

Reinforcement learning is a general method for learning in sequential settings, but it can often be difficult to specify a good reward function when the task is complex. In these cases, preference feedback or expert demonstrations can be…

Machine Learning · Computer Science 2025-08-20 Jason R Brown , Carl Henrik Ek , Robert D Mullins

In recent years, the field of recommendation systems has attracted increasing attention to developing predictive models that provide explanations of why an item is recommended to a user. The explanations can be either obtained by post-hoc…

Machine Learning · Computer Science 2020-12-16 Yifeng Guo , Yu Su , Zebin Yang , Aijun Zhang

Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry…

Human-Computer Interaction · Computer Science 2022-07-27 Changkun Ou , Daniel Buschek , Sven Mayer , Andreas Butz

In the realm of autonomous vehicles, dynamic user preferences are critical yet challenging to accommodate. Existing methods often misrepresent these preferences, either by overlooking their dynamism or overburdening users as humans often…

Human-Computer Interaction · Computer Science 2024-03-06 Mingyue Zhang , Jialong Li , Nianyu Li , Eunsuk Kang , Kenji Tei

A central concern in an interactive intelligent system is optimization of its actions, to be maximally helpful to its human user. In recommender systems for instance, the action is to choose what to recommend, and the optimization task is…

Human-Computer Interaction · Computer Science 2020-05-05 Fabio Colella , Pedram Daee , Jussi Jokinen , Antti Oulasvirta , Samuel Kaski

Explanations in a recommender system assist users in making informed decisions among a set of recommended items. Great research attention has been devoted to generating natural language explanations to depict how the recommendations are…

Information Retrieval · Computer Science 2022-02-22 Peng Wang , Renqin Cai , Hongning Wang