English
Related papers

Related papers: Preference Modeling by Exploiting Latent Component…

200 papers

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand

With the widespread adoption of information systems, recommender systems are widely used for better user experience. Collaborative filtering is a popular approach in implementing recommender systems. Yet, collaborative filtering methods are…

Information Retrieval · Computer Science 2019-08-20 Sapumal Ahangama , Danny Chiang-Choon Poo

Accommodating human preferences is essential for creating aligned LLM agents that deliver personalized and effective interactions. Recent work has shown the potential for LLMs acting as writing agents to infer a description of user…

Computation and Language · Computer Science 2025-06-02 Stéphane Aroca-Ouellette , Natalie Mackraz , Barry-John Theobald , Katherine Metcalf

Personalizing large language models (LLMs) to accommodate diverse user preferences is essential for enhancing alignment and user satisfaction. Traditional reinforcement learning from human feedback (RLHF) approaches often rely on monolithic…

Machine Learning · Computer Science 2025-04-22 Avinandan Bose , Zhihan Xiong , Yuejie Chi , Simon Shaolei Du , Lin Xiao , Maryam Fazel

Recommendation models are predominantly trained using implicit user feedback, since explicit feedback is often costly to obtain. However, implicit feedback, such as clicks, does not always reflect users' real preferences. For example, a…

Information Retrieval · Computer Science 2025-10-06 Mengchen Zhao , Yifan Gao , Yaqing Hou , Xiangyang Li , Pengjie Gu , Zhenhua Dong , Ruiming Tang , Yi Cai

Many travel decisions involve a degree of experience formation, where individuals learn their preferences over time. At the same time, there is extensive scope for heterogeneity across individual travellers, both in their underlying…

As language models (LMs) become more capable, it is increasingly important to align them with human preferences. However, the dominant paradigm for training Preference Models (PMs) for that purpose suffers from fundamental limitations, such…

Computation and Language · Computer Science 2024-03-18 Dongyoung Go , Tomasz Korbak , Germán Kruszewski , Jos Rozen , Marc Dymetman

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

Recommender systems are critical for delivering personalized content across digital platforms, and recent advances in Large Language Models (LLMs) offer new opportunities to enhance them with richer world knowledge and explicit reasoning…

Information Retrieval · Computer Science 2026-05-22 Jingtong Gao , Zeyu Song , Chi Lu , Xiaopeng Li , Derong Xu , Maolin Wang , Peng Jiang , Kun Gai , Qingpeng Cai , Xiangyu Zhao

Machine Learning's proliferation in critical fields such as healthcare, banking, and criminal justice has motivated the creation of tools which ensure trust and transparency in ML models. One such tool is Actionable Recourse (AR) for…

Machine Learning · Computer Science 2023-09-07 Jayanth Yetukuri , Ian Hardy , Yang Liu

Accurately modeling user preferences is vital not only for improving recommendation performance but also for enhancing transparency in recommender systems. Conventional user profiling methods, such as averaging item embeddings, often…

Information Retrieval · Computer Science 2025-05-05 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

Many platforms on the web present ranked lists of content to users, typically optimized for engagement-, satisfaction- or retention- driven metrics. Advances in the Learning-to-Rank (LTR) research literature have enabled rapid growth in…

Information Retrieval · Computer Science 2024-01-09 Hitesh Sagtani , Olivier Jeunen , Aleksei Ustimenko

Recommendation systems aim to predict users' feedback on items not exposed to them. Confounding bias arises due to the presence of unmeasured variables (e.g., the socio-economic status of a user) that can affect both a user's exposure and…

Machine Learning · Computer Science 2023-06-16 Qing Zhang , Xiaoying Zhang , Yang Liu , Hongning Wang , Min Gao , Jiheng Zhang , Ruocheng Guo

Conversational recommendation system (CRS) is able to obtain fine-grained and dynamic user preferences based on interactive dialogue. Previous CRS assumes that the user has a clear target item. However, for many users who resort to CRS,…

Information Retrieval · Computer Science 2022-02-08 Yiming Zhang , Lingfei Wu , Qi Shen , Yitong Pang , Zhihua Wei , Fangli Xu , Bo Long , Jian Pei

Current sequential recommender systems are proposed to tackle the dynamic user preference learning with various neural techniques, such as Transformer and Graph Neural Networks (GNNs). However, inference from the highly sparse user behavior…

Information Retrieval · Computer Science 2023-03-22 Yuhao Yang , Chao Huang , Lianghao Xia , Chunzhen Huang , Da Luo , Kangyi Lin

Consumers often heavily rely on online product reviews, analyzing both quantitative ratings and textual descriptions to assess product quality. However, existing research hasn't adequately addressed how to systematically encourage the…

Information Retrieval · Computer Science 2025-04-22 Ekta Gujral , Apurva Sinha , Lishi Ji , Bijayani Sanghamitra Mishra

This paper presents a novel approach for using clickthrough data to learn ranked retrieval functions for web search results. We observe that users searching the web often perform a sequence, or chain, of queries with a similar information…

Machine Learning · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims

Rating elicitation is a success element for recommender systems to perform well at cold-starting, in which the systems need to recommend items to a newly arrived user with no prior knowledge about the user's preference. Existing elicitation…

Information Retrieval · Computer Science 2024-06-04 Hieu Trung Nguyen , Duy Nguyen , Khoa Doan , Viet Anh Nguyen

Understanding consumer preferences is essential to product design and predicting market response to these new products. Choice-based conjoint analysis is widely used to model user preferences using their choices in surveys. However,…

Understanding what users like is relatively straightforward; understanding what users dislike, however, remains a challenging and underexplored problem. Research into users' negative preferences has gained increasing importance in modern…

Information Retrieval · Computer Science 2026-01-23 Xinda Chen , Jiawei Wu , Yishuang Liu , Jialin Zhu , Shuwen Xiao , Junjun Zheng , Xiangheng Kong , Yuning Jiang