English
Related papers

Related papers: Inductive Pairwise Ranking: Going Beyond the n log…

200 papers

Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning approaches typically represent user intent with a single…

Information Retrieval · Computer Science 2026-04-30 Tianqi Gao , Chengkai Huang , Zihan Wang , Cao Liu , Ke Zeng , Lina Yao

Recommender systems are important to help users select relevant and personalised information over massive amounts of data available. We propose an unified framework called Preference Network (PN) that jointly models various types of domain…

Information Retrieval · Computer Science 2014-07-23 Tran The Truyen , Dinh Q. Phung , Svetha Venkatesh

This paper provides a theoretical analysis of a new learning problem for recommender systems where users provide feedback by comparing pairs of items instead of rating them individually. We assume that comparisons stem from latent user and…

Machine Learning · Computer Science 2025-08-20 Suryanarayana Sankagiri , Jalal Etesami , Matthias Grossglauser

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications. Most existing variations of NMF only consider how each row/column vector of factorised matrices should be shaped, and…

Machine Learning · Computer Science 2019-07-09 Shuai Jiang , Kan Li , Richard Yida Xu

Pairwise comparisons are a well-known method for modelling of the subjective preferences of a decision maker. A popular implementation of the method is based on solving an eigenvalue problem for M - the matrix of pairwise comparisons. This…

Discrete Mathematics · Computer Science 2015-09-25 Konrad Kułakowski

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining…

Machine Learning · Computer Science 2018-02-22 Luisa M Zintgraf , Diederik M Roijers , Sjoerd Linders , Catholijn M Jonker , Ann Nowé

We introduce a novel framework for analyzing sorting algorithms in pairwise ranking prompting (PRP), re-centering the cost model around LLM inferences rather than traditional pairwise comparisons. While classical metrics based on comparison…

Computation and Language · Computer Science 2025-06-02 Juan Wisznia , Cecilia Bolaños , Juan Tollo , Giovanni Marraffini , Agustín Gianolini , Noe Hsueh , Luciano Del Corro

The core objective of modelling recommender systems from implicit feedback is to maximize the positive sample score $s_p$ and minimize the negative sample score $s_n$, which can usually be summarized into two paradigms: the pointwise and…

Information Retrieval · Computer Science 2022-03-01 Jianhuan Zhuo , Qiannan Zhu , Yinliang Yue , Yuhong Zhao

Pairwise learning underpins implicit collaborative filtering, yet its effectiveness is often hindered by sparse supervision, noisy interactions, and popularity-driven exposure bias. In this paper, we propose Variational Bayesian…

Information Retrieval · Computer Science 2026-03-25 Bin Liu , Xiaohong Liu , Qin Luo , Ziqiao Shang , Jielei Chu , Lin Ma , Zhaoyu Li , Fei Teng , Guangtao Zhai , Tianrui Li

In industry, feature selection is a standard but necessary step to search for an optimal set of informative feature fields for efficient and effective training of deep Click-Through Rate (CTR) models. Most previous works measure the…

Information Retrieval · Computer Science 2022-09-07 Yi Guo , Zhaocheng Liu , Jianchao Tan , Chao Liao , Sen Yang , Lei Yuan , Dongying Kong , Zhi Chen , Ji Liu

Preference-based Reinforcement Learning (PbRL) is a paradigm in which an RL agent learns to optimize a task using pair-wise preference-based feedback over trajectories, rather than explicit reward signals. While PbRL has demonstrated…

Machine Learning · Computer Science 2024-04-18 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

The goal of a recommendation system is to model the relevance between each user and each item through the user-item interaction history, so that maximize the positive samples score and minimize negative samples. Currently, two popular loss…

Information Retrieval · Computer Science 2022-07-08 Chun Yang , Shicai Fan

Reinforcement Learning (RL) has emerged as a powerful tool for neural combinatorial optimization, enabling models to learn heuristics that solve complex problems without requiring expert knowledge. Despite significant progress, existing RL…

Machine Learning · Computer Science 2025-05-14 Mingjun Pan , Guanquan Lin , You-Wei Luo , Bin Zhu , Zhien Dai , Lijun Sun , Chun Yuan

Preference-based Reinforcement Learning (PbRL) replaces reward values in traditional reinforcement learning by preferences to better elicit human opinion on the target objective, especially when numerical reward values are hard to design or…

Machine Learning · Computer Science 2020-10-27 Yichong Xu , Ruosong Wang , Lin F. Yang , Aarti Singh , Artur Dubrawski

Learning to rank has recently emerged as an attractive technique to train deep convolutional neural networks for various computer vision tasks. Pairwise ranking, in particular, has been successful in multi-label image classification,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-02 Yuncheng Li , Yale Song , Jiebo Luo

Pseudo-relevance feedback (PRF) can enhance average retrieval effectiveness over a sufficiently large number of queries. However, PRF often introduces a drift into the original information need, thus hurting the retrieval effectiveness of…

Information Retrieval · Computer Science 2024-01-23 Suchana Datta , Debasis Ganguly , Sean MacAvaney , Derek Greene

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

Computation and Language · Computer Science 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

Preference learning is a widely adopted post-training technique that aligns large language models (LLMs) to human preferences and improves specific downstream task capabilities. In this work we systematically investigate how specific…

Computation and Language · Computer Science 2024-12-23 Joongwon Kim , Anirudh Goyal , Aston Zhang , Bo Xiong , Rui Hou , Melanie Kambadur , Dhruv Mahajan , Hannaneh Hajishirzi , Liang Tan

FOLD-R++ is a new inductive learning algorithm for binary classification tasks. It generates an (explainable) normal logic program for mixed type (numerical and categorical) data. We present a customized FOLD-R++ algorithm with the ranking…

Machine Learning · Computer Science 2022-06-16 Huaduo Wang , Gopal Gupta