English
Related papers

Related papers: Embed Progressive Implicit Preference in Unified S…

200 papers

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Sequential recommendation, where user preference is dynamically inferred from sequential historical behaviors, is a critical task in recommender systems (RSs). To further optimize long-term user engagement, offline…

Machine Learning · Computer Science 2024-08-16 Jun Wang , Likang Wu , Qi Liu , Yu Yang

Convolutional Neural Networks (CNNs) have been recently introduced in the domain of session-based next item recommendation. An ordered collection of past items the user has interacted with in a session (or sequence) are embedded into a…

Information Retrieval · Computer Science 2018-11-30 Fajie Yuan , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M Jose , Xiangnan He

Modern AI is opening the door to collective decision-making in which participants express their views as free-form text rather than voting on a fixed set of candidates. A natural idea is to embed these opinions in a vector space so that the…

Artificial Intelligence · Computer Science 2026-05-12 Carter Blair , Ariel D. Procaccia , Milind Tambe

List-wise reranking arranges a request-specific pool of candidate items into an ordered slate that maximizes user satisfaction. Existing generative rerankers fall into two paradigms: Autoregressive (AR) rerankers construct the slate left to…

Information Retrieval · Computer Science 2026-05-12 Pengyue Jia , Hailan Yang , Shuchang Liu , Xiaobei Wang , Wanyu Wang , Xiang Li , Yongqi Liu , Kaiqiao Zhan , Kun Gai , Xiangyu Zhao

The customization of recommended content to users holds significant importance in enhancing user experiences across a wide spectrum of applications such as e-commerce, music, and shopping. Graph-based methods have achieved considerable…

Information Retrieval · Computer Science 2023-12-05 Narges Sadat Fazeli Dehkordi , Hadi Zare , Parham Moradi , Mahdi Jalili

In applications such as recommendation systems and revenue management, it is important to predict preferences on items that have not been seen by a user or predict outcomes of comparisons among those that have never been compared. A popular…

Machine Learning · Computer Science 2015-06-29 Sewoong Oh , Kiran K. Thekumparampil , Jiaming Xu

Learning from preference feedback is essential for aligning large language models (LLMs) with human values and improving the quality of generated responses. However, existing preference learning methods rely heavily on curated data from…

Computation and Language · Computer Science 2025-06-06 Zhaoxuan Tan , Zheng Li , Tianyi Liu , Haodong Wang , Hyokun Yun , Ming Zeng , Pei Chen , Zhihan Zhang , Yifan Gao , Ruijie Wang , Priyanka Nigam , Bing Yin , Meng Jiang

Dynamic recommendation is essential for modern recommender systems to provide real-time predictions based on sequential data. In real-world scenarios, the popularity of items and interests of users change over time. Based on this…

Information Retrieval · Computer Science 2021-01-11 Xiaohan Li , Mengqi Zhang , Shu Wu , Zheng Liu , Liang Wang , Philip S. Yu

Generative recommendation is an emerging paradigm that leverages the extensive knowledge of large language models by formulating recommendations into a text-to-text generation task. However, existing studies face two key limitations in (i)…

Information Retrieval · Computer Science 2025-06-03 Sunkyung Lee , Minjin Choi , Eunseong Choi , Hye-young Kim , Jongwuk Lee

Collaborative filtering is one of the most common scenarios and popular research topics in recommender systems. Among existing methods, latent factor models, i.e., learning a specific embedding for each user/item by reconstructing the…

Information Retrieval · Computer Science 2022-04-27 Yunfan Wu , Qi Cao , Huawei Shen , Shuchang Tao , Xueqi Cheng

In this paper, we investigate preference-based reinforcement learning (PbRL), which enables reinforcement learning (RL) agents to learn from human feedback. This is particularly valuable when defining a fine-grain reward function is not…

Machine Learning · Computer Science 2025-11-11 Guojian Wang , Jianxiang Liu , Xinyuan Li , Faguo Wu , Xiao Zhang , Tianyuan Chen , Xuyang Chen

Offline goal-conditioned reinforcement learning (GCRL) provides a practical framework for obtaining goal-reaching policies from fixed datasets. However, learning a reliable goal-conditioned value function in long-horizon tasks remains…

Machine Learning · Computer Science 2026-05-26 Hyungkyu Kang , Byeongchan Kim , Min-hwan Oh

Recommender models aimed at mining users' behavioral patterns have raised great attention as one of the essential applications in daily life. Recent work on graph neural networks (GNNs) or debiasing methods has attained remarkable gains.…

Information Retrieval · Computer Science 2024-09-05 Xinfeng Wang , Fumiyo Fukumoto , Jin Cui , Yoshimi Suzuki , Jiyi Li , Dongjin Yu

Representation learning systems typically rely on massive amounts of labeled data in order to be trained to high accuracy. Recently, high-dimensional parametric models like neural networks have succeeded in building rich representations…

Machine Learning · Statistics 2016-03-03 Theofanis Karaletsos , Serge Belongie , Gunnar Rätsch

Implicit neural representation (INR), in combination with geometric rendering, has recently been employed in real-time dense RGB-D SLAM. Despite active research endeavors being made, there lacks a unified protocol for fair evaluation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Tongyan Hua , Lin Wang

In this work, we contribute a new multi-layer neural network architecture named ONCF to perform collaborative filtering. The idea is to use an outer product to explicitly model the pairwise correlations between the dimensions of the…

Information Retrieval · Computer Science 2018-08-20 Xiangnan He , Xiaoyu Du , Xiang Wang , Feng Tian , Jinhui Tang , Tat-Seng Chua

We propose a general framework for interactively learning models, such as (binary or non-binary) classifiers, orderings/rankings of items, or clusterings of data points. Our framework is based on a generalization of Angluin's equivalence…

Data Structures and Algorithms · Computer Science 2017-10-17 Ehsan Emamjomeh-Zadeh , David Kempe

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

We study human-in-the-loop reinforcement learning (RL) with trajectory preferences, where instead of receiving a numeric reward at each step, the agent only receives preferences over trajectory pairs from a human overseer. The goal of the…

Machine Learning · Computer Science 2022-05-25 Xiaoyu Chen , Han Zhong , Zhuoran Yang , Zhaoran Wang , Liwei Wang