English
Related papers

Related papers: uCTRL: Unbiased Contrastive Representation Learnin…

200 papers

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

Information Retrieval · Computer Science 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Collaborative Filtering (CF) typically suffers from the significant challenge of popularity bias due to the uneven distribution of items in real-world datasets. This bias leads to a significant accuracy gap between popular and unpopular…

Information Retrieval · Computer Science 2024-06-12 Miaomiao Cai , Lei Chen , Yifan Wang , Haoyue Bai , Peijie Sun , Le Wu , Min Zhang , Meng Wang

Deep neural networks suffer from catastrophic forgetting when continually learning new concepts. In this paper, we analyze this problem from a data imbalance point of view. We argue that the imbalance between old task and new task data…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Leyuan Wang , Liuyu Xiang , Yunlong Wang , Huijia Wu , Zhaofeng He

Increasing users' positive interactions, such as purchases or clicks, is an important objective of recommender systems. Recommenders typically aim to select items that users will interact with. If the recommended items are purchased, an…

Machine Learning · Computer Science 2020-09-24 Masahiro Sato , Sho Takemori , Janmajay Singh , Tomoko Ohkuma

Contrastive Learning (CL) has recently emerged as a powerful technique in recommendation systems, particularly for its capability to harness self-supervised signals from perturbed views to mitigate the persistent challenge of data sparsity.…

Information Retrieval · Computer Science 2025-04-08 Zheyu Chen , Jinfeng Xu , Yutong Wei , Ziyue Peng

Recommender systems widely use implicit feedback such as click data because of its general availability. Although the presence of clicks signals the users' preference to some extent, the lack of such clicks does not necessarily indicate a…

Machine Learning · Statistics 2022-06-16 Yuta Saito , Suguru Yaginuma , Yuta Nishino , Hayato Sakata , Kazuhide Nakata

This paper addresses the challenge of jointly modeling user intent diversity and behavioral uncertainty in recommender systems. A unified representation learning framework is proposed. The framework builds a multi-intent representation…

Information Retrieval · Computer Science 2025-09-08 Wei Xu , Jiasen Zheng , Junjiang Lin , Mingxuan Han , Junliang Du

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Collaborative filtering (CF) based recommendations suffer from mainstream bias -- where mainstream users are favored over niche users, leading to poor recommendation quality for many long-tail users. In this paper, we identify two root…

Information Retrieval · Computer Science 2024-04-16 Jinhao Pan , Ziwei Zhu , Jianling Wang , Allen Lin , James Caverlee

The enhancement of unsupervised learning of sentence representations has been significantly achieved by the utility of contrastive learning. This approach clusters the augmented positive instance with the anchor instance to create a desired…

Computation and Language · Computer Science 2023-10-11 Qingfa Xiao , Shuangyin Li , Lei Chen

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Contrastive learning (CL) recently has spurred a fruitful line of research in the field of recommendation, since its ability to extract self-supervised signals from the raw data is well-aligned with recommender systems' needs for tackling…

Information Retrieval · Computer Science 2022-05-10 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Lizhen Cui , Quoc Viet Hung Nguyen

Contrastive representation learning (CRL) underpins many modern foundation models. Despite recent theoretical progress, existing analyses suffer from several key limitations: (i) the statistical consistency of CRL remains poorly understood;…

Machine Learning · Computer Science 2026-05-29 Yuanfan Li , Xiyuan Wei , Tianbao Yang , Yiming Ying

Graph neural networks (GNNs) have recently emerged as an effective collaborative filtering (CF) approaches for recommender systems. The key idea of GNN-based recommender systems is to recursively perform message passing along user-item…

Information Retrieval · Computer Science 2023-07-14 Yangqin Jiang , Chao Huang , Lianghao Xia

Recommender systems leverage extensive user interaction data to model preferences; however, directly modeling these data may introduce biases that disproportionately favor popular items. In this paper, we demonstrate that popularity bias…

Information Retrieval · Computer Science 2025-04-21 Jiahao Liu , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Li Shang , Ning Gu

Contrastive representation learning has been outstandingly successful in practice. In this work, we identify two key properties related to the contrastive loss: (1) alignment (closeness) of features from positive pairs, and (2) uniformity…

Machine Learning · Computer Science 2022-08-17 Tongzhou Wang , Phillip Isola

Contrastive learning (CL) continuously achieves significant breakthroughs across multiple domains. However, the most common InfoNCE-based methods suffer from some dilemmas, such as \textit{uniformity-tolerance dilemma} (UTD) and…

Machine Learning · Computer Science 2023-06-13 Zizheng Huang , Haoxing Chen , Ziqi Wen , Chao Zhang , Huaxiong Li , Bo Wang , Chunlin Chen

The growth of Internet commerce has stimulated the use of collaborative filtering (CF) algorithms as recommender systems. A collaborative filtering (CF) algorithm recommends items of interest to the target user by leveraging the votes given…

Information Retrieval · Computer Science 2018-05-09 Xu He , Bin Liu , Ke-Jia Chen

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison