English

Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)

Artificial Intelligence 2024-11-05 v2

Abstract

Inspired by the success of contrastive learning, we systematically examine recommendation losses, including listwise (softmax), pairwise (BPR), and pointwise (MSE and CCL) losses. In this endeavor, we introduce InfoNCE+, an optimized generalization of InfoNCE with balance coefficients, and highlight its performance advantages, particularly when aligned with our new decoupled contrastive loss, MINE+. We also leverage debiased InfoNCE to debias pointwise recommendation loss (CCL) as Debiased CCL. Interestingly, our analysis reveals that linear models like iALS and EASE are inherently debiased. Empirical results demonstrates the effectiveness of MINE+ and Debiased-CCL.

Keywords

Cite

@article{arxiv.2312.08520,
  title  = {Revisiting Recommendation Loss Functions through Contrastive Learning (Technical Report)},
  author = {Dong Li and Ruoming Jin and Bin Ren},
  journal= {arXiv preprint arXiv:2312.08520},
  year   = {2024}
}

Comments

This manuscript was initially submitted for review in August 2023

R2 v1 2026-06-28T13:50:18.219Z