English
Related papers

Related papers: Advancing Loss Functions in Recommender Systems: A…

200 papers

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Integrating supervised contrastive loss to cross entropy-based communication has recently been proposed as a solution to address the long-tail learning problem. However, when the class imbalance ratio is high, it requires adjusting the…

Machine Learning · Computer Science 2024-07-10 Charika De Alvis , Dishanika Denipitiyage , Suranga Seneviratne

The top-k recommendation is a fundamental task in recommendation systems which is generally learned by comparing positive and negative pairs. The Contrastive Loss (CL) is the key in contrastive learning that has received more attention…

Information Retrieval · Computer Science 2021-09-02 Hao Tang , Guoshuai Zhao , Yuxia Wu , Xueming Qian

Ranking tasks constitute fundamental components of extreme similarity learning frameworks, where extremely large corpora of objects are modeled through relative similarity relationships adhering to predefined ordinal structures. Among…

Machine Learning · Computer Science 2025-06-12 Yuanhao Pu , Defu Lian , Xiaolong Chen , Xu Huang , Jin Chen , Enhong Chen

Large language models (LLMs) have been garnering increasing attention in the recommendation community. Some studies have observed that LLMs, when fine-tuned by the cross-entropy (CE) loss with a full softmax, could achieve…

Information Retrieval · Computer Science 2024-08-27 Cong Xu , Zhangchi Zhu , Mo Yu , Jun Wang , Jianyong Wang , Wei Zhang

Collaborative filtering (CF) is a widely studied research topic in recommender systems. The learning of a CF model generally depends on three major components, namely interaction encoder, loss function, and negative sampling. While many…

Information Retrieval · Computer Science 2023-12-01 Kelong Mao , Jieming Zhu , Jinpeng Wang , Quanyu Dai , Zhenhua Dong , Xi Xiao , Xiuqiang He

The goal of Continual Learning (CL) task is to continuously learn multiple new tasks sequentially while achieving a balance between the plasticity and stability of new and old knowledge. This paper analyzes that this insufficiency arises…

Machine Learning · Computer Science 2024-05-28 Hanxi Xiao , Fan Lyu

In large-scale recommender systems, retrieving top N relevant candidates accurately with resource constrain is crucial. To evaluate the performance of such retrieval models, Recall@N, the frequency of positive samples being retrieved in the…

Information Retrieval · Computer Science 2024-11-12 Yongxiang Tang , Wentao Bai , Guilin Li , Xialong Liu , Yu Zhang

In the realm of recommender systems (RS), Top-$K$ ranking metrics such as NDCG@$K$ are the gold standard for evaluating recommendation performance. However, during the training of recommendation models, optimizing NDCG@$K$ poses significant…

Information Retrieval · Computer Science 2025-08-11 Weiqin Yang , Jiawei Chen , Shengjia Zhang , Peng Wu , Yuegang Sun , Yan Feng , Chun Chen , Can Wang

Continual learning (CL) is crucial for the adaptation of neural network models to new environments. Although outperforming weight-space regularisation approaches, the functional regularisation-based CL methods suffer from high computational…

Machine Learning · Computer Science 2025-08-19 Pengcheng Hao , Menghao Waiyan William Zhu , Ercan Engin Kuruoglu

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

We present a novel method for Deep Reinforcement Learning (DRL), incorporating the convex property of the value function over the belief space in Partially Observable Markov Decision Processes (POMDPs). We introduce hard- and soft-enforced…

Machine Learning · Computer Science 2025-03-13 Daniel Koutas , Daniel Hettegger , Kostas G. Papakonstantinou , Daniel Straub

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

The empirical success of distributional reinforcement learning (RL) highly relies on the choice of distribution divergence equipped with an appropriate distribution representation. In this paper, we propose \textit{Sinkhorn distributional…

Machine Learning · Computer Science 2024-10-16 Ke Sun , Yingnan Zhao , Wulong Liu , Bei Jiang , Linglong Kong

The rise of large language models (LLMs) has opened new opportunities in Recommender Systems (RSs) by enhancing user behavior modeling and content understanding. However, current approaches that integrate LLMs into RSs solely utilize either…

Information Retrieval · Computer Science 2024-03-26 Yunjia Xi , Weiwen Liu , Jianghao Lin , Chuhan Wu , Bo Chen , Ruiming Tang , Weinan Zhang , Yong Yu

Deep Metric Learning (DML) aims to learn embedding functions that map semantically similar inputs to proximate points in a metric space while separating dissimilar ones. Existing methods, such as pairwise losses, are hindered by complex…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pedro Silva , Guilherme A. L. Silva , Pablo Coelho , Vander Freitas , Gladston Moreira , David Menotii , Eduardo Luz

Interactive Recommendation (IR) has gained significant attention recently for its capability to quickly capture dynamic interest and optimize both short and long term objectives. IR agents are typically implemented through Deep…

Information Retrieval · Computer Science 2025-06-17 Jingyu Li , Zhiyong Feng , Dongxiao He , Hongqi Chen , Qinghang Gao , Guoli Wu

Learning systems match predicted scores to observations over some domain. Often, it is critical to produce accurate predictions in some subset (or region) of the domain, yet less important to accurately predict in other regions. We…

Machine Learning · Computer Science 2025-06-11 Gil I. Shamir , Manfred K. Warmuth