English
Related papers

Related papers: Contrastive Learning for Representation Degenerati…

200 papers

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

Recommendation fairness has recently attracted much attention. In the real world, recommendation systems are driven by user behavior, and since users with the same sensitive feature (e.g., gender and age) tend to have the same patterns,…

Information Retrieval · Computer Science 2025-07-16 Yang Liu , Feng Wu , Xuefang Zhu

Sequential recommendation is an important recommendation task that aims to predict the next item in a sequence. Recently, adaptations of language models, particularly Transformer-based models such as SASRec and BERT4Rec, have achieved…

Information Retrieval · Computer Science 2023-06-21 Aleksandr V. Petrov , Craig Macdonald

Dataset Condensation (DC) aims to reduce deep neural networks training efforts by synthesizing a small dataset such that it will be as effective as the original large dataset. Conventionally, DC relies on a costly bi-level optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Sahar Rahimi Malakshan , Mohammad Saeed Ebrahimi Saadabadi , Ali Dabouei , Nasser M. Nasrabadi

In recommender systems, popularity and conformity biases undermine recommender effectiveness by disproportionately favouring popular items, leading to their over-representation in recommendation lists and causing an unbalanced distribution…

Information Retrieval · Computer Science 2024-08-20 Zhirong Huang , Shichao Zhang , Debo Cheng , Jiuyong Li , Lin Liu , Guixian Zhang

Sequential recommendation aims to recommend the next item of users' interest based on their historical interactions. Recently, the self-attention mechanism has been adapted for sequential recommendation, and demonstrated state-of-the-art…

Information Retrieval · Computer Science 2022-09-19 Bo Peng , Srinivasan Parthasarathy , Xia Ning

Heterogeneous gap among different modalities emerges as one of the critical issues in modern AI problems. Unlike traditional uni-modal cases, where raw features are extracted and directly measured, the heterogeneous nature of cross modal…

Information Retrieval · Computer Science 2015-11-19 Aiwen Jiang , Hanxi Li , Yi Li , Mingwen Wang

A new trend uses LLMs as dense text encoders via contrastive learning. However, since LLM embeddings predict the probability distribution of the next token, they are inherently generative and distributive, conflicting with contrastive…

Computation and Language · Computer Science 2025-10-17 Jingcheng Deng , Zhongtao Jiang , Liang Pang , Liwei Chen , Kun Xu , Zihao Wei , Huawei Shen , Xueqi Cheng

Learning user representations based on historical behaviors lies at the core of modern recommender systems. Recent advances in sequential recommenders have convincingly demonstrated high capability in extracting effective user…

Information Retrieval · Computer Science 2021-09-14 Shengyu Zhang , Dong Yao , Zhou Zhao , Tat-seng Chua , Fei Wu

Time series anomaly detection is critical for a wide range of applications. It aims to identify deviant samples from the normal sample distribution in time series. The most fundamental challenge for this task is to learn a representation…

Machine Learning · Computer Science 2023-10-12 Yiyuan Yang , Chaoli Zhang , Tian Zhou , Qingsong Wen , Liang Sun

Bundle recommendation approaches offer users a set of related items on a particular topic. The current state-of-the-art (SOTA) method utilizes contrastive learning to learn representations at both the bundle and item levels. However, due to…

Information Retrieval · Computer Science 2023-11-29 Xiaoyu Du , Kun Qian , Yunshan Ma , Xinguang Xiang

Self-supervised visual representation learning aims to learn useful representations without relying on human annotations. Joint embedding approach bases on maximizing the agreement between embedding vectors from different views of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Li Jing , Pascal Vincent , Yann LeCun , Yuandong Tian

Diffusion-based recommender systems (DR) have gained increasing attention for their advanced generative and denoising capabilities. However, existing DR face two central limitations: (i) a trade-off between enhancing generative capacity via…

Information Retrieval · Computer Science 2025-02-03 Gyuseok Lee , Yaochen Zhu , Hwanjo Yu , Yao Zhou , Jundong Li

Sequential recommender systems (SRSs) aim to suggest next item for a user based on her historical interaction sequences. Recently, many research efforts have been devoted to attenuate the influence of noisy items in sequences by either…

Information Retrieval · Computer Science 2024-06-21 Xiaofei Zhu , Liang Li , Weidong Liu , Xin Luo

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

In this paper, we propose a novel training procedure for the continual representation learning problem in which a neural network model is sequentially learned to alleviate catastrophic forgetting in visual search tasks. Our method, called…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Tommaso Barletti , Niccolo' Biondi , Federico Pernici , Matteo Bruni , Alberto Del Bimbo

Sequential recommendation involves automatically recommending the next item to users based on their historical item sequence. While most prior research employs RNN or transformer methods to glean information from the item…

Information Retrieval · Computer Science 2024-10-10 Xiaofan Zhou

Modern recommender systems heavily rely on high-quality representations learned from high-dimensional sparse data. While significant efforts have been invested in designing powerful algorithms for extracting user preferences, the factors…

Information Retrieval · Computer Science 2025-02-18 Shaowen Peng , Kazunari Sugiyama , Xin Liu , Tsunenori Mine

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

Contrastive learning has shown to learn better quality representations than models trained using cross-entropy loss. They also transfer better to downstream datasets from different domains. However, little work has been done to explore the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Alvin De Jun Tan , Clement Tan , Chai Kiat Yeo