English
Related papers

Related papers: Contrastive Learning for Representation Degenerati…

200 papers

Sequential recommendation systems often struggle to make predictions or take action when dealing with cold-start items that have limited amount of interactions. In this work, we propose SimRec - a new approach to mitigate the cold-start…

Information Retrieval · Computer Science 2024-10-30 Shaked Brody , Shoval Lagziel

How to improve discriminative feature learning is central in classification. Existing works address this problem by explicitly increasing inter-class separability and intra-class similarity, whether by constructing positive and negative…

Machine Learning · Computer Science 2024-08-21 Qingsong Zhao , Yi Wang , Shuguang Dou , Chen Gong , Yin Wang , Cairong Zhao

In this paper, a contrastive representation learning framework is proposed to enhance human action segmentation via pre-training using trimmed (single action) skeleton sequences. Unlike previous representation learning works that are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Haitao Tian , Pierre Payeur

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Sequential Recommendation is a popular recommendation task that uses the order of user-item interaction to model evolving users' interests and sequential patterns in their behaviour. Current state-of-the-art Transformer-based models for…

Information Retrieval · Computer Science 2023-12-19 Aleksandr V. Petrov , Craig Macdonald

Sequential Recommendation (SR) plays a pivotal role in recommender systems by tailoring recommendations to user preferences based on their non-stationary historical interactions. Achieving high-quality performance in SR requires attention…

Information Retrieval · Computer Science 2024-08-23 Wuchao Li , Rui Huang , Haijun Zhao , Chi Liu , Kai Zheng , Qi Liu , Na Mou , Guorui Zhou , Defu Lian , Yang Song , Wentian Bao , Enyun Yu , Wenwu Ou

Semantic search is an important task which objective is to find the relevant index from a database for query. It requires a retrieval model that can properly learn the semantics of sentences. Transformer-based models are widely used as…

Machine Learning · Computer Science 2022-09-28 Mingxi Tan , Alexis Rolland , Andong Tian

This paper improves contrastive learning for sentence embeddings from two perspectives: handling dropout noise and addressing feature corruption. Specifically, for the first perspective, we identify that the dropout noise from negative…

Computation and Language · Computer Science 2023-12-25 Jiahao Xu , Wei Shao , Lihui Chen , Lemao Liu

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

Machine Learning · Computer Science 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han

The core of the general recommender systems lies in learning high-quality embedding representations of users and items to investigate their positional relations in the feature space. Unfortunately, data sparsity caused by…

Information Retrieval · Computer Science 2025-04-24 Yi Zhang , Yiwen Zhang

Sequential recommendation has become increasingly prominent in both academia and industry, particularly in e-commerce. The primary goal is to extract user preferences from historical interaction sequences and predict items a user is likely…

Information Retrieval · Computer Science 2026-04-16 Xiaofan Zhou , Kyumin Lee

Recent sequential recommendation models have combined pre-trained text embeddings of items with item ID embeddings to achieve superior recommendation performance. Despite their effectiveness, the expressive power of text features in these…

Information Retrieval · Computer Science 2024-02-19 Lingzi Zhang , Xin Zhou , Zhiwei Zeng , Zhiqi Shen

By generating new yet effective data, data augmentation has become a promising method to mitigate the data sparsity problem in sequential recommendation. Existing works focus on augmenting the original data but rarely explore the issue of…

Information Retrieval · Computer Science 2024-12-24 Yizhou Dang , Jiahui Zhang , Yuting Liu , Enneng Yang , Yuliang Liang , Guibing Guo , Jianzhe Zhao , Xingwei Wang

The success of Transformer-based models has encouraged many researchers to learn CAD models using sequence-based approaches. However, learning CAD models is still a challenge, because they can be represented as complex shapes with long…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minseop Jung , Minseong Kim , Jibum Kim

Dense correspondence across semantically related images has been extensively studied, but still faces two challenges: 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Taihong Xiao , Sifei Liu , Shalini De Mello , Zhiding Yu , Jan Kautz , Ming-Hsuan Yang

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-supervised learning algorithms used for image and NLP pretraining,…

Computation and Language · Computer Science 2021-03-29 Dongsheng Luo , Wei Cheng , Jingchao Ni , Wenchao Yu , Xuchao Zhang , Bo Zong , Yanchi Liu , Zhengzhang Chen , Dongjin Song , Haifeng Chen , Xiang Zhang

Recommendation system has been a widely studied task both in academia and industry. Previous works mainly focus on homogeneous recommendation and little progress has been made for heterogeneous recommender systems. However, heterogeneous…

Information Retrieval · Computer Science 2022-01-27 Chengqiang Lu , Mingyang Yin , Shuheng Shen , Luo Ji , Qi Liu , Hongxia Yang

Contrastive learning demonstrates great promise for representation learning. Data augmentations play a critical role in contrastive learning by providing informative views of the data without necessitating explicit labels. Nonetheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Zihu Wang , Yu Wang , Zhuotong Chen , Hanbin Hu , Peng Li

Recent advancements in generative recommendation systems, particularly in the realm of sequential recommendation tasks, have shown promise in enhancing generalization to new items. Among these approaches, diffusion-based generative…

Information Retrieval · Computer Science 2024-10-23 Guoqing Hu , Zhengyi Yang , Zhibo Cai , An Zhang , Xiang Wang

Over the past decade, recommender systems have experienced a surge in popularity. Despite notable progress, they grapple with challenging issues, such as high data dimensionality and sparseness. Representing users and items as…

Information Retrieval · Computer Science 2025-07-28 Pedro R. Pires , Tiago A. Almeida