English
Related papers

Related papers: Self-Supervised Contrastive BERT Fine-tuning for F…

200 papers

Music retrieval and recommendation applications often rely on content features encoded as embeddings, which provide vector representations of items in a music dataset. Numerous complementary embeddings can be derived from processing items…

Information Retrieval · Computer Science 2023-08-15 Andres Ferraro , Jaehun Kim , Sergio Oramas , Andreas Ehmann , Fabien Gouyon

Pretrained language models such as BERT, GPT have shown great effectiveness in language understanding. The auxiliary predictive tasks in existing pretraining approaches are mostly defined on tokens, thus may not be able to capture…

Computation and Language · Computer Science 2020-06-19 Hongchao Fang , Sicheng Wang , Meng Zhou , Jiayuan Ding , Pengtao Xie

Sequential Recommendation (SR) learns user preferences from their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most items exhibit sparse interactions, known as the tail-item problem. This…

Information Retrieval · Computer Science 2026-04-07 Zhifu Wei , Yizhou Dang , Guibing Guo , Chuang Zhao , Zhu Sun

Person re-identification (ReID) aims at searching the same identity person among images captured by various cameras. Unsupervised person ReID attracts a lot of attention recently, due to it works without intensive manual annotation and thus…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Bo Pang , Deming Zhai , Junjun Jiang , Xianming Liu

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

The rapid proliferation of digital content and the ever-growing need for precise object recognition and segmentation have driven the advancement of cutting-edge techniques in the field of object classification and segmentation. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

Conversational recommender systems (CRS) aim to recommend suitable items to users through natural language conversations. For developing effective CRSs, a major technical issue is how to accurately infer user preference from very limited…

Computation and Language · Computer Science 2023-05-31 Yuanhang Zhou , Kun Zhou , Wayne Xin Zhao , Cheng Wang , Peng Jiang , He Hu

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Multilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages. We present an effective method to train multilingual IR systems when only English IR training data and some parallel…

Information Retrieval · Computer Science 2023-05-29 Xiyang Hu , Xinchi Chen , Peng Qi , Deguang Kong , Kunlun Liu , William Yang Wang , Zhiheng Huang

Along with the exponential growth of online platforms and services, recommendation systems have become essential for identifying relevant items based on user preferences. The domain of sequential recommendation aims to capture evolving user…

Information Retrieval · Computer Science 2023-07-12 Jung Hyun Ryu , Jaeheyoung Jeon , Jewoong Cho , Myungjoo Kang 1

Generative retrieval constitutes an innovative approach in information retrieval, leveraging generative language models (LM) to generate a ranked list of document identifiers (docid) for a given query. It simplifies the retrieval pipeline…

Information Retrieval · Computer Science 2025-02-13 Penghao Lu , Xin Dong , Yuansheng Zhou , Lei Cheng , Chuan Yuan , Linjian Mo

In the era of big data and Artificial Intelligence, an emerging paradigm is to utilize contrastive self-supervised learning to model large-scale heterogeneous data. Many existing foundation models benefit from the generalization capability…

Machine Learning · Computer Science 2024-04-02 Lecheng Zheng , Baoyu Jing , Zihao Li , Hanghang Tong , Jingrui He

Pre-trained model such as BERT has been proved to be an effective tool for dealing with Information Retrieval (IR) problems. Due to its inspiring performance, it has been widely used to tackle with real-world IR problems such as document…

Information Retrieval · Computer Science 2021-09-15 Ruizhi Pu , Xinyu Zhang , Ruofei Lai , Zikai Guo , Yinxia Zhang , Hao Jiang , Yongkang Wu , Yantao Jia , Zhicheng Dou , Zhao Cao

Although large-scale pretrained language models, such as BERT and RoBERTa, have achieved superhuman performance on in-distribution test sets, their performance suffers on out-of-distribution test sets (e.g., on contrast sets). Building…

Computation and Language · Computer Science 2020-11-13 Chuanrong Li , Lin Shengshuo , Leo Z. Liu , Xinyi Wu , Xuhui Zhou , Shane Steinert-Threlkeld

Feature fusion is a commonly used strategy in image retrieval tasks, which aggregates the matching responses of multiple visual features. Feasible sets of features can be either descriptors (SIFT, HSV) for an entire image or the same…

Information Retrieval · Computer Science 2018-11-01 Zhongdao Wang , Liang Zheng , Shengjin Wang

In modern e-commerce search systems, dense retrieval has become an indispensable component. By computing similarities between query and item (product) embeddings, it efficiently selects candidate products from large-scale repositories. With…

Information Retrieval · Computer Science 2025-10-20 Jianting Tang , Dongshuai Li , Tao Wen , Fuyu Lv , Dan Ou , Linli Xu

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Recommender systems and search are both indispensable in facilitating personalization and ease of browsing in online fashion platforms. However, the two tools often operate independently, failing to combine the strengths of recommender…

Information Retrieval · Computer Science 2022-07-26 Karin Sevegnani , Arjun Seshadri , Tian Wang , Anurag Beniwal , Julian McAuley , Alan Lu , Gerard Medioni

This paper presents a solution to the challenges faced by contrastive learning in sequential recommendation systems. In particular, it addresses the issue of false negative, which limits the effectiveness of recommendation algorithms. By…

Information Retrieval · Computer Science 2023-07-12 Jaeheyoung Jeon , Jung Hyun Ryu , Jewoong Cho , Myungjoo Kang

Most modern recommender systems predict users preferences with two components: user and item embedding learning, followed by the user-item interaction modeling. By utilizing the auxiliary review information accompanied with user ratings,…

Information Retrieval · Computer Science 2022-05-17 Jie Shuai , Kun Zhang , Le Wu , Peijie Sun , Richang Hong , Meng Wang , Yong Li