中文
相关论文

相关论文: Self-Supervised Contrastive BERT Fine-tuning for F…

200 篇论文

In recent years, self-supervised contrastive learning has emerged as a distinguished paradigm in the artificial intelligence landscape. It facilitates unsupervised feature learning through contrastive delineations at the instance level.…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Jiansong Zhang , Linlin Shen , Peizhong Liu

Side information fusion for sequential recommendation (SR) aims to effectively leverage various side information to enhance the performance of next-item prediction. Most state-of-the-art methods build on self-attention networks and focus on…

信息检索 · 计算机科学 2022-04-26 Yueqi Xie , Peilin Zhou , Sunghun Kim

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

机器学习 · 计算机科学 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Online shopping stores have grown steadily over the past few years. Due to the massive growth of these businesses, the detection of fake reviews has attracted attention. Fake reviews are seriously trying to mislead customers and thereby…

计算与语言 · 计算机科学 2023-01-10 Abrar Qadir Mir , Furqan Yaqub Khan , Mohammad Ahsan Chishti

In information retrieval, training reranking models mainly focuses on two types of objectives: metric learning (e.g. contrastive loss to increase the predicted scores on relevant query-document pairs) and classification (binary label…

计算与语言 · 计算机科学 2025-10-17 Ziqi Dai , Xin Zhang , Mingxin Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang , Wenjie Li , Min Zhang

Word embeddings, made widely popular in 2013 with the release of word2vec, have become a mainstay of NLP engineering pipelines. Recently, with the release of BERT, word embeddings have moved from the term-based embedding space to the…

信息检索 · 计算机科学 2022-02-17 Arthur Câmara , Claudia Hauff

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image given a reference image and a relative text, without relying on costly triplet annotations. Existing CLIP-based methods face two core challenges: (1) union-based…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Yuqi Xiao , Yingying Zhu

Cross-language pre-trained models such as multilingual BERT (mBERT) have achieved significant performance in various cross-lingual downstream NLP tasks. This paper proposes a multi-level contrastive learning (ML-CTL) framework to further…

计算与语言 · 计算机科学 2022-03-01 Beiduo Chen , Wu Guo , Bin Gu , Quan Liu , Yongchao Wang

Information retrieval (IR) for precision medicine (PM) often involves looking for multiple pieces of evidence that characterize a patient case. This typically includes at least the name of a condition and a genetic variation that applies to…

计算与语言 · 计算机科学 2020-12-18 Jiho Noh , Ramakanth Kavuluru

This extended abstract introduces Self-Explaining Contrastive Evidence Re-Ranking (CER), a novel method that restructures retrieval around factual evidence by fine-tuning embeddings with contrastive learning and generating token-level…

计算与语言 · 计算机科学 2025-12-05 Francielle Vargas , Daniel Pedronette

Fine-grained remote sensing datasets often use hierarchical label structures to differentiate objects in a coarse-to-fine manner, with each object annotated across multiple levels. However, embedding this semantic hierarchy into the…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Jingzhou Chen , Dexin Chen , Fengchao Xiong , Yuntao Qian , Liang Xiao

For an image query, unsupervised contrastive learning labels crops of the same image as positives, and other image crops as negatives. Although intuitive, such a native label assignment strategy cannot reveal the underlying semantic…

计算机视觉与模式识别 · 计算机科学 2021-06-29 Pan Zhou , Caiming Xiong , Xiao-Tong Yuan , Steven Hoi

Unsupervised sentence embedding aims to obtain the most appropriate embedding for a sentence to reflect its semantic. Contrastive learning has been attracting developing attention. For a sentence, current models utilize diverse data…

计算与语言 · 计算机科学 2022-03-03 Hao Wang , Yangguang Li , Zhen Huang , Yong Dou , Lingpeng Kong , Jing Shao

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

信息检索 · 计算机科学 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Text embedding models play a crucial role in natural language processing, particularly in information retrieval, and their importance is further highlighted with the recent utilization of RAG (Retrieval- Augmented Generation). This study…

信息检索 · 计算机科学 2024-12-24 Jeongsu Yu

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

机器学习 · 计算机科学 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Contextual ranking models have delivered impressive performance improvements over classical models in the document ranking task. However, these highly over-parameterized models tend to be data-hungry and require large amounts of data even…

信息检索 · 计算机科学 2022-07-08 Abhijit Anand , Jurek Leonhardt , Koustav Rudra , Avishek Anand