English
Related papers

Related papers: ConVerSum: A Contrastive Learning-based Approach f…

200 papers

Large Language Models (LLMs) have achieved remarkable success in Natural Language Processing (NLP), yet their cross-lingual performance consistency remains a significant challenge. This paper introduces a novel methodology for efficiently…

Computation and Language · Computer Science 2025-05-27 Zixiang Xu , Yanbo Wang , Yue Huang , Xiuying Chen , Jieyu Zhao , Meng Jiang , Xiangliang Zhang

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Cross-lingual summarization aims to bridge language barriers by summarizing documents in different languages. However, ensuring semantic coherence across languages is an overlooked challenge and can be critical in several contexts. To fill…

Computation and Language · Computer Science 2024-10-02 Diogo Pernes , Gonçalo M. Correia , Afonso Mendes

Phrase-level dense retrieval has shown many appealing characteristics in downstream NLP tasks by leveraging the fine-grained information that phrases offer. In our work, we propose a new task formulation of dense retrieval, cross-lingual…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Deng Cai , Zhi Qu , Qu Cui , Hidetaka Kamigaito , Lemao Liu , Taro Watanabe

Contrastive graph node clustering via learnable data augmentation is a hot research spot in the field of unsupervised graph learning. The existing methods learn the sampling distribution of a pre-defined augmentation to generate data-driven…

Machine Learning · Computer Science 2023-10-23 Xihong Yang , Cheng Tan , Yue Liu , Ke Liang , Siwei Wang , Sihang Zhou , Jun Xia , Stan Z. Li , Xinwang Liu , En Zhu

In recent years, Contrastive Learning (CL) has become a predominant representation learning paradigm for time series. Most existing methods manually build specific CL Strategies (CLS) by human heuristics for certain datasets and tasks.…

Machine Learning · Computer Science 2024-10-24 Baoyu Jing , Yansen Wang , Guoxin Sui , Jing Hong , Jingrui He , Yuqing Yang , Dongsheng Li , Kan Ren

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

Citation graphs can be helpful in generating high-quality summaries of scientific papers, where references of a scientific paper and their correlations can provide additional knowledge for contextualising its background and main…

Information Retrieval · Computer Science 2023-02-24 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

After pre-training on extensive image-text pairs, Contrastive Language-Image Pre-training (CLIP) demonstrates promising performance on a wide variety of benchmarks. However, a substantial volume of multimodal interleaved documents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tiancheng Gu , Kaicheng Yang , Chaoyi Zhang , Yin Xie , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai , Jiankang Deng

Text-video retrieval aims to find the most semantically similar videos with given text queries. However, since videos contain more diverse content than texts, the main semantics expressed by each text-video pair is often partially relevant.…

Information Retrieval · Computer Science 2026-05-19 Xiaolun Jing , Xinxing Yang , Genke Yang

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives high-quality sentence…

Computation and Language · Computer Science 2023-05-29 Jiduan Liu , Jiahao Liu , Qifan Wang , Jingang Wang , Wei Wu , Yunsen Xian , Dongyan Zhao , Kai Chen , Rui Yan

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existing pipelines often…

Information Retrieval · Computer Science 2025-11-25 Roksana Goworek , Olivia Macmillan-Scott , Eda B. Özyiğit

Self-supervised sentence representation learning is the task of constructing an embedding space for sentences without relying on human annotation efforts. One straightforward approach is to finetune a pretrained language model (PLM) with a…

Recently, various contrastive learning techniques have been developed to categorize time series data and exhibit promising performance. A general paradigm is to utilize appropriate augmentations and construct feasible positive samples such…

Machine Learning · Computer Science 2024-10-11 Qianying Ren , Dongsheng Luo , Dongjin Song

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Recent advances in Large Language Models (LLMs) have stimulated a surge of research aimed at extending their applications to the visual domain. While these models exhibit promise in generating abstract image captions and facilitating…

Computation and Language · Computer Science 2023-10-27 Geewook Kim , Hodong Lee , Daehee Kim , Haeji Jung , Sanghee Park , Yoonsik Kim , Sangdoo Yun , Taeho Kil , Bado Lee , Seunghyun Park

News summarization in today's global scene can be daunting with its flood of multilingual content and varied viewpoints from different sources. However, current studies often neglect such real-world scenarios as they tend to focus solely on…

Computation and Language · Computer Science 2024-10-08 Yangfan Ye , Xiachong Feng , Xiaocheng Feng , Weitao Ma , Libo Qin , Dongliang Xu , Qing Yang , Hongtao Liu , Bing Qin

Text summarization is a fundamental task in natural language processing (NLP), and the information explosion has made long-document processing increasingly demanding, making summarization essential. Existing research mainly focuses on model…