English
Related papers

Related papers: Semantic-aware Contrastive Learning for More Accur…

200 papers

Unsupervised sentence representation learning is one of the fundamental problems in natural language processing with various downstream applications. Recently, contrastive learning has been widely adopted which derives high-quality sentence…

Computation and Language · Computer Science 2023-05-29 Jiduan Liu , Jiahao Liu , Qifan Wang , Jingang Wang , Wei Wu , Yunsen Xian , Dongyan Zhao , Kai Chen , Rui Yan

Despite great improvements in semantic segmentation, challenges persist because of the lack of local/global contexts and the relationship between them. In this paper, we propose Contextrast, a contrastive learning-based semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Changki Sung , Wanhee Kim , Jungho An , Wooju Lee , Hyungtae Lim , Hyun Myung

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Extracting image semantics effectively and assigning corresponding labels to multiple objects or attributes for natural images is challenging due to the complex scene contents and confusing label dependencies. Recent works have focused on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Leilei Ma , Dengdi Sun , Lei Wang , Haifeng Zhao , Bin Luo

To overcome the data-hungry challenge, we have proposed a semi-supervised contrastive learning framework for the task of class-imbalanced semantic segmentation. First and foremost, to make the model operate in a semi-supervised manner, we…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Kangcheng Liu

Graph-level contrastive learning, aiming to learn the representations for each graph by contrasting two augmented graphs, has attracted considerable attention. Previous studies usually simply assume that a graph and its augmented graph as a…

Artificial Intelligence · Computer Science 2024-04-15 Yanbei Liu , Yu Zhao , Xiao Wang , Lei Geng , Zhitao Xiao

Contrastive learning has achieved remarkable success in learning effective representations, with supervised contrastive learning often outperforming self-supervised approaches. However, in real-world scenarios, data annotations are often…

Machine Learning · Computer Science 2025-05-29 Zi-Hao Zhou , Jun-Jie Wang , Tong Wei , Min-Ling Zhang

Contrastive Analysis is a sub-field of Representation Learning that aims at separating common factors of variation between two datasets, a background (i.e., healthy subjects) and a target (i.e., diseased subjects), from the salient factors…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Robin Louiset , Edouard Duchesnay , Antoine Grigis , Pietro Gori

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

Low-light image enhancement (LLE) remains challenging due to the unfavorable prevailing low-contrast and weak-visibility problems of single RGB images. In this paper, we respond to the intriguing learning-related question -- if leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Dong Liang , Ling Li , Mingqiang Wei , Shuo Yang , Liyan Zhang , Wenhan Yang , Yun Du , Huiyu Zhou

Contrastive learning models have achieved great success in unsupervised visual representation learning, which maximize the similarities between feature representations of different views of the same image, while minimize the similarities…

Computation and Language · Computer Science 2022-01-13 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei

Pretrained multilingual language models (LMs) can be successfully transformed into multilingual sentence encoders (SEs; e.g., LaBSE, xMPNet) via additional fine-tuning or model distillation with parallel data. However, it remains unclear…

Computation and Language · Computer Science 2022-10-14 Ivan Vulić , Goran Glavaš , Fangyu Liu , Nigel Collier , Edoardo Maria Ponti , Anna Korhonen

Automatic medical question summarization can significantly help the system to understand consumer health questions and retrieve correct answers. The Seq2Seq model based on maximum likelihood estimation (MLE) has been applied in this task,…

Computation and Language · Computer Science 2023-02-15 Ming Zhang , Shuai Dou , Ziyang Wang , Yunfang Wu

Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails…

Computation and Language · Computer Science 2024-03-12 Ming Zhang , Ke Chang , Yunfang Wu

Identifying semantically equivalent sentences is important for many cross-lingual and mono-lingual NLP tasks. Current approaches to semantic equivalence take a loose, sentence-level approach to "equivalence," despite previous evidence that…

Computation and Language · Computer Science 2022-10-07 Shira Wein , Zhuxin Wang , Nathan Schneider

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt…

Information Retrieval · Computer Science 2025-12-23 Ziqiang Cui , Yunpeng Weng , Xing Tang , Xiaokun Zhang , Shiwei Li , Peiyang Liu , Bowei He , Dugang Liu , Weihong Luo , Xiuqiang He , Chen Ma

The contextual information is critical for various computer vision tasks, previous works commonly design plug-and-play modules and structural losses to effectively extract and aggregate the global context. These methods utilize fine-label…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Jing Wang , Jiangyun Li , Wei Li , Lingfei Xuan , Tianxiang Zhang , Wenxuan Wang