English
Related papers

Related papers: Learning Better Contrastive View from Radiologist'…

200 papers

Contrastive Learning (CL) enhances the training of sequential recommendation (SR) models through informative self-supervision signals. Existing methods often rely on data augmentation strategies to create positive samples and promote…

Information Retrieval · Computer Science 2026-04-06 Zhikai Wang , Yanyan Shen , Zexi Zhang , Li He , Yichun Li , Hao Gu , Yinghua Zhang

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Radio Frequency (RF) device fingerprinting has been recognized as a potential technology for enabling automated wireless device identification and classification. However, it faces a key challenge due to the domain shift that could arise…

Machine Learning · Computer Science 2024-03-08 Jun Chen , Weng-Keen Wong , Bechir Hamdaoui

Deep clustering has attracted increasing attention in recent years due to its capability of joint representation learning and clustering via deep neural networks. In its latest developments, the contrastive learning has emerged as an…

Machine Learning · Computer Science 2022-07-15 Xiaozhi Deng , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

As trustworthy AI continues to advance, the fairness issue in recommendations has received increasing attention. A recommender system is considered unfair when it produces unequal outcomes for different user groups based on user-sensitive…

Artificial Intelligence · Computer Science 2024-10-24 Wei Chen , Meng Yuan , Zhao Zhang , Ruobing Xie , Fuzhen Zhuang , Deqing Wang , Rui Liu

Magnetic resonance imaging (MRI) is crucial for enhancing diagnostic accuracy in clinical settings. However, the inherent long scan time of MRI restricts its widespread applicability. Deep learning-based image super-resolution (SR) methods…

Image and Video Processing · Electrical Eng. & Systems 2024-02-19 Hao Li , Quanwei Liu , Jianan Liu , Xiling Liu , Yanni Dong , Tao Huang , Zhihan Lv

Computer-aided X-ray pneumonia lesion recognition is important for accurate diagnosis of pneumonia. With the emergence of deep learning, the identification accuracy of pneumonia has been greatly improved, but there are still some challenges…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Xinxu Wei , Haohan Bai , Xianshi Zhang , Yongjie Li

Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder…

Computation and Language · Computer Science 2021-09-28 An Yan , Zexue He , Xing Lu , Jiang Du , Eric Chang , Amilcare Gentili , Julian McAuley , Chun-Nan Hsu

Preserving maximal information is one of principles of designing self-supervised learning methodologies. To reach this goal, contrastive learning adopts an implicit way which is contrasting image pairs. However, we believe it is not fully…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Hong-Yu Zhou , Chixiang Lu , Sibei Yang , Xiaoguang Han , Yizhou Yu

Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and rely on a large…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Mathilde Caron , Ishan Misra , Julien Mairal , Priya Goyal , Piotr Bojanowski , Armand Joulin

The central idea of contrastive learning is to discriminate between different instances and force different views from the same instance to share the same representation. To avoid trivial solutions, augmentation plays an important role in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Zhiwu Qing , Ziyuan Huang , Shiwei Zhang , Mingqian Tang , Changxin Gao , Marcelo H. Ang , Rong Jin , Nong Sang

Contrastive learning has been utilized as a promising self-supervised learning approach to extract meaningful representations from unlabeled data. The majority of these methods take advantage of data-augmentation techniques to create…

Machine Learning · Computer Science 2025-08-14 Han Yu , Huiyuan Yang , Akane Sano

Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a novel graph contrastive learning method named RoSA that focuses…

Machine Learning · Computer Science 2022-05-03 Yun Zhu , Jianhao Guo , Fei Wu , Siliang Tang

Detecting diseases from social media has diverse applications, such as public health monitoring and disease spread detection. While language models (LMs) have shown promising performance in this domain, there remains ongoing research aimed…

Computation and Language · Computer Science 2024-05-06 Pervaiz Iqbal Khan , Andreas Dengel , Sheraz Ahmed

Existing approaches for unsupervised metric learning focus on exploring self-supervision information within the input image itself. We observe that, when analyzing images, human eyes often compare images against each other instead of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Yang Li , Shichao Kan , Zhihai He

Contrastive learning relies on an assumption that positive pairs contain related views, e.g., patches of an image or co-occurring multimodal signals of a video, that share certain underlying information about an instance. But what if this…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Ching-Yao Chuang , R Devon Hjelm , Xin Wang , Vibhav Vineet , Neel Joshi , Antonio Torralba , Stefanie Jegelka , Yale Song

Contrastive learning has been used to learn a high-quality representation of the image in computer vision. However, contrastive learning is not widely utilized in natural language processing due to the lack of a general method of data…

Computation and Language · Computer Science 2021-04-29 Peng Su , Yifan Peng , K. Vijay-Shanker

In contrastive self-supervised learning, the common way to learn discriminative representation is to pull different augmented "views" of the same image closer while pushing all other images further apart, which has been proven to be…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kaiyou Song , Shan Zhang , Zihao An , Zimeng Luo , Tong Wang , Jin Xie

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang