English
Related papers

Related papers: Domain Generalization for Mammographic Image Analy…

200 papers

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Contrastive learning has achieved state-of-the-art performance in various self-supervised learning tasks and even outperforms its supervised counterpart. Despite its empirical success, theoretical understanding of the superiority of…

Machine Learning · Computer Science 2023-12-21 Wenlong Ji , Zhun Deng , Ryumei Nakada , James Zou , Linjun Zhang

Convolutional Neural Networks (CNNs) show impressive performance in the standard classification setting where training and testing data are drawn i.i.d. from a given domain. However, CNNs do not readily generalize to new domains with…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Nathan Somavarapu , Chih-Yao Ma , Zsolt Kira

Recently, we have witnessed great progress in the field of medical imaging classification by adopting deep neural networks. However, the recent advanced models still require accessing sufficiently large and representative datasets for…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Haoliang Li , YuFei Wang , Renjie Wan , Shiqi Wang , Tie-Qiang Li , Alex C. Kot

The generalization performance of deep learning models for medical image analysis often decreases on images collected with different devices for data acquisition, device settings, or patient population. A better understanding of the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Aleksandar Vakanski , Min Xian

In medical imaging, the heterogeneity of multi-centre data impedes the applicability of deep learning-based methods and results in significant performance degradation when applying models in an unseen data domain, e.g. a new centreor a new…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Hongwei Li , Timo Loehr , Anjany Sekuboyina , Jianguo Zhang , Benedikt Wiestler , Bjoern Menze

Several automatic approaches for objective music performance assessment (MPA) have been proposed in the past, however, existing systems are not yet capable of reliably predicting ratings with the same accuracy as professional judges. This…

Sound · Computer Science 2021-08-16 Pavan Seshadri , Alexander Lerch

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feihu Zhang , Vladlen Koltun , Philip Torr , René Ranftl , Stephan R. Richter

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haojin Deng , Yimin Yang

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Rongchang Xie , Fei Yu , Jiachao Wang , Yizhou Wang , Li Zhang

The insertion of deep learning in medical image analysis had lead to the development of state-of-the art strategies in several applications such a disease classification, as well as abnormality detection and segmentation. However, even the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Mauricio Orbes-Arteaga , Thomas Varsavsky , Lauge Sorensen , Mads Nielsen , Akshay Pai , Sebastien Ourselin , Marc Modat , M Jorge Cardoso

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Xiao Wang , Guo-Jun Qi

Learning deep neural networks that are generalizable across different domains remains a challenge due to the problem of domain shift. Unsupervised domain adaptation is a promising avenue which transfers knowledge from a source domain to a…

Machine Learning · Computer Science 2020-08-20 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

A key promise of AI applications in healthcare is in increasing access to quality medical care in under-served populations and emerging markets. However, deep learning models are often only trained on data from advantaged populations that…

Image and Video Processing · Electrical Eng. & Systems 2019-11-04 Kevin Wu , Eric Wu , Yaping Wu , Hongna Tan , Greg Sorensen , Meiyun Wang , Bill Lotter

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif