中文
相关论文

相关论文: Bridging Contrastive Learning and Domain Adaptatio…

200 篇论文

Deep convolutional neural networks have considerably improved state-of-the-art results for semantic segmentation. Nevertheless, even modern architectures lack the ability to generalize well to a test dataset that originates from a different…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Robert A. Marsden , Alexander Bartler , Mario Döbler , Bin Yang

In this work, we propose CLUDA, a simple, yet novel method for performing unsupervised domain adaptation (UDA) for semantic segmentation by incorporating contrastive losses into a student-teacher learning paradigm, that makes use of…

计算机视觉与模式识别 · 计算机科学 2022-11-09 Midhun Vayyat , Jaswin Kasi , Anuraag Bhattacharya , Shuaib Ahmed , Rahul Tallamraju

Recent literature in self-supervised has demonstrated significant progress in closing the gap between supervised and unsupervised methods in the image and text domains. These methods rely on domain-specific augmentations that are not…

机器学习 · 计算机科学 2021-09-02 Sajad Darabi , Shayan Fazeli , Ali Pazoki , Sriram Sankararaman , Majid Sarrafzadeh

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Contrastive learning has shown impressive success in enhancing feature discriminability for various visual tasks in a self-supervised manner, but the standard contrastive paradigm (features+$\ell_{2}$ normalization) has limited benefits…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Junjie Li , Yixin Zhang , Zilei Wang , Saihui Hou , Keyu Tu , Man Zhang

Contrastive learning is a major studied topic in metric learning. However, sampling effective contrastive pairs remains a challenge due to factors such as limited batch size, imbalanced data distribution, and the risk of overfitting. In…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Bolun Cai , Pengfei Xiong , Shangxuan Tian

Domain adaptation (DA) aims to transfer knowledge from a label-rich source domain to a related but label-scarce target domain. The conventional DA strategy is to align the feature distributions of the two domains. Recently, increasing…

计算机视觉与模式识别 · 计算机科学 2022-03-08 Yixin Zhang , Junjie Li , Zilei Wang

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haojin Deng , Yimin Yang

Despite its empirical success, the theoretical foundations of self-supervised contrastive learning (CL) are not yet fully established. In this work, we address this gap by showing that standard CL objectives implicitly approximate a…

机器学习 · 计算机科学 2025-11-12 Achleshwar Luthra , Tianbao Yang , Tomer Galanti

We present a novel unsupervised domain adaptation method for semantic segmentation that generalizes a model trained with source images and corresponding ground-truth labels to a target domain. A key to domain adaptive semantic segmentation…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Geon Lee , Chanho Eom , Wonkyung Lee , Hyekang Park , Bumsub Ham

Self-supervised learning is a growing paradigm in deep representation learning, showing great generalization capabilities and competitive performance in low-labeled data regimes. The SimCLR framework proposes the NT-Xent loss for…

机器学习 · 计算机科学 2022-05-09 Wilhelm Ågren

State-of-the-art object detection methods applied to satellite and drone imagery largely fail to identify small and dense objects. One reason is the high variability of content in the overhead imagery due to the terrestrial region captured…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Debojyoti Biswas , Jelena Tešić

In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant…

机器学习 · 计算机科学 2024-02-12 Kecheng Chen , Elena Gal , Hong Yan , Haoliang Li

Lesion detection is a fundamental problem in the computer-aided diagnosis scheme for mammography. The advance of deep learning techniques have made a remarkable progress for this task, provided that the training data are large and…

图像与视频处理 · 电气工程与系统科学 2021-11-23 Zheren Li , Zhiming Cui , Sheng Wang , Yuji Qi , Xi Ouyang , Qitian Chen , Yuezhi Yang , Zhong Xue , Dinggang Shen , Jie-Zhi Cheng

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the…

机器学习 · 计算机科学 2020-07-03 Wei Wang , Haojie Li , Zhengming Ding , Zhihui Wang

Self-supervised learning (SSL) has recently become the favorite among feature learning methodologies. It is therefore appealing for domain adaptation approaches to consider incorporating SSL. The intuition is to enforce instance-level…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Yang Chen , Yingwei Pan , Yu Wang , Ting Yao , Xinmei Tian , Tao Mei

Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a fully-labeled source domain to a different unlabeled target domain. Most existing UDA methods learn domain-invariant feature representations by minimizing…

计算机视觉与模式识别 · 计算机科学 2022-05-10 Rui Wang , Zuxuan Wu , Zejia Weng , Jingjing Chen , Guo-Jun Qi , Yu-Gang Jiang

Object detectors often suffer from the domain gap between training (source domain) and real-world applications (target domain). Mean-teacher self-training is a powerful paradigm in unsupervised domain adaptation for object detection, but it…

计算机视觉与模式识别 · 计算机科学 2023-05-05 Shengcao Cao , Dhiraj Joshi , Liang-Yan Gui , Yu-Xiong Wang

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

计算机视觉与模式识别 · 计算机科学 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

In the presence of large sets of labeled data, Deep Learning (DL) has accomplished extraordinary triumphs in the avenue of computer vision, particularly in object classification and recognition tasks. However, DL cannot always perform well…

计算机视觉与模式识别 · 计算机科学 2019-01-03 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan