English
Related papers

Related papers: Prototype and Instance Contrastive Learning for Un…

200 papers

In this paper, we propose a simple but powerful unsupervised learning method for speaker recognition, namely Contrastive Equilibrium Learning (CEL), which increases the uncertainty on nuisance factors latent in the embeddings by employing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Sung Hwan Mun , Woo Hyun Kang , Min Hyun Han , Nam Soo Kim

Sound source localization aims to localize objects emitting the sound in visual scenes. Recent works obtaining impressive results typically rely on contrastive learning. However, the common practice of randomly sampling negatives in prior…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zengjie Song , Jiangshe Zhang , Yuxi Wang , Junsong Fan , Zhaoxiang Zhang

Domain adaptive semantic segmentation aims to learn a model with the supervision of source domain data, and produce satisfactory dense predictions on unlabeled target domain. One popular solution to this challenging task is self-training,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Ruihuang Li , Shuai Li , Chenhang He , Yabin Zhang , Xu Jia , Lei Zhang

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent IDA methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Xiaona Sun , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

This paper proposes a novel pixel-level distribution regularization scheme (DRSL) for self-supervised domain adaptation of semantic segmentation. In a typical setting, the classification loss forces the semantic segmentation model to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Javed Iqbal , Hamza Rawal , Rehan Hafiz , Yu-Tseh Chi , Mohsen Ali

Massive rumors usually appear along with breaking news or trending topics, seriously hindering the truth. Existing rumor detection methods are mostly focused on the same domain, and thus have poor performance in cross-domain scenarios due…

Social and Information Networks · Computer Science 2023-03-22 Hongyan Ran , Caiyan Jia

Semantic segmentation models struggle to generalize in the presence of domain shift. In this paper, we introduce contrastive learning for feature alignment in cross-domain adaptation. We assemble both in-domain contrastive pairs and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feihu Zhang , Vladlen Koltun , Philip Torr , René Ranftl , Stephan R. Richter

Deep neural networks have been widely studied in autonomous driving applications such as semantic segmentation or depth estimation. However, training a neural network in a supervised manner requires a large amount of annotated labels which…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Dongseok Shim , H. Jin Kim

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Domain Adaptation methodologies have shown to effectively generalize from a labeled source domain to a label scarce target domain. Previous research has either focused on unlabeled domain adaptation without any target supervision or…

Machine Learning · Computer Science 2022-02-14 Jonas Sonntag , Gunnar Behrens , Lars Schmidt-Thieme

Domain adaptive object re-ID aims to transfer the learned knowledge from the labeled source domain to the unlabeled target domain to tackle the open-class re-identification problems. Although state-of-the-art pseudo-label-based methods have…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Yixiao Ge , Feng Zhu , Dapeng Chen , Rui Zhao , Hongsheng Li

Unsupervised domain adaption (UDA) aims to adapt models learned from a well-annotated source domain to a target domain, where only unlabeled samples are given. Current UDA approaches learn domain-invariant features by aligning source and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Chunjiang Ge , Rui Huang , Mixue Xie , Zihang Lai , Shiji Song , Shuang Li , Gao Huang

Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize CSL with a loss…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Shentong Mo , Zhun Sun , Chao Li

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu

Self-supervised learning (SSL) has drawn an increased attention in the field of speech processing. Recent studies have demonstrated that contrastive learning is able to learn discriminative speaker embeddings in a self-supervised manner.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Chunlei Zhang , Dong Yu

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

Machine Learning · Computer Science 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao