English
Related papers

Related papers: DABS: A Domain-Agnostic Benchmark for Self-Supervi…

200 papers

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

Computation and Language · Computer Science 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Unsupervised domain adaptation for semantic segmentation (DASS) aims to transfer knowledge from a label-rich source domain to a target domain with no labels. Two key approaches in DASS are (1) vision-only approaches using masking or…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chang Liu , Bavesh Balaji , Saad Hossain , C Thomas , Kwei-Herng Lai , Raviteja Vemulapalli , Alexander Wong , Sirisha Rambhatla

The paradigm of training models on massive data without label through self-supervised learning (SSL) and finetuning on many downstream tasks has become a trend recently. However, due to the high training costs and the unconsciousness of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qing Chang , Junran Peng , Lingxie Xie , Jiajun Sun , Haoran Yin , Qi Tian , Zhaoxiang Zhang

Deep learning-based object detectors have shown remarkable improvements. However, supervised learning-based methods perform poorly when the train data and the test data have different distributions. To address the issue, domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Seunghyeon Kim , Jaehoon Choi , Taekyung Kim , Changick Kim

Supervised deep learning requires massive labeled datasets, but obtaining annotations is not always easy or possible, especially for dense tasks like semantic segmentation. To overcome this issue, numerous works explore Unsupervised Domain…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Daniel Morales-Brotons , Grigorios Chrysos , Stratis Tzoumas , Volkan Cevher

By using deep learning approaches, Speech Emotion Recog-nition (SER) on a single domain has achieved many excellentresults. However, cross-domain SER is still a challenging taskdue to the distribution shift between source and target…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-22 Xiong Cai , Zhiyong Wu , Kuo Zhong , Bin Su , Dongyang Dai , Helen Meng

Both limited annotation and domain shift are significant challenges frequently encountered in medical image segmentation, leading to derivative scenarios like semi-supervised medical (SSMIS), semi-supervised medical domain generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Wei Li , Pengcheng Zhou , Linye Ma , Wenyi Zhao , Huihua Yang , Yuchen Guo

Recent progress of self-supervised visual representation learning has achieved remarkable success on many challenging computer vision benchmarks. However, whether these techniques can be used for domain adaptation has not been explored. In…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Jiaolong Xu , Liang Xiao , Antonio M. Lopez

Self-supervised learning excels in learning representations from large amounts of unlabeled data, demonstrating success across multiple data modalities. Yet, extending self-supervised learning to new modalities is non-trivial because the…

Machine Learning · Computer Science 2024-02-23 Johnathan Xie , Yoonho Lee , Annie S. Chen , Chelsea Finn

Recently, self-supervised metric learning has raised attention for the potential to learn a generic distance function. It overcomes the limitations of conventional supervised one, e.g., scalability and label biases. Despite progress in this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Jiantao Wu , Shentong Mo , Sara Atito , Josef Kittler , Zhenhua Feng , Muhammad Awais

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and…

Data cleaning is a long-standing challenge in data management. While powerful logic and statistical algorithms have been developed to detect and repair data errors in tables, existing algorithms predominantly rely on domain-experts to first…

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Da Li , Timothy Hospedales

We extend semi-supervised learning to the problem of domain adaptation to learn significantly higher-accuracy models that train on one data distribution and test on a different one. With the goal of generality, we introduce AdaMatch, a…

Machine Learning · Computer Science 2022-03-16 David Berthelot , Rebecca Roelofs , Kihyuk Sohn , Nicholas Carlini , Alex Kurakin

This paper addresses unsupervised domain adaptation, the setting where labeled training data is available on a source domain, but the goal is to have good performance on a target domain with only unlabeled data. Like much of previous work,…

Machine Learning · Computer Science 2019-10-01 Yu Sun , Eric Tzeng , Trevor Darrell , Alexei A. Efros

Dynamic Algorithm Configuration (DAC) aims to dynamically control a target algorithm's hyperparameters in order to improve its performance. Several theoretical and empirical results have demonstrated the benefits of dynamically controlling…

Artificial Intelligence · Computer Science 2021-12-07 Theresa Eimer , André Biedenkapp , Maximilian Reimer , Steven Adriaensen , Frank Hutter , Marius Lindauer

Data labeling in supervised learning is considered an expensive and infeasible tool in some conditions. The self-supervised learning method is proposed to tackle the learning effectiveness with fewer labeled data, however, there is a lack…

Machine Learning · Computer Science 2021-08-18 Hilal AlQuabeh , Ameera Bawazeer , Abdulateef Alhashmi

The label-embedded dictionary learning (DL) algorithms generate influential dictionaries by introducing discriminative information. However, there exists a limitation: All the label-embedded DL methods rely on the labels due that this way…

Machine Learning · Computer Science 2021-12-06 Shuai Shao , Lei Xing , Wei Yu , Rui Xu , Yanjiang Wang , Baodi Liu

Despite their effectiveness, current deep learning models face challenges with images coming from different domains with varying appearance and content. We introduce SegCLR, a versatile framework designed to segment images across different…

Image and Video Processing · Electrical Eng. & Systems 2025-04-15 Alvaro Gomariz , Yusuke Kikuchi , Yun Yvonna Li , Thomas Albrecht , Andreas Maunz , Daniela Ferrara , Huanxiang Lu , Orcun Goksel

Supervised deep learning algorithms have enabled significant performance gains in medical image classification tasks. But these methods rely on large labeled datasets that require resource-intensive expert annotation. Semi-supervised…