English
Related papers

Related papers: PADA: Pruning Assisted Domain Adaptation for Self-…

200 papers

Anomaly detection (AD) plays a vital role across a wide range of domains, but its performance might deteriorate when applied to target domains with limited data. Domain Adaptation (DA) offers a solution by transferring knowledge from a…

Machine Learning · Statistics 2025-08-12 Tran Tuan Kiet , Nguyen Thang Loi , Vo Nguyen Le Duy

Adapters are an efficient, composable alternative to full fine-tuning of pre-trained models and help scale the deployment of large ASR models to many tasks. In practice, a task ID is commonly prepended to the input during inference to route…

Computation and Language · Computer Science 2023-10-23 Hillary Ngai , Rohan Agrawal , Neeraj Gaur , Ronny Huang , Parisa Haghani , Pedro Moreno Mengibar

Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Wenlve Zhou , Zhiheng Zhou , Tianlei Wang , Delu Zeng

This work proposes a robust Partial Domain Adaptation (PDA) framework that mitigates the negative transfer problem by incorporating a robust target-supervision strategy. It leverages ensemble learning and includes diverse, complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen

Unsupervised Domain Adaptation (UDA) has attracted a lot of attention in the last ten years. The emergence of Domain Invariant Representations (IR) has improved drastically the transferability of representations from a labelled source…

Machine Learning · Computer Science 2020-06-25 Victor Bouvier , Philippe Very , Clément Chastagnol , Myriam Tami , Céline Hudelot

Adversarial training is a useful approach to promote the learning of transferable representations across the source and target domains, which has been widely applied for domain adaptation (DA) tasks based on deep neural networks. Until very…

Machine Learning · Computer Science 2020-03-31 Zeya Wang , Baoyu Jing , Yang Ni , Nanqing Dong , Pengtao Xie , Eric P. Xing

Natural Language Processing algorithms have made incredible progress, but they still struggle when applied to out-of-distribution examples. We address a challenging and underexplored version of this domain adaptation problem, where an…

Computation and Language · Computer Science 2022-01-28 Eyal Ben-David , Nadav Oved , Roi Reichart

Quality of deep convolutional neural network predictions strongly depends on the size of the training dataset and the quality of the annotations. Creating annotations, especially for 3D medical image segmentation, is time-consuming and…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Matin Hosseinzadeh , Anindo Saha , Joeran Bosma , Henkjan Huisman

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

The transcription quality of automatic speech recognition (ASR) systems degrades significantly when transcribing audios coming from unseen domains. We propose an unsupervised error correction method for unsupervised ASR domain adaption,…

Sound · Computer Science 2022-09-27 Long Mai , Julie Carson-Berndsen

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

As Large Language Models (LLMs) continue to scale, post-training pruning has emerged as a promising approach to reduce computational costs while preserving performance. Existing methods such as SparseGPT and Wanda achieve high sparsity…

Computation and Language · Computer Science 2026-01-15 Sai Varun Kodathala , Rakesh Vunnam

End-to-end automatic speech recognition often degrades on domain-specific data due to scarce in-domain resources. We propose a synthetic-data-based domain adaptation framework with two contributions: (1) a large language model (LLM)-based…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Natsuo Yamashita , Koichi Nagatsuka , Hiroaki Kokubo , Kota Dohi , Tuan Vu Ho

Deep pre-trained Transformer models have achieved state-of-the-art results over a variety of natural language processing (NLP) tasks. By learning rich language knowledge with millions of parameters, these models are usually…

Computation and Language · Computer Science 2020-11-10 Zhengyan Zhang , Fanchao Qi , Zhiyuan Liu , Qun Liu , Maosong Sun

Unsupervised domain adaptation (UDA) approaches focus on adapting models trained on a labeled source domain to an unlabeled target domain. UDA methods have a strong assumption that the source data is accessible during adaptation, which may…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Nazmul Karim , Niluthpol Chowdhury Mithun , Abhinav Rajvanshi , Han-pang Chiu , Supun Samarasekera , Nazanin Rahnavard

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

Sound · Computer Science 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Shujie Hu , Xurong Xie , Mengzhe Geng , Zengrui Jin , Jiajun Deng , Guinan Li , Yi Wang , Mingyu Cui , Tianzi Wang , Helen Meng , Xunying Liu

Semi-supervised domain adaptation (SSDA) aims at training a high-performance model for a target domain using few labeled target data, many unlabeled target data, and plenty of auxiliary data from a source domain. Previous works in SSDA…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Lingfei Deng , Changming Zhao , Zhenbang Du , Kun Xia , Dongrui Wu

Unsupervised Domain Adaptation (UDA) transfers predictive models from a fully-labeled source domain to an unlabeled target domain. In some applications, however, it is expensive even to collect labels in the source domain, making most…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Xiangyu Yue , Zangwei Zheng , Shanghang Zhang , Yang Gao , Trevor Darrell , Kurt Keutzer , Alberto Sangiovanni Vincentelli

We address the Unsupervised Domain Adaptation (UDA) problem in image classification from a new perspective. In contrast to most existing works which either align the data distributions or learn domain-invariant features, we directly learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Qian Wang , Fanlin Meng , Toby P. Breckon