English
Related papers

Related papers: Modular Domain Adaptation for Conformer-Based Stre…

200 papers

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Da Li , Timothy Hospedales

In many practical applications, it is often difficult and expensive to obtain large-scale labeled data to train state-of-the-art deep neural networks. Therefore, transferring the learned knowledge from a separate, labeled source domain to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Sicheng Zhao , Hui Chen , Hu Huang , Pengfei Xu , Guiguang Ding

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

Current state-of-the-art automatic speech recognition systems are trained to work in specific `domains', defined based on factors like application, sampling rate and codec. When such recognizers are used in conditions that do not match the…

Domain mismatch between training and testing can lead to significant degradation in performance in many machine learning scenarios. Unfortunately, this is not a rare situation for automatic speech recognition deployments in real-world…

Computation and Language · Computer Science 2017-09-25 Wei-Ning Hsu , Yu Zhang , James Glass

Multi-source Domain Adaptation (MDA) seeks to adapt models trained on data from multiple labeled source domains to perform effectively on an unlabeled target domain data, assuming access to sources data. To address the challenges of model…

Machine Learning · Computer Science 2024-08-20 Omar Ghannou , Younès Bennani

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Simulation-to-real domain adaptation for semantic segmentation has been actively studied for various applications such as autonomous driving. Existing methods mainly focus on a single-source setting, which cannot easily handle a more…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Sicheng Zhao , Bo Li , Xiangyu Yue , Yang Gu , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from various domains. However, fine-tuning all the parameters of the…

Computation and Language · Computer Science 2021-11-02 Rongsheng Zhang , Yinhe Zheng , Xiaoxi Mao , Minlie Huang

Although current face anti-spoofing methods achieve promising results under intra-dataset testing, they suffer from poor generalization to unseen attacks. Most existing works adopt domain adaptation (DA) or domain generalization (DG)…

Computer Vision and Pattern Recognition · Computer Science 2021-02-25 Jingjing Wang , Jingyi Zhang , Ying Bian , Youyi Cai , Chunmao Wang , Shiliang Pu

Most existing domain adaptation methods focus on adaptation from only one source domain, however, in practice there are a number of relevant sources that could be leveraged to help improve performance on target domain. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Ruihuang Li , Xu Jia , Jianzhong He , Shuaijun Chen , Qinghua Hu

Typically a classifier trained on a given dataset (source domain) does not performs well if it is tested on data acquired in a different setting (target domain). This is the problem that domain adaptation (DA) tries to overcome and, while…

Machine Learning · Computer Science 2018-08-01 Silvia Bucci , Mohammad Reza Loghmani , Barbara Caputo

In this paper, we propose two novel methods for domain adaptation for the attention-only neural machine translation (NMT) model, i.e., the Transformer. Our methods focus on training a single translation model for multiple domains by either…

Computation and Language · Computer Science 2019-06-21 Chenhui Chu , Raj Dabre

Multi-source domain adaptation (MSDA) plays an important role in industrial model generalization. Recent efforts on MSDA focus on enhancing multi-domain distributional alignment while omitting three issues, e.g., the class-level discrepancy…

Machine Learning · Computer Science 2024-12-24 Min Huang , Zifeng Xie , Bo Sun , Ning Wang

In real-world applications, speaker recognition models often face various domain-mismatch challenges, leading to a significant drop in performance. Although numerous domain adaptation techniques have been developed to address this issue,…

Sound · Computer Science 2023-09-26 Wan Lin , Lantian Li , Dong Wang

In real-life conditions, mismatch between development and test domain degrades speaker recognition performance. To solve the issue, many researchers explored domain adaptation approaches using matched in-domain dataset. However, adaptation…

Sound · Computer Science 2017-08-29 Suwon Shon , Seongkyu Mun , Wooil Kim , Hanseok Ko

We propose an adapter based multi-domain Transformer based language model (LM) for Transformer ASR. The model consists of a big size common LM and small size adapters. The model can perform multi-domain adaptation with only the small size…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-12 Taewoo Lee , Min-Joong Lee , Tae Gyoon Kang , Seokyeoung Jung , Minseok Kwon , Yeona Hong , Jungin Lee , Kyoung-Gu Woo , Ho-Gyeong Kim , Jiseung Jeong , Jihyun Lee , Hosik Lee , Young Sang Choi

One challenge of machine translation is how to quickly adapt to unseen domains in face of surging events like COVID-19, in which case timely and accurate translation of in-domain information into multiple languages is critical but little…

Computation and Language · Computer Science 2020-10-27 Mahdis Mahdieh , Mia Xu Chen , Yuan Cao , Orhan Firat

Multilingual neural machine translation models (MNMT) yield state-of-the-art performance when evaluated on data from a domain and language pair seen at training time. However, when a MNMT model is used to translate under domain shift or to…

Computation and Language · Computer Science 2022-10-24 Wen Lai , Alexandra Chronopoulou , Alexander Fraser

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

Computation and Language · Computer Science 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina