English
Related papers

Related papers: Domain Adaptation via Teacher-Student Learning for…

200 papers

Automatic Speech Recognition (ASR) systems, despite large multilingual training, struggle in low-resource scenarios where labeled data is scarce. We propose BEARD (BEST-RQ Encoder Adaptation with Re-training and Distillation), a novel…

Computation and Language · Computer Science 2026-05-13 Raphaël Bagat , Irina Illina , Emmanuel Vincent

Recent advances in deep learning show that end-to-end speech to text translation model is a promising approach to direct the speech translation field. In this work, we provide an overview of different end-to-end architectures, as well as…

Computation and Language · Computer Science 2019-11-21 Parnia Bahar , Tobias Bieschke , Hermann Ney

Meta-learning has emerged as a trending technique to tackle few-shot text classification and achieved state-of-the-art performance. However, existing solutions heavily rely on the exploitation of lexical features and their distributional…

Computation and Language · Computer Science 2021-07-27 ChengCheng Han , Zeqiu Fan , Dongxiang Zhang , Minghui Qiu , Ming Gao , Aoying Zhou

While neural end-to-end text-to-speech (TTS) is superior to conventional statistical methods in many ways, the exposure bias problem in the autoregressive models remains an issue to be resolved. The exposure bias problem arises from the…

Computation and Language · Computer Science 2020-02-21 Rui Liu , Berrak Sisman , Jingdong Li , Feilong Bao , Guanglai Gao , Haizhou Li

Optical character recognition remains critical infrastructure for document digitization, yet state-of-the-art performance is often restricted to well-resourced institutions by prohibitive computational barriers. End-to-end transformer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Arundhathi Dev , Justin Zhan

We address the problem of unsupervised domain adaptation (UDA) by learning a cross-domain agnostic embedding space, where the distance between the probability distributions of the two source and target visual domains is minimized. We use…

Machine Learning · Computer Science 2019-09-25 Alex Gabourie , Mohammad Rostami , Philip Pope , Soheil Kolouri , Kyungnam Kim

Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yanan Wu , Zhixiang Chi , Yang Wang , Konstantinos N. Plataniotis , Songhe Feng

Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Manish Sahu , Anirban Mukhopadhyay , Stefan Zachow

Recently, end-to-end (E2E) models, which allow to take spectral vector sequences of L2 (second-language) learners' utterances as input and produce the corresponding phone-level sequences as output, have attracted much research attention in…

Sound · Computer Science 2021-10-19 Tien-Hong Lo , Yao-Ting Sung , Berlin Chen

In this paper we investigate the use of adversarial domain adaptation for addressing the problem of language mismatch between speaker recognition corpora. In the context of speaker verification, adversarial domain adaptation methods aim at…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-07 Johan Rohdin , Themos Stafylakis , Anna Silnova , Hossein Zeinali , Lukas Burget , Oldrich Plchot

End-to-end models have achieved impressive results on the task of automatic speech recognition (ASR). For low-resource ASR tasks, however, labeled data can hardly satisfy the demand of end-to-end models. Self-supervised acoustic…

Computation and Language · Computer Science 2021-05-12 Cheng Yi , Shiyu Zhou , Bo Xu

We aim to improve the performance of regressing hand keypoints and segmenting pixel-level hand masks under new imaging conditions (e.g., outdoors) when we only have labeled images taken under very different conditions (e.g., indoors). In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Takehiko Ohkawa , Yu-Jhe Li , Qichen Fu , Ryosuke Furuta , Kris M. Kitani , Yoichi Sato

Distantly-Supervised Named Entity Recognition (DS-NER) effectively alleviates the data scarcity problem in NER by automatically generating training samples. Unfortunately, the distant supervision may induce noisy labels, thus undermining…

Computation and Language · Computer Science 2022-12-14 Xiaoye Qu , Jun Zeng , Daizong Liu , Zhefeng Wang , Baoxing Huai , Pan Zhou

Self-training is a competitive approach in domain adaptive segmentation, which trains the network with the pseudo labels on the target domain. However inevitably, the pseudo labels are noisy and the target features are dispersed due to the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Yong Wang , Fang Wen

Point cloud-based medical registration promises increased computational efficiency, robustness to intensity shifts, and anonymity preservation but is limited by the inefficacy of unsupervised learning with similarity metrics. Supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Alexander Bigalke , Mattias P. Heinrich

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

The external language models (LM) integration remains a challenging task for end-to-end (E2E) automatic speech recognition (ASR) which has no clear division between acoustic and language models. In this work, we propose an internal LM…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Zhong Meng , Sarangarajan Parthasarathy , Eric Sun , Yashesh Gaur , Naoyuki Kanda , Liang Lu , Xie Chen , Rui Zhao , Jinyu Li , Yifan Gong

Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily require large amounts…

Machine Learning · Computer Science 2021-10-13 Shuai Yang , Kui Yu , Fuyuan Cao , Lin Liu , Hao Wang , Jiuyong Li

An end-to-end (e2e) text-to-speech (TTS) system is a deep architecture that learns to associate a text string with acoustic speech patterns from a curated dataset. It is expected that all aspects associated with speech production, such as…

Sound · Computer Science 2026-02-17 Parth Khadse , Sunil Kumar Kopparapu

Deep learning models have shown great promise in diverse remote sensing applications. However, they often struggle to generalize across geographic regions unseen during training due to domain shifts. Domain shifts occur when data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sofiane Bouaziz , Adel Hafiane , Raphael Canals , Rachid Nedjai