English
Related papers

Related papers: Domain Expansion in DNN-based Acoustic Models for …

200 papers

Although deep neural networks have achieved remarkable results for the task of semantic segmentation, they usually fail to generalize towards new domains, especially when performing synthetic-to-real adaptation. Such domain shift is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Adriano Cardace , Pierluigi Zama Ramirez , Samuele Salti , Luigi Di Stefano

Current work in named entity recognition (NER) shows that data augmentation techniques can produce more robust models. However, most existing techniques focus on augmenting in-domain data in low-resource scenarios where annotated data is…

Computation and Language · Computer Science 2021-09-07 Shuguang Chen , Gustavo Aguilar , Leonardo Neves , Thamar Solorio

While ongoing advancements in Large Language Models have demonstrated remarkable success across various NLP tasks, Retrieval Augmented Generation Model stands out to be highly effective on downstream applications like Question Answering.…

Computation and Language · Computer Science 2024-10-24 Salman Rakin , Md. A. R. Shibly , Zahin M. Hossain , Zeeshan Khan , Md. Mostofa Akbar

Teacher-student (T/S) has shown to be effective for domain adaptation of deep neural network acoustic models in hybrid speech recognition systems. In this work, we extend the T/S learning to large-scale unsupervised domain adaptation of an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-08 Zhong Meng , Jinyu Li , Yashesh Gaur , Yifan Gong

In recent years, deep learning has significantly advanced sound source localization (SSL). However, training such models requires large labeled datasets, and real recordings are costly to annotate in particular if sources move. While…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-17 Bingxiang Zhong , Thomas Dietzen

Disordered speech recognition is a highly challenging task. The underlying neuro-motor conditions of people with speech disorders, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large…

Sound · Computer Science 2022-01-20 Mengzhe Geng , Xurong Xie , Shansong Liu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily require large amounts…

Machine Learning · Computer Science 2021-10-13 Shuai Yang , Kui Yu , Fuyuan Cao , Lin Liu , Hao Wang , Jiuyong Li

End-to-end automatic speech recognition suffers from adaptation to unknown target domain speech despite being trained with a large amount of paired audio--text data. Recent studies estimate a linguistic bias of the model as the internal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Emiru Tsunoo , Yosuke Kashiwagi , Chaitanya Narisetty , Shinji Watanabe

We propose data and knowledge-driven approaches for multilingual training of the automated speech recognition (ASR) system for a target language by pooling speech data from multiple source languages. Exploiting the acoustic similarities…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 A. Madhavaraj , Ramakrishnan Angarai Ganesan

With the acceleration of globalization, more and more people are willing or required to learn second languages (L2). One of the major remaining challenges facing current mispronunciation and diagnosis (MDD) models for use in…

Multimedia · Computer Science 2021-10-05 Shao-Wei Fan Jiang , Bi-Cheng Yan , Tien-Hong Lo , Fu-An Chao , Berlin Chen

In speech enhancement, complex neural network has shown promising performance due to their effectiveness in processing complex-valued spectrum. Most of the recent speech enhancement approaches mainly focus on wide-band signal with a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Shubo Lv , Yihui Fu , Mengtao Xing , Jiayao Sun , Lei Xie , Jun Huang , Yannan Wang , Tao Yu

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

Recent advance in Dense Retrieval (DR) techniques has significantly improved the effectiveness of first-stage retrieval. Trained with large-scale supervised data, DR models can encode queries and documents into a low-dimensional dense space…

Information Retrieval · Computer Science 2022-08-18 Jingtao Zhan , Qingyao Ai , Yiqun Liu , Jiaxin Mao , Xiaohui Xie , Min Zhang , Shaoping Ma

Domain adaptation deals with adapting behaviour of machine learning based systems trained using samples in source domain to their deployment in target domain where the statistics of samples in both domains are dissimilar. The task of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Abhijit Guha Roy , Debdoot Sheet

Most recent self-supervised learning methods learn visual representation by contrasting different augmented views of images. Compared with supervised learning, more aggressive augmentations have been introduced to further improve the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Yingbin Bai , Erkun Yang , Zhaoqing Wang , Yuxuan Du , Bo Han , Cheng Deng , Dadong Wang , Tongliang Liu

Dialect variation hampers automatic recognition of bird calls collected by passive acoustic monitoring. We address the problem on DB3V, a three-region, ten-species corpus of 8-s clips, and propose a deployable framework built on Time-Delay…

Sound · Computer Science 2025-09-29 Jiani Ding , Qiyang Sun , Alican Akman , Björn W. Schuller

We present an approach to reduce the performance disparity between geographic regions without degrading performance on the overall user population for ASR. A popular approach is to fine-tune the model with data from regions where the ASR…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-09 Viet Anh Trinh , Pegah Ghahremani , Brian King , Jasha Droppo , Andreas Stolcke , Roland Maas

Continual learning, the ability of a model to learn over time without forgetting previous knowledge and, therefore, be adaptive to new data, is paramount in dynamic fields such as disease outbreak prediction. Deep neural networks, i.e.,…

Machine Learning · Computer Science 2024-01-18 Saba Aslam , Abdur Rasool , Hongyan Wu , Xiaoli Li

Speaker adaptive training (SAT) of neural network acoustic models learns models in a way that makes them more suitable for adaptation to test conditions. Conventionally, model-based speaker adaptive training is performed by having a set of…

Computation and Language · Computer Science 2019-10-24 Ondřej Klejch , Joachim Fainberg , Peter Bell , Steve Renals