English
Related papers

Related papers: Bayesian Learning of LF-MMI Trained Time Delay Neu…

200 papers

Recently, variational autoencoder (VAE), a deep representation learning (DRL) model, has been used to perform speech enhancement (SE). However, to the best of our knowledge, current VAE-based SE methods only apply VAE to the model speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-25 Yang Xiang , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Low-bit neural network…

Computation and Language · Computer Science 2021-12-22 Junhao Xu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Estimating the uncertainty of responses from Large Language Models (LLMs) remains a critical challenge. While recent Bayesian methods have demonstrated effectiveness in quantifying uncertainty through low-rank weight updates, they typically…

Machine Learning · Statistics 2025-09-29 Haizhou Shi , Yibin Wang , Ligong Han , Huan Zhang , Hao Wang

Speech dereverberation is an important stage in many speech technology applications. Recent work in this area has been dominated by deep neural network models. Temporal convolutional networks (TCNs) are deep learning models that have been…

Sound · Computer Science 2022-07-26 William Ravenscroft , Stefan Goetze , Thomas Hain

This paper considers the problem of learning the parameters in Bayesian networks of discrete variables with known structure and hidden variables. Previous approaches in these settings typically use expectation maximization; when the network…

Machine Learning · Computer Science 2013-09-27 Yonatan Halpern , David Sontag

In this work, we propose minimum Bayes risk (MBR) training of RNN-Transducer (RNN-T) for end-to-end speech recognition. Specifically, initialized with a RNN-T trained model, MBR training is conducted via minimizing the expected edit…

Computation and Language · Computer Science 2019-12-02 Chao Weng , Chengzhu Yu , Jia Cui , Chunlei Zhang , Dong Yu

Conventional time-delay neural networks (TDNNs) struggle to handle long-range context, their ability to represent speaker information is therefore limited in long utterances. Existing solutions either depend on increasing model complexity…

Sound · Computer Science 2023-08-02 Yangfu Li , Jiapan Gan , Xiaodan Lin

Beamforming has been extensively investigated for multi-channel audio processing tasks. Recently, learning-based beamforming methods, sometimes called \textit{neural beamformers}, have achieved significant improvements in both signal…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Yi Luo , Enea Ceolini , Cong Han , Shih-Chii Liu , Nima Mesgarani

Distant speech recognition is a challenge, particularly due to the corruption of speech signals by reverberation caused by large distances between the speaker and microphone. In order to cope with a wide range of reverberations in…

Computation and Language · Computer Science 2016-08-18 Jeehye Lee , Myungin Lee , Joon-Hyuk Chang

The identification of Linear Time-Varying (LTV) systems from input-output data is a fundamental yet challenging ill-posed inverse problem. This work introduces a unified Bayesian framework that models the system's impulse response, $h(t,…

Machine Learning · Statistics 2026-04-01 Yaniv Shulman

This paper presents a novel Dialect Identification (DID) system developed for the Fifth Edition of the Multi-Genre Broadcast challenge, the task of Fine-grained Arabic Dialect Identification (MGB-5 ADI Challenge). The system improves upon…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-20 Xiaoxiao Miao , Ian McLoughlin

In this paper we investigate the GMM-derived (GMMD) features for adaptation of deep neural network (DNN) acoustic models. The adaptation of the DNN trained on GMMD features is done through the maximum a posteriori (MAP) adaptation of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-17 Natalia Tomashenko , Yuri Khokhlov , Yannick Esteve

The Bidirectional LSTM (BLSTM) RNN based speech synthesis system is among the best parametric Text-to-Speech (TTS) systems in terms of the naturalness of generated speech, especially the naturalness in prosody. However, the model complexity…

Computation and Language · Computer Science 2018-02-27 Mengxiao Bi , Heng Lu , Shiliang Zhang , Ming Lei , Zhijie Yan

Speaker recognition performance has been greatly improved with the emergence of deep learning. Deep neural networks show the capacity to effectively deal with impacts of noise and reverberation, making them attractive to far-field speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Wenda Chen , Jonathan Huang , Tobias Bocklet

This paper proposes a sparse Bayesian treatment of deep neural networks (DNNs) for system identification. Although DNNs show impressive approximation ability in various fields, several challenges still exist for system identification…

Systems and Control · Electrical Eng. & Systems 2022-06-02 Hongpeng Zhou , Chahine Ibrahim , Wei Xing Zheng , Wei Pan

Bayesian neural networks (BNNs) offer uncertainty quantification but come with the downside of substantially increased training and inference costs. Sparse BNNs have been investigated for efficient inference, typically by either slowly…

Machine Learning · Computer Science 2024-02-20 Junbo Li , Zichen Miao , Qiang Qiu , Ruqi Zhang

So far, many of the deep learning approaches for voice conversion produce good quality speech by using a large amount of training data. This paper presents a Deep Bidirectional Long Short-Term Memory (DBLSTM) based voice conversion…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-27 Mingyang Zhang , Berrak Sisman , Sai Sirisha Rallabandi , Haizhou Li , Li Zhao

Recognition of overlapped speech has been a highly challenging task to date. State-of-the-art multi-channel speech separation system are becoming increasingly complex and expensive for practical applications. To this end, low-bit neural…

Sound · Computer Science 2021-11-30 Junhao Xu , Jianwei Yu , Xunying Liu , Helen Meng

Sequence-to-sequence models, such as attention-based models in automatic speech recognition (ASR), are typically trained to optimize the cross-entropy criterion which corresponds to improving the log-likelihood of the data. However, system…

Computation and Language · Computer Science 2017-12-06 Rohit Prabhavalkar , Tara N. Sainath , Yonghui Wu , Patrick Nguyen , Zhifeng Chen , Chung-Cheng Chiu , Anjuli Kannan

Bayesian HMM clustering of x-vector sequences (VBx) has become a widely adopted diarization baseline model in publications and challenges. It uses an HMM to model speaker turns, a generatively trained probabilistic linear discriminant…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-05 Dominik Klement , Mireia Diez , Federico Landini , Lukáš Burget , Anna Silnova , Marc Delcroix , Naohiro Tawara