English
Related papers

Related papers: Cumulative Adaptation for BLSTM Acoustic Models

200 papers

We investigate the nonparametric bivariate additive regression estimation in the random design and long-memory errors and construct adaptive thresholding estimators based on wavelet series. The proposed approach achieves asymptotically…

Statistics Theory · Mathematics 2022-05-24 Rida Benhaddou , Qing Liu

Trans-dimensional random field language models (TRF LMs) where sentences are modeled as a collection of random fields, have shown close performance with LSTM LMs in speech recognition and are computationally more efficient in inference.…

Computation and Language · Computer Science 2017-10-31 Bin Wang , Zhijian Ou

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

Sound · Computer Science 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

One crucial challenge of real-world multilingual speech recognition is the long-tailed distribution problem, where some resource-rich languages like English have abundant training data, but a long tail of low-resource languages have varying…

Computation and Language · Computer Science 2020-12-04 Genta Indra Winata , Guangsen Wang , Caiming Xiong , Steven Hoi

In this paper we investigate the GMM-derived (GMMD) features for adaptation of deep neural network (DNN) acoustic models. The adaptation of the DNN trained on GMMD features is done through the maximum a posteriori (MAP) adaptation of the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-17 Natalia Tomashenko , Yuri Khokhlov , Yannick Esteve

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

This paper addresses the challenges of mining latent patterns and modeling contextual dependencies in complex sequence data. A sequence pattern mining algorithm is proposed by integrating Bidirectional Long Short-Term Memory (BiLSTM) with a…

Machine Learning · Computer Science 2025-04-22 Tao Yang , Yu Cheng , Yaokun Ren , Yujia Lou , Minggu Wei , Honghui Xin

Text-independent speaker recognition using short utterances is a highly challenging task due to the large variation and content mismatch between short utterances. I-vector based systems have become the standard in speaker verification…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-18 Jinxi Guo , Ning Xu , Kailun Qian , Yang Shi , Kaiyuan Xu , Yingnian Wu , Abeer Alwan

The learning of interpretable representations from raw data presents significant challenges for time series data like speech. In this work, we propose a relevance weighting scheme that allows the interpretation of the speech representations…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-05 Purvi Agrawal , Sriram Ganapathy

Multi-task learning (MTL) frameworks have proven to be effective in diverse speech related tasks like automatic speech recognition (ASR) and speech emotion recognition. This paper proposes a MTL framework to perform acoustic-to-articulatory…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-18 Yashish M. Siriwardena , Ganesh Sivaraman , Carol Espy-Wilson

This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2025 Simultaneous Speech Translation track. Our submission addresses the unique challenges of real-time translation of long-form speech…

Computation and Language · Computer Science 2025-06-24 Jorge Iranzo-Sánchez , Javier Iranzo-Sánchez , Adrià Giménez , Jorge Civera , Alfons Juan

Speech classification tasks often require powerful language understanding models to grasp useful features, which becomes problematic when limited training data is available. To attain superior classification performance, we propose to…

Computation and Language · Computer Science 2024-07-26 Nicolae-Catalin Ristea , Andrei Anghel , Radu Tudor Ionescu

The popular i-vector model represents speakers as low-dimensional continuous vectors (i-vectors), and hence it is a way of continuous speaker embedding. In this paper, we investigate binary speaker embedding, which transforms i-vectors to…

Sound · Computer Science 2016-04-01 Lantian Li , Dong Wang , Chao Xing , Kaimin Yu , Thomas Fang Zheng

We describe the latest improvements to the IBM English conversational telephone speech recognition system. Some of the techniques that were found beneficial are: maxout networks with annealed dropout rates; networks with a very large number…

Computation and Language · Computer Science 2015-05-25 George Saon , Hong-Kwang J. Kuo , Steven Rennie , Michael Picheny

Language models (LMs) based on Long Short Term Memory (LSTM) have shown good gains in many automatic speech recognition tasks. In this paper, we extend an LSTM by adding highway networks inside an LSTM and use the resulting Highway LSTM…

Computation and Language · Computer Science 2017-09-20 Gakuto Kurata , Bhuvana Ramabhadran , George Saon , Abhinav Sethy

Long short-term memory(LSTM) units on sequence-based models are being used in translation, question-answering systems, classification tasks due to their capability of learning long-term dependencies. In Natural language generation, LSTM…

Computation and Language · Computer Science 2020-05-04 Sivasurya Santhanam

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

Computation and Language · Computer Science 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

Connectionist Temporal Classification (CTC) models are popular for their balance between speed and performance for Automatic Speech Recognition (ASR). However, these CTC models still struggle in other areas, such as personalization towards…

Computation and Language · Computer Science 2023-07-04 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Sravan Bodapati

We present CALM, a joint Contextual Acoustic-Linguistic Modeling framework for multi-speaker automatic speech recognition (ASR). In personalized AI scenarios, the joint availability of acoustic and linguistic cues naturally motivates the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-14 Muhammad Shakeel , Yosuke Fukumoto , Chikara Maeda , Chyi-Jiunn Lin , Shinji Watanabe

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li