English
Related papers

Related papers: Adaptive hybrid speech coding with a MLP LPC struc…

200 papers

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

Sound · Computer Science 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Speech model adaptation is crucial to handle the discrepancy between server-side proxy training data and actual data received on local devices of users. With the use of federated learning (FL), we introduce an efficient approach on…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Zhe Liu , Ke Li , Shreyan Bakshi , Fuchun Peng

Single-channel speech enhancement (SE) is an important task in speech processing. A widely used framework combines an analysis/synthesis filterbank with a mask prediction network, such as the Conv-TasNet architecture. In such systems, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-06 Yuma Koizumi , Shigeki Karita , Scott Wisdom , Hakan Erdogan , John R. Hershey , Llion Jones , Michiel Bacchiani

Model compression has become an emerging need as the sizes of modern speech systems rapidly increase. In this paper, we study model weight quantization, which directly reduces the memory footprint to accommodate computationally…

Personalized speech enhancement (PSE) methods typically rely on pre-trained speaker verification models or self-designed speaker encoders to extract target speaker clues, guiding the PSE model in isolating the desired speech. However, these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Ziling Huang , Haixin Guan , Haoran Wei , Yanhua Long

This paper proposes a novel approach for speech signal prediction based on a recurrent neural network (RNN). Unlike existing RNN-based predictors, which operate on parametric features and are trained offline on a large collection of such…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-17 Reza Lotfidereshgi , Philippe Gournay

Machine recognition of an atypical speech like whispered speech, is a challenging task. We introduce whisper-to-natural-speech conversion using sequence-to-sequence approach by proposing enhanced transformer architecture, which uses both…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Abhishek Niranjan , Mukesh Sharma , Sai Bharath Chandra Gutha , M Ali Basha Shaik

Convolutional neural networks (CNN) and Transformer have wildly succeeded in multimedia applications. However, more effort needs to be made to harmonize these two architectures effectively to satisfy speech enhancement. This paper aims to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Xinmeng Xu , Weiping Tu , Yuhong Yang

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication reliability over…

Information Theory · Computer Science 2023-06-09 Junghoon Kim , Taejoon Kim , David Love , Christopher Brinton

Transformers are among the state of the art for many tasks in speech, vision, and natural language processing, among others. Self-attentions, which are crucial contributors to this performance have quadratic computational complexity, which…

Computation and Language · Computer Science 2022-12-21 Roshan Sharma , Bhiksha Raj

Automatic speech recognition systems usually rely on spectral-based features, such as MFCC of PLP. These features are extracted based on prior knowledge such as, speech perception or/and speech production. Recently, convolutional neural…

Machine Learning · Computer Science 2015-04-17 Dimitri Palaz , Mathew Magimai Doss , Ronan Collobert

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

Speaker adaptive training (SAT) of neural network acoustic models learns models in a way that makes them more suitable for adaptation to test conditions. Conventionally, model-based speaker adaptive training is performed by having a set of…

Computation and Language · Computer Science 2019-10-24 Ondřej Klejch , Joachim Fainberg , Peter Bell , Steve Renals

Speech enhancement (SE) models advance rapidly, yet it remains underexplored how degradation of input signals affects their internal representations. We introduce a probing process, aimed at modeling the behavior of internal representations…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-05 Yair Amar , Amir Ivry , Israel Cohen

Unsupervised cross-lingual speech representation learning (XLSR) has recently shown promising results in speech recognition by leveraging vast amounts of unlabeled data across multiple languages. However, standard XLSR model suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-10 Yizhou Lu , Mingkun Huang , Xinghua Qu , Pengfei Wei , Zejun Ma

We discuss the performance of Low-Density-Parity-Check (LDPC) codes decoded by means of Linear Programming (LP) at moderate and large Signal-to-Noise-Ratios (SNR). Utilizing a combination of the previously introduced pseudo-codeword-search…

Information Theory · Computer Science 2007-07-13 Michael Chertkov , Mikhail Stepanov

An algorithm is proposed to encode low-density parity-check (LDPC) codes into codewords with a non-uniform distribution. This enables power-efficient signalling for asymmetric channels. We show gains of 0.9 dB for additive white Gaussian…

Information Theory · Computer Science 2023-05-24 Thomas Wiegart , Linfang Wang , Diego Lentner , Richard D. Wesel

Self-supervised learning (SSL) is a powerful technique for learning representations from unlabeled data. Transformer based models such as HuBERT, which consist a feature extractor and transformer layers, are leading the field in the speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-23 Zih-Ching Chen , Yu-Shun Sung , Hung-yi Lee

Building a good speech recognition system usually requires large amounts of transcribed data, which is expensive to collect. To tackle this problem, many unsupervised pre-training methods have been proposed. Among these methods, Masked…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-24 Dongwei Jiang , Wubo Li , Ruixiong Zhang , Miao Cao , Ne Luo , Yang Han , Wei Zou , Xiangang Li

Neural network language model (NNLM) plays an essential role in automatic speech recognition (ASR) systems, especially in adaptation tasks when text-only data is available. In practice, an NNLM is typically trained on a combination of data…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-11 Yingyi Ma , Zhe Liu , Xuedong Zhang