English
Related papers

Related papers: Speech-enhanced and Noise-aware Networks for Robus…

200 papers

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

Sound · Computer Science 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

Speech enhancement (SE) is crucial for reliable communication devices or robust speech recognition systems. Although conventional artificial neural networks (ANN) have demonstrated remarkable performance in SE, they require significant…

Sound · Computer Science 2023-07-28 Abir Riahi , Éric Plourde

In this paper, we propose a transformer-based architecture, called two-stage transformer neural network (TSTNN) for end-to-end speech denoising in the time domain. The proposed model is composed of an encoder, a two-stage transformer module…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-19 Kai Wang , Bengbeng He , Wei-Ping Zhu

Modern speech enhancement algorithms achieve remarkable noise suppression by means of large recurrent neural networks (RNNs). However, large RNNs limit practical deployment in hearing aid hardware (HW) form-factors, which are battery…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-15 Igor Fedorov , Marko Stamenovic , Carl Jensen , Li-Chia Yang , Ari Mandell , Yiming Gan , Matthew Mattina , Paul N. Whatmough

Perceptually-inspired objective functions such as the perceptual evaluation of speech quality (PESQ), signal-to-distortion ratio (SDR), and short-time objective intelligibility (STOI), have recently been used to optimize performance of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-27 Khandokar Md. Nayem , Donald S. Williamson

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

For enhancement of noisy speech, a method of threshold determination based on modeling of Teager energy (TE) operated perceptual wavelet packet (PWP) coefficients of the noisy speech by exponential distribution is presented. A custom…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-19 Md Tauhidul Islam , Celia Shahnaz , Wei-Ping Zhu , M. Omair Ahmad

Estimating noise information exactly is crucial for noise aware training in speech applications including speech enhancement (SE) which is our focus in this paper. To estimate noise-only frames, we employ voice activity detection (VAD) to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Joohyung Lee , Youngmoon Jung , Myunghun Jung , Hoirin Kim

In recent research, in the domain of speech processing, large End-to-End (E2E) systems for Automatic Speech Recognition (ASR) have reported state-of-the-art performance on various benchmarks. These systems intrinsically learn how to handle…

Computation and Language · Computer Science 2023-09-06 Patrick Eickhoff , Matthias Möller , Theresa Pekarek Rosin , Johannes Twiefel , Stefan Wermter

A new whole-sentence language model - neural trans-dimensional random field language model (neural TRF LM), where sentences are modeled as a collection of random fields, and the potential function is defined by a neural network, has been…

Computation and Language · Computer Science 2018-07-04 Bin Wang , Zhijian Ou

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

Sound · Computer Science 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Andrea Faúndez Quezada , Salvatore La Cavera , Sidahmed A Abayzeed

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

While machine learning techniques are traditionally resource intensive, we are currently witnessing an increased interest in hardware and energy efficient approaches. This need for resource-efficient machine learning is primarily driven by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-23 Lukas Pfeifenberger , Matthias Zöhrer , Günther Schindler , Wolfgang Roth , Holger Fröning , Franz Pernkopf

Recently, several types of end-to-end speech recognition methods named transformer-transducer were introduced. According to those kinds of methods, transcription networks are generally modeled by transformer-based neural networks, while…

Machine Learning · Computer Science 2020-11-03 Jae-Jin Jeon , Eesung Kim

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

Automatic speech recognition (ASR) tasks are resolved by end-to-end deep learning models, which benefits us by less preparation of raw data, and easier transformation between languages. We propose a novel end-to-end deep learning model…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Xinpei Zhou , Jiwei Li , Xi Zhou

Recent advances in self-supervised learning (SSL) on Transformers have significantly improved speaker verification (SV) by providing domain-general speech representations. However, existing approaches have underutilized the multi-layered…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-16 Jin Sob Kim , Hyun Joon Park , Wooseok Shin , Juan Yun , Sung Won Han

We explore the possibility of leveraging accelerometer data to perform speech enhancement in very noisy conditions. Although it is possible to only partially reconstruct user's speech from the accelerometer, the latter provides a strong…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-02 Marco Tagliasacchi , Yunpeng Li , Karolis Misiunas , Dominik Roblek