English
Related papers

Related papers: F-T-LSTM based Complex Network for Joint Acoustic …

200 papers

Audio Sentiment Analysis is a popular research area which extends the conventional text-based sentiment analysis to depend on the effectiveness of acoustic features extracted from speech. However, current progress on audio sentiment…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-01 Feiyang Chen , Ziqian Luo

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

We present a comprehensive study of deep bidirectional long short-term memory (LSTM) recurrent neural network (RNN) based acoustic models for automatic speech recognition (ASR). We study the effect of size and depth and train models of up…

Neural and Evolutionary Computing · Computer Science 2019-08-06 Albert Zeyer , Patrick Doetsch , Paul Voigtlaender , Ralf Schlüter , Hermann Ney

This paper describes a Two-step Band-split Neural Network (TBNN) approach for full-band acoustic echo cancellation. Specifically, after linear filtering, we split the full-band signal into wide-band (16KHz) and high-band (16-48KHz) for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Zihan Zhang , Shimin Zhang , Mingshuai Liu , Yanhong Leng , Zhe Han , Li Chen , Lei Xie

Long short-term memory (LSTM) is normally used in recurrent neural network (RNN) as basic recurrent unit. However,conventional LSTM assumes that the state at current time step depends on previous time step. This assumption constraints the…

Machine Learning · Computer Science 2017-11-01 Fei Tao , Gang Liu

We propose FSB-LSTM, a novel long short-term memory (LSTM) based architecture that integrates full- and sub-band (FSB) modeling, for single- and multi-channel speech enhancement in the short-time Fourier transform (STFT) domain. The model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Zhong-Qiu Wang , Samuele Cornell , Shukjae Choi , Younglo Lee , Byeong-Yeol Kim , Shinji Watanabe

Deep complex convolution recurrent network (DCCRN), which extends CRN with complex structure, has achieved superior performance in MOS evaluation in Interspeech 2020 deep noise suppression challenge (DNS2020). This paper further extends…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Shubo Lv , Yanxin Hu , Shimin Zhang , Lei Xie

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

Speech quality and intelligibility are significantly degraded in noisy environments. This paper presents a novel transformer-based learning framework to address the single-channel noise suppression problem for real-time applications.…

Sound · Computer Science 2025-11-18 Behnaz Bahmei , Siamak Arzanpour , Elina Birmingham

Speech enhancement (SE) methods mainly focus on recovering clean speech from noisy input. In real-world speech communication, however, noises often exist in not only speaker but also listener environments. Although SE methods can suppress…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Haoyu Li , Yun Liu , Junichi Yamagishi

Multimodal Large Language Models (MLLMs) excel in Open-Vocabulary (OV) emotion recognition but often neglect fine-grained acoustic modeling. Existing methods typically use global audio encoders, failing to capture subtle, local temporal…

Multimedia · Computer Science 2026-03-24 Liyun Zhang , Xuanmeng Sha , Shuqiong Wu , Fengkai Liu

The early detection of potential failures in industrial machinery components is paramount for ensuring the reliability and safety of operations, thereby preserving Machine Condition Monitoring (MCM). This research addresses this imperative…

Sound · Computer Science 2024-10-28 Sahan Dissanayaka , Manjusri Wickramasinghe , Pasindu Marasinghe

This paper introduces an innovative method for reducing the computational complexity of deep neural networks in real-time speech enhancement on resource-constrained devices. The proposed approach utilizes a two-stage processing framework,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Shrishti Saha Shetu , Soumitro Chakrabarty , Oliver Thiergart , Edwin Mabande

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Using neural network based acoustic frontends for improving robustness of streaming automatic speech recognition (ASR) systems is challenging because of the causality constraints and the resulting distortion that the frontend processing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Arun Narayanan , James Walker , Sankaran Panchapagesan , Nathan Howard , Yuma Koizumi

Deep learning based techniques have been popularly adopted in acoustic echo cancellation (AEC). Utilization of speaker representation has extended the frontier of AEC, thus attracting many researchers' interest in personalized acoustic echo…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Zihan Zhang , Jiayao Sun , Xianjun Xia , Ziqian Wang , Xiaopeng Yan , Yijian Xiao , Lei Xie

In this work, we describe a novel method of training an embedding-matching word-level connectionist temporal classification (CTC) automatic speech recognizer (ASR) such that it directly produces word start times and durations, required by…

Computation and Language · Computer Science 2023-06-21 Woojay Jeon

This paper proposes a low algorithmic latency adaptation of the deep clustering approach to speaker-independent speech separation. It consists of three parts: a) the usage of long-short-term-memory (LSTM) networks instead of their…

Sound · Computer Science 2019-02-20 Shanshan Wang , Gaurav Naithani , Tuomas Virtanen

We investigate the effectiveness of using a large ensemble of advanced neural language models (NLMs) for lattice rescoring on automatic speech recognition (ASR) hypotheses. Previous studies have reported the effectiveness of combining a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Atsunori Ogawa , Naohiro Tawara , Marc Delcroix , Shoko Araki

Majority of the recent approaches for text-independent speaker recognition apply attention or similar techniques for aggregation of frame-level feature descriptors generated by a deep neural network (DNN) front-end. In this paper, we…

Sound · Computer Science 2019-10-22 Sarthak Yadav , Atul Rai