English
Related papers

Related papers: CleanMel: Mel-Spectrogram Enhancement for Improvin…

200 papers

This paper presents the details of the SRIB-LEAP submission to the ConferencingSpeech challenge 2021. The challenge involved the task of multi-channel speech enhancement to improve the quality of far field speech from microphone arrays in a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-25 R G Prithvi Raj , Rohit Kumar , M K Jayesh , Anurenjan Purushothaman , Sriram Ganapathy , M A Basha Shaik

This paper introduces a cepstrum-based pitch modification method that can be applied to any mel-spectrogram representation. As a result, this method is compatible with any mel-based vocoder without requiring any additional training or…

Speech super-resolution (SR) is a task to increase speech sampling rate by generating high-frequency components. Existing speech SR methods are trained in constrained experimental settings, such as a fixed upsampling ratio. These strong…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Haohe Liu , Woosung Choi , Xubo Liu , Qiuqiang Kong , Qiao Tian , DeLiang Wang

In this paper, the Lingban entry to the third 'CHiME' speech separation and recognition challenge is presented. A time-frequency masking based speech enhancement front-end is proposed to suppress the environmental noise utilizing…

Sound · Computer Science 2015-09-25 Zaihu Pang , Fengyun Zhu

Feature-mapping with deep neural networks is commonly used for single-channel speech enhancement, in which a feature-mapping network directly transforms the noisy features to the corresponding enhanced ones and is trained to minimize the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-01 Zhong Meng , Jinyu Li , Yifan Gong , Biing-Hwang , Juang

We present a novel source separation model to decompose asingle-channel speech signal into two speech segments belonging to two different speakers. The proposed model is a neural network based on residual blocks, and uses learnt speaker…

Sound · Computer Science 2019-06-25 Shuo Liu , Gil Keren , Björn Schuller

While contemporary speech separation technologies adeptly process lengthy mixed audio waveforms, they are frequently challenged by the intricacies of real-world environments, including noisy and reverberant settings, which can result in…

Sound · Computer Science 2025-05-27 Zhaoxi Mu , Xinyu Yang , Gang Wang

Single-word Automatic Speech Recognition (ASR) is a challenging task due to the lack of linguistic context and sensitivity to noise, pronunciation variation, and channel artifacts, especially in low-resource, communication-critical domains…

Sound · Computer Science 2026-01-30 Manali Sharma , Riya Naik , Buvaneshwari G

Speech enhancement improves speech quality and promotes the performance of various downstream tasks. However, most current speech enhancement work was mainly devoted to improving the performance of downstream automatic speech recognition…

Sound · Computer Science 2022-09-16 Jianrong Wang , Xiaomin Li , Xuewei Li , Mei Yu , Qiang Fang , Li Liu

Using neural network based acoustic frontends for improving robustness of streaming automatic speech recognition (ASR) systems is challenging because of the causality constraints and the resulting distortion that the frontend processing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Arun Narayanan , James Walker , Sankaran Panchapagesan , Nathan Howard , Yuma Koizumi

Singing voice separation (SVS) is a task that separates singing voice audio from its mixture with instrumental audio. Previous SVS studies have mainly employed the spectrogram masking method which requires a large dimensionality in…

Sound · Computer Science 2022-11-30 Jaekwon Im , Soonbeom Choi , Sangeon Yong , Juhan Nam

Despite the rapid advance of automatic speech recognition (ASR) technologies, accurate recognition of cocktail party speech characterised by the interference from overlapping speakers, background noise and room reverberation remains a…

Sound · Computer Science 2022-04-11 Guinan Li , Jianwei Yu , Jiajun Deng , Xunying Liu , Helen Meng

In this paper, we present a reverberation removal approach for speaker verification, utilizing dual-label deep neural networks (DNNs). The networks perform feature mapping between the spectral features of reverberant and clean speech. Long…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-12 Hao Zhang , Stephen Zahorian , Xiao Chen , Peter Guzewich , Xiaoyu Liu

Recently, deep learning-based generative models have been introduced to generate singing voices. One approach is to predict the parametric vocoder features consisting of explicit speech parameters. This approach has the advantage that the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Tae-Woo Kim , Min-Su Kang , Gyeong-Hoon Lee

With the surge of online meetings, it has become more critical than ever to provide high-quality speech audio and live captioning under various noise conditions. However, most monaural speech enhancement (SE) models introduce processing…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-08 Sefik Emre Eskimez , Xiaofei Wang , Min Tang , Hemin Yang , Zirun Zhu , Zhuo Chen , Huaming Wang , Takuya Yoshioka

Extracting features from the speech is the most critical process in speech signal processing. Mel Frequency Cepstral Coefficients (MFCC) are the most widely used features in the majority of the speaker and speech recognition applications,…

Sound · Computer Science 2025-10-31 Rinku Sebastian , Simon O'Keefe , Martin Trefzer

Adding visual cues to audio-based speech separation can improve separation performance. This paper introduces AV-CrossNet, an audiovisual (AV) system for speech enhancement, target speaker extraction, and multi-talker speaker separation.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Vahid Ahmadi Kalkhorani , Cheng Yu , Anurag Kumar , Ke Tan , Buye Xu , DeLiang Wang

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and…

Computation and Language · Computer Science 2024-08-13 Wonjun Lee , San Kim , Gary Geunbae Lee

ASR systems designed for native English (L1) usually underperform on non-native English (L2). To address this performance gap, \textbf{(i)} we extend our previous work to investigate fine-tuning of a pre-trained wav2vec 2.0 model…

Computation and Language · Computer Science 2022-02-11 Peter Sullivan , Toshiko Shibano , Muhammad Abdul-Mageed

This paper proposes an efficient attempt to noisy speech emotion recognition (NSER). Conventional NSER approaches have proven effective in mitigating the impact of artificial noise sources, such as white Gaussian noise, but are limited to…

Sound · Computer Science 2026-01-13 Xiaohan Shi , Jiajun He , Xingfeng Li , Tomoki Toda