English
Related papers

Related papers: DENT-DDSP: Data-efficient noisy speech generator u…

200 papers

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

Sound · Computer Science 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

Although deep learning (DL) has achieved notable progress in speech enhancement (SE), further research is still required for a DL-based SE system to adapt effectively and efficiently to particular speakers. In this study, we propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-11 Cheng Yu , Szu-Wei Fu , Tsun-An Hsieh , Yu Tsao , Mirco Ravanelli

Dysarthric speech reconstruction (DSR) typically employs a cascaded system that combines automatic speech recognition (ASR) and sentence-level text-to-speech (TTS) to convert dysarthric speech into normally-prosodied speech. However,…

Sound · Computer Science 2026-03-03 Minghui Wu , Haitao Tang , Jiahuan Fan , Ruizhi Liao , Yanyong Zhang

Speech enhancement (SE) is usually required as a front end to improve the speech quality in noisy environments, while the enhanced speech might not be optimal for automatic speech recognition (ASR) systems due to speech distortion. On the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-27 Qiu-Shi Zhu , Jie Zhang , Zi-Qiang Zhang , Li-Rong Dai

A judicious combination of dictionary learning methods, block sparsity and source recovery algorithm are used in a hierarchical manner to identify the noises and the speakers from a noisy conversation between two people. Conversations are…

Sound · Computer Science 2016-10-31 K V Vijay Girish , A G Ramakrishnan , T V Ananthapadmanabha

Improving the accuracy of single-channel automatic speech recognition (ASR) in noisy conditions is challenging. Strong speech enhancement front-ends are available, however, they typically require that the ASR model is retrained to cope with…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-10 Catalin Zorila , Rama Doddipatla

Spoken named entity recognition (NER) aims to identify named entities from speech, playing an important role in speech processing. New named entities appear every day, however, annotating their Spoken NER data is costly. In this paper, we…

Computation and Language · Computer Science 2024-12-30 Jiawei Yu , Xiang Geng , Yuang Li , Mengxin Ren , Wei Tang , Jiahuan Li , Zhibin Lan , Min Zhang , Hao Yang , Shujian Huang , Jinsong Su

State-of-the-art Automatic Speech Recognition (ASR) systems are known to exhibit disparate performance on varying speech accents. To improve performance on a specific target accent, a commonly adopted solution is to finetune the ASR model…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-18 Suraj Kothawade , Anmol Mekala , Chandra Sekhara D , Mayank Kothyari , Rishabh Iyer , Ganesh Ramakrishnan , Preethi Jyothi

Self-supervised learning (SSL) based speech foundation models have been applied to a wide range of ASR tasks. However, their application to dysarthric and elderly speech via data-intensive parameter fine-tuning is confronted by in-domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Shujie Hu , Xurong Xie , Mengzhe Geng , Zengrui Jin , Jiajun Deng , Guinan Li , Yi Wang , Mingyu Cui , Tianzi Wang , Helen Meng , Xunying Liu

Deep Neural Networks (DNNs) have shown excellent performance in a wide range of machine learning applications. Knowing the latency of running a DNN model or tensor program on a specific device is useful in various tasks, such as DNN graph-…

Machine Learning · Computer Science 2023-11-20 Hanpeng Hu , Junwei Su , Juntao Zhao , Yanghua Peng , Yibo Zhu , Haibin Lin , Chuan Wu

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Speech Emotion Recognition (SER) presents a significant yet persistent challenge in human-computer interaction. While deep learning has advanced spoken language processing, achieving high performance on limited datasets remains a critical…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Tai Vu

Audio generation systems now create very realistic soundscapes that can enhance media production, but also pose potential risks. Several studies have examined deepfakes in speech or singing voice. However, environmental sounds have…

Sound · Computer Science 2025-09-30 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Haohe Liu , Wenwu Wang , Mark D Plumbley

Detecting synthetic from real speech is increasingly crucial due to the risks of misinformation and identity impersonation. While various datasets for synthetic speech analysis have been developed, they often focus on specific areas,…

Sound · Computer Science 2025-07-18 Zhoulin Ji , Chenhao Lin , Hang Wang , Chao Shen

Generating synchronized and natural lip movement with speech is one of the most important tasks in creating realistic virtual characters. In this paper, we present a combined deep neural network of one-dimensional convolutions and LSTM to…

Sound · Computer Science 2022-05-03 Xiaohong Li , Xiang Wang , Kai Wang , Shiguo Lian

Denoising Diffusion Probabilistic Models (DDPMs) have achieved impressive performance on various generation tasks. By modeling the reverse process of gradually diffusing the data distribution into a Gaussian distribution, generating a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhaoyang Lyu , Xudong XU , Ceyuan Yang , Dahua Lin , Bo Dai

Recent techniques for speech deepfake detection often rely on pre-trained self-supervised models. These systems, initially developed for Automatic Speech Recognition (ASR), have proved their ability to offer a meaningful representation of…

The recent advances in the field of deep learning have not been fully utilised for decoding imagined speech primarily because of the unavailability of sufficient training samples to train a deep network. In this paper, we present a novel…

Signal Processing · Electrical Eng. & Systems 2020-03-23 Jerrin Thomas Panachakel , A. G. Ramakrishnan , T. V. Ananthapadmanabha

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

The popularity of automatic speech recognition (ASR) systems nowadays leads to an increasing need for improving their accessibility. Handling stuttering speech is an important feature for accessible ASR systems. To improve the accessibility…

Sound · Computer Science 2023-08-31 Yi Liu , Yuekang Li , Gelei Deng , Felix Juefei-Xu , Yao Du , Cen Zhang , Chengwei Liu , Yeting Li , Lei Ma , Yang Liu