English
Related papers

Related papers: CITISEN: A Deep Learning-Based Speech Signal-Proce…

200 papers

Data-driven models achieve successful results in Speech Emotion Recognition (SER). However, these models, which are often based on general acoustic features or end-to-end approaches, show poor performance when the testing set has a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-15 Duowei Tang , Peter Kuppens , Lucca Geurts , Toon van Waterschoot

Most work in audio enhancement targets human speech, while bioacoustics is less studied due to noisy recordings and the distinct traits of animal sounds. To fill this gap, we adapt speech enhancement methods and build BioSEN, a model made…

Sound · Computer Science 2026-05-15 Tianyu Song , Ton Viet Ta , Ngamta Thamwattana , Hisako Nomura , Linh Thi Hoai Nguyen

Conventional deep neural network (DNN)-based speech enhancement (SE) approaches aim to minimize the mean square error (MSE) between enhanced speech and clean reference. The MSE-optimized model may not directly improve the performance of an…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-13 Yih-Liang Shen , Chao-Yuan Huang , Syu-Siang Wang , Yu Tsao , Hsin-Min Wang , Tai-Shih Chi

The performance of automatic speech recognition (ASR) has improved tremendously due to the application of deep neural networks (DNNs). Despite this progress, building a new ASR system remains a challenging task, requiring various resources,…

Computation and Language · Computer Science 2015-10-20 Yajie Miao , Mohammad Gowayyed , Florian Metze

This paper presents recent progress on integrating speech separation and enhancement (SSE) into the ESPnet toolkit. Compared with the previous ESPnet-SE work, numerous features have been added, including recent state-of-the-art speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-21 Yen-Ju Lu , Xuankai Chang , Chenda Li , Wangyou Zhang , Samuele Cornell , Zhaoheng Ni , Yoshiki Masuyama , Brian Yan , Robin Scheibler , Zhong-Qiu Wang , Yu Tsao , Yanmin Qian , Shinji Watanabe

The primary objective of speech enhancement is to reduce background noise while preserving the target's speech. A common dilemma occurs when a speaker is confined to a noisy environment and receives a call with high background and…

Sound · Computer Science 2023-01-24 Amanda Shu , Hamza Khalid , Haohui Liu , Shikhar Agnihotri , Joseph Konan , Ojas Bhargave

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

Sound · Computer Science 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

In this study, we propose a cross-domain multi-objective speech assessment model called MOSA-Net, which can estimate multiple speech assessment metrics simultaneously. Experimental results show that MOSA-Net can improve the linear…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-20 Ryandhimas E. Zezario , Szu-Wei Fu , Fei Chen , Chiou-Shann Fuh , Hsin-Min Wang , Yu Tsao

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

Deep learning has the potential to enhance speech signals and increase their intelligibility for users of hearing aids. Deep models suited for real-world application should feature a low computational complexity and low processing delay of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-31 Nils L. Westhausen , Hendrik Kayser , Theresa Jansen , Bernd T. Meyer

With the development of deep learning, neural network-based speech enhancement (SE) models have shown excellent performance. Meanwhile, it was shown that the development of self-supervised pre-trained models can be applied to various…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-29 Xiao-Ying Zhao , Qiu-Shi Zhu , Jie Zhang

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

Speech enhancement (SE) methods mainly focus on recovering clean speech from noisy input. In real-world speech communication, however, noises often exist in not only speaker but also listener environments. Although SE methods can suppress…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Haoyu Li , Yun Liu , Junichi Yamagishi

Noise reduction is an important part of modern hearing aids and is included in most commercially available devices. Deep learning-based state-of-the-art algorithms, however, either do not consider real-time and frequency resolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-29 Hendrik Schröter , Tobias Rosenkranz , Alberto N. Escalante B. , Marc Aubreville , Andreas Maier

Automatic speech recognition systems are part of people's daily lives, embedded in personal assistants and mobile phones, helping as a facilitator for human-machine interaction while allowing access to information in a practically intuitive…

Sound · Computer Science 2021-10-05 Julio Cesar Duarte , Sérgio Colcher

Recently, with the help of deep learning models, significant advances have been made in different Natural Language Processing (NLP) tasks. Unfortunately, state-of-the-art models are vulnerable to noisy texts. We propose a new contextual…

Computation and Language · Computer Science 2024-03-06 Yifu Sun , Haoming Jiang

Cochlear implants(CIs) are arguably the most successful neural implant, having restored hearing to over one million people worldwide. While CI research has focused on modeling the cochlear activations in response to low-level acoustic…

Neural and Evolutionary Computing · Computer Science 2024-07-31 Cynthia R. Steinhardt , Menoua Keshishian , Nima Mesgarani , Kim Stachenfeld

Multi-task learning (MTL) and attention mechanism have been proven to effectively extract robust acoustic features for various speech-related tasks in noisy environments. In this study, we propose an attention-based MTL (ATM) approach that…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Chiang-Jen Peng , Yun-Ju Chan , Cheng Yu , Syu-Siang Wang , Yu Tsao , Tai-Shih Chi

In a noisy environment, a lossy speech signal can be automatically restored by a listener if he/she knows the language well. That is, with the built-in knowledge of a "language model", a listener may effectively suppress noise interference…

Machine Learning · Computer Science 2019-07-03 Chien-Feng Liao , Yu Tsao , Xugang Lu , Hisashi Kawai

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

Sound · Computer Science 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang