English
Related papers

Related papers: Speech Boosting: Low-Latency Live Speech Enhanceme…

200 papers

Recently, zero-shot text-to-speech (TTS) systems, capable of synthesizing any speaker's voice from a short audio prompt, have made rapid advancements. However, the quality of the generated speech significantly deteriorates when the audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Xiaofei Wang , Sefik Emre Eskimez , Manthan Thakker , Hemin Yang , Zirun Zhu , Min Tang , Yufei Xia , Jinzhu Li , Sheng Zhao , Jinyu Li , Naoyuki Kanda

Speech enhancement and separation have been a long-standing problem, especially with the recent advances using a single microphone. Although microphones perform well in constrained settings, their performance for speech separation decreases…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-15 Muhammed Zahid Ozturk , Chenshu Wu , Beibei Wang , Min Wu , K. J. Ray Liu

Accurate on-device keyword spotting (KWS) with low false accept and false reject rate is crucial to customer experience for far-field voice control of conversational agents. It is particularly challenging to maintain low false reject rate…

Computation and Language · Computer Science 2018-08-03 Anirudh Raju , Sankaran Panchapagesan , Xing Liu , Arindam Mandal , Nikko Strom

While neural-based text to speech (TTS) models can synthesize natural and intelligible voice, they usually require high-quality speech data, which is costly to collect. In many scenarios, only noisy speech of a target speaker is available,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Chen Zhang , Yi Ren , Xu Tan , Jinglin Liu , Kejun Zhang , Tao Qin , Sheng Zhao , Tie-Yan Liu

Teleconferencing is becoming essential during the COVID-19 pandemic. However, in real-world applications, speech quality can deteriorate due to, for example, background interference, noise, or reverberation. To solve this problem, target…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-02 Yicheng Hsu , Yonghan Lee , Mingsian R. Bai

Speech enhancement has seen great improvement in recent years mainly through contributions in denoising, speaker separation, and dereverberation methods that mostly deal with environmental effects on vocal audio. To enhance speech beyond…

Sound · Computer Science 2021-02-02 Adam Polyak , Lior Wolf , Yossi Adi , Ori Kabeli , Yaniv Taigman

The primary objective of speech enhancement is to reduce background noise while preserving the target's speech. A common dilemma occurs when a speaker is confined to a noisy environment and receives a call with high background and…

Sound · Computer Science 2023-01-24 Amanda Shu , Hamza Khalid , Haohui Liu , Shikhar Agnihotri , Joseph Konan , Ojas Bhargave

Recent advances in text-to-speech (TTS) synthesis, such as Tacotron and WaveRNN, have made it possible to construct a fully neural network based TTS system, by coupling the two components together. Such a system is conceptually simple as it…

In this paper we consider the problem of speech enhancement in real-world like conditions where multiple noises can simultaneously corrupt speech. Most of the current literature on speech enhancement focus primarily on presence of single…

Sound · Computer Science 2016-05-10 Anurag Kumar , Dinei Florencio

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

From hearing aids to augmented and virtual reality devices, binaural speech enhancement algorithms have been established as state-of-the-art techniques to improve speech intelligibility and listening comfort. In this paper, we present an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-29 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

Active Noise Control (ANC) is a widely adopted technology for reducing environmental noise across various scenarios. This paper focuses on enhancing noise reduction performance, particularly through the refinement of signal quality fed into…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-22 Xiaoyi Shen , Dongyuan Shi , Zhengding Luo , Junwei Ji , Woon-Seng Gan

It is highly desirable that speech enhancement algorithms can achieve good performance while keeping low latency for many applications, such as digital hearing aids, acoustically transparent hearing devices, and public address systems. To…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-01 Chengshi Zheng , Wenzhe Liu , Andong Li , Yuxuan Ke , Xiaodong Li

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

We present a causal speech enhancement model working on the raw waveform that runs in real-time on a laptop CPU. The proposed model is based on an encoder-decoder architecture with skip-connections. It is optimized on both time and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-08 Alexandre Defossez , Gabriel Synnaeve , Yossi Adi

Ensuring intelligible speech communication for hearing assistive devices in low-latency scenarios presents significant challenges in terms of speech enhancement, coding and transmission. In this paper, we propose novel solutions for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-01 Mohammad Bokaei , Jesper Jensen , Simon Doclo , Jan Østergaard

Noise robustness is a key aspect of successful speech applications. Speech enhancement (SE) has been investigated to improve automatic speech recognition accuracy; however, its effectiveness for keyword spotting (KWS) is still…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Avamarie Brueggeman , Takuya Higuchi , Masood Delfarah , Stephen Shum , Vineet Garg

In this paper, we propose a text-to-speech (TTS)-driven data augmentation method for improving the quality of a non-autoregressive (AR) TTS system. Recently proposed non-AR models, such as FastSpeech 2, have successfully achieved fast…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Min-Jae Hwang , Ryuichi Yamamoto , Eunwoo Song , Jae-Min Kim

Discretized representations of speech signals are efficient alternatives to continuous features for various speech applications, including automatic speech recognition (ASR) and speech language models. However, these representations, such…

Sound · Computer Science 2026-02-05 Takanori Ashihara , Shota Horiguchi , Kohei Matsuura , Tsubasa Ochiai , Marc Delcroix

We address the problem of speech enhancement generalisation to unseen environments by performing two manipulations. First, we embed an additional recording from the environment alone, and use this embedding to alter activations in the main…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Gil Keren , Jing Han , Björn Schuller