中文
相关论文

相关论文: Improving Speech Enhancement via Event-based Query

200 篇论文

Deep learning based speech denoising still suffers from the challenge of improving perceptual quality of enhanced signals. We introduce a generalized framework called Perceptual Ensemble Regularization Loss (PERL) built on the idea of…

音频与语音处理 · 电气工程与系统科学 2020-10-23 Saurabh Kataria , Jesús Villalba , Najim Dehak

Neural network applications generally benefit from larger-sized models, but for current speech enhancement models, larger scale networks often suffer from decreased robustness to the variety of real-world use cases beyond what is…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Umut Isik , Ritwik Giri , Neerad Phansalkar , Jean-Marc Valin , Karim Helwani , Arvindh Krishnaswamy

This paper proposes an active learning system for sound event detection (SED). It aims at maximizing the accuracy of a learned SED model with limited annotation effort. The proposed system analyzes an initially unlabeled audio dataset, from…

音频与语音处理 · 电气工程与系统科学 2020-09-10 Shuyang Zhao , Toni Heittola , Tuomas Virtanen

The performance of state-of-the-art speech enhancement (SE) models considerably degrades for pathological speech due to atypical acoustic characteristics and limited data availability. This paper systematically investigates data…

音频与语音处理 · 电气工程与系统科学 2026-05-25 Mingchi Hou , Enno Hermann , Ina Kodrasi

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

音频与语音处理 · 电气工程与系统科学 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

Sound event localization frameworks based on deep neural networks have shown increased robustness with respect to reverberation and noise in comparison to classical parametric approaches. In particular, recurrent architectures that…

Supervised speech enhancement methods have been very successful. However, in practical scenarios, there is a lack of clean speech, and self-supervised learning-based (SSL) speech enhancement methods that offer comparable enhancement…

声音 · 计算机科学 2026-02-03 Rajalaxmi Rajagopalan , Ritwik Giri , Zhiqiang Tang , Kyu Han

Pre-emphasis filtering, compensating for the natural energy decay of speech at higher frequencies, has been considered as a common pre-processing step in a number of speech processing tasks over the years. In this work, we demonstrate, for…

音频与语音处理 · 电气工程与系统科学 2024-01-18 Iván López-Espejo , Aditya Joglekar , Antonio M. Peinado , Jesper Jensen

We propose an algorithm to denoise speakers from a single microphone in the presence of non-stationary and dynamic noise. Our approach is inspired by the recent success of neural network models separating speakers from other speakers and…

声音 · 计算机科学 2018-05-01 Jeff Hetherly , Paul Gamble , Maria Barrios , Cory Stephenson , Karl Ni

This paper presents a complete hardware and software pipeline for real-time speech enhancement in noisy and reverberant conditions. The device consists of a microphone array and a camera mounted on eyeglasses, connected to an embedded…

This paper proposes a guided speaker embedding extraction system, which extracts speaker embeddings of the target speaker using speech activities of target and interference speakers as clues. Several methods for long-form overlapped…

音频与语音处理 · 电气工程与系统科学 2025-01-03 Shota Horiguchi , Takafumi Moriya , Atsushi Ando , Takanori Ashihara , Hiroshi Sato , Naohiro Tawara , Marc Delcroix

Automatic classification of disordered speech can provide an objective tool for identifying the presence and severity of speech impairment. Classification approaches can also help identify hard-to-recognize speech samples to teach ASR…

音频与语音处理 · 电气工程与系统科学 2021-07-09 Subhashini Venugopalan , Joel Shor , Manoj Plakal , Jimmy Tobin , Katrin Tomanek , Jordan R. Green , Michael P. Brenner

This paper describes an audio-visual speech enhancement (AV-SE) method that estimates from noisy input audio a mixture of the speech of the speaker appearing in an input video (on-screen target speech) and of a selected speaker not…

音频与语音处理 · 电气工程与系统科学 2023-06-13 Tomoya Yoshinaga , Keitaro Tanaka , Shigeo Morishima

We propose an approach to extract speaker embeddings that are robust to speaking style variations in text-independent speaker verification. Typically, speaker embedding extraction includes training a DNN for speaker classification and using…

音频与语音处理 · 电气工程与系统科学 2022-06-29 Amber Afshan , Abeer Alwan

This paper presents a statistical method of single-channel speech enhancement that uses a variational autoencoder (VAE) as a prior distribution on clean speech. A standard approach to speech enhancement is to train a deep neural network…

In this paper, the coherence between speech and noise signals is used to obtain a Speech Enhancement (SE) gain function, in combination with a Super Gaussian Joint Maximum a Posteriori (SGJMAP) single microphone SE gain function. The…

音频与语音处理 · 电气工程与系统科学 2020-01-28 Nikhil Shankar , Gautam S Bhat , Chandan K A Reddy , Issa Panahi

Enhancing noisy speech is an important task to restore its quality and to improve its intelligibility. In traditional non-machine-learning (ML) based approaches the parameters required for noise reduction are estimated blindly from the…

声音 · 计算机科学 2018-01-16 Robert Rehr , Timo Gerkmann

The adoption of advanced deep learning architectures in stuttering detection (SD) tasks is challenging due to the limited size of the available datasets. To this end, this work introduces the application of speech embeddings extracted from…

声音 · 计算机科学 2023-06-02 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

In recent years, the joint training of speech enhancement front-end and automatic speech recognition (ASR) back-end has been widely used to improve the robustness of ASR systems. Traditional joint training methods only use enhanced speech…

声音 · 计算机科学 2023-05-31 Haoyu Lu , Nan Li , Tongtong Song , Longbiao Wang , Jianwu Dang , Xiaobao Wang , Shiliang Zhang

Recently, deep neural network (DNN)-based speech enhancement (SE) systems have been used with great success. During training, such systems require clean speech data - ideally, in large quantity with a variety of acoustic conditions, many…

音频与语音处理 · 电气工程与系统科学 2021-05-27 Koichi Saito , Stefan Uhlich , Giorgio Fabbro , Yuki Mitsufuji