English
Related papers

Related papers: End-to-End Multi-Microphone Speaker Extraction Usi…

200 papers

In conventional multichannel audio signal enhancement, spatial and spectral filtering are often performed sequentially. In contrast, it has been shown that for neural spatial filtering a joint approach of spectro-spatial filtering is more…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Annika Briegleb , Mhd Modar Halimeh , Walter Kellermann

The vast majority of speech separation methods assume that the number of speakers is known in advance, hence they are specific to the number of speakers. By contrast, a more realistic and challenging task is to separate a mixture in which…

Sound · Computer Science 2022-03-31 Zhenhao Jin , Xiang Hao , Xiangdong Su

This paper addresses the problem of multichannel online dereverberation. The proposed method is carried out in the short-time Fourier transform (STFT) domain, and for each frequency band independently. In the STFT domain, the time-domain…

Sound · Computer Science 2020-11-10 Xiaofei Li , Laurent Girin , Sharon Gannot , Radu Horaud

This paper proposes a speech rhythm-based method for speaker embeddings to model phoneme duration using a few utterances by the target speaker. Speech rhythm is one of the essential factors among speaker characteristics, along with acoustic…

Sound · Computer Science 2024-02-13 Kenichi Fujita , Atsushi Ando , Yusuke Ijima

To estimate the direction of arrival (DOA) of multiple speakers with methods that use prototype transfer functions, frequency-dependent spatial spectra (SPS) are usually constructed. To make the DOA estimation robust, SPS from different…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Daniel Fejgin , Elior Hadad , Sharon Gannot , Zbyněk Koldovský , Simon Doclo

Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verification (SV) approaches estimate a fixed-dimensional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Ahmad Aloradi , Wolfgang Mack , Mohamed Elminshawi , Emanuël A. P. Habets

Current multichannel speech enhancement algorithms typically assume a stationary sound source, a common mismatch with reality that limits their performance in real-world scenarios. This paper focuses on attention-driven spatial filtering…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-19 Yuzhu Wang , Archontis Politis , Tuomas Virtanen

Conventional direction of arrival (DOA) estimators are based on array processing using either time differences or beamforming. The proposed approach is based on the received power at each microphone, which enables simple hardware, low…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Gustav Zetterqvist , Fredrik Gustafsson , Gustaf Hendeby

This work proposes a multichannel speech separation method with narrow-band Conformer (named NBC). The network is trained to learn to automatically exploit narrow-band speech separation information, such as spatial vector clustering of…

Sound · Computer Science 2022-07-04 Changsheng Quan , Xiaofei Li

Speaker verification based on ad-hoc microphone arrays has the potential of reducing the error significantly in adverse acoustic environments. However, existing approaches extract utterance-level speaker embeddings from each channel of an…

Sound · Computer Science 2022-03-29 Chengdong Liang , Yijiang Chen , Jiadi Yao , Xiao-Lei Zhang

We present a head-related transfer function (HRTF) estimation method which relies on a data-driven prior given by a score-based diffusion model. The HRTF is estimated in reverberant environments using natural excitation signals, e.g. human…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Etienne Thuillier , Jean-Marie Lemercier , Eloi Moliner , Timo Gerkmann , Vesa Välimäki

We propose a spatial diffuseness feature for deep neural network (DNN)-based automatic speech recognition to improve recognition accuracy in reverberant and noisy environments. The feature is computed in real-time from multiple microphone…

Computation and Language · Computer Science 2015-09-02 Andreas Schwarz , Christian Huemmer , Roland Maas , Walter Kellermann

Range estimation of a far field sound source in a reverberant environment is known to be a notoriously difficult problem, hence most localization methods are only capable of estimating the source's Direction-of-Arrival (DoA). In an earlier…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-11 Jérôme Daniel , Srđan Kitić

In this paper, we address the problem of multichannel speech enhancement in the short-time Fourier transform (STFT) domain. A long short-time memory (LSTM) network takes as input a sequence of STFT coefficients associated with a frequency…

Sound · Computer Science 2020-09-24 Xiaofei LI , Radu Horaud

For 6-DOF (degrees of freedom) interactive virtual acoustic environments (VAEs), the spatial rendering of diffuse late reverberation in addition to early (specular) reflections is important. In the interest of computational efficiency, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-30 Christoph Kirsch , Josef Poppitz , Torben Wendt , Steven van de Par , Stephan D. Ewert

One of the major challenges of employing a dual-frequency phase-shifting algorithm for phase retrieval is its sensitivity to noise. Yun et. al [H Yun, B Li, S Zhang. 2017] proposed a dual-frequency method based on the Fourier transform…

Instrumentation and Detectors · Physics 2018-05-23 Minmin Wang , Canlin Zhou , Shuchun Si , Zhenkun Lei , Xiaolei Li , Hui Li , YanJie Li

In far-field speaker verification, the performance of speaker embeddings is susceptible to degradation when there is a mismatch between the conditions of enrollment and test speech. To solve this problem, we propose the feature-level and…

Sound · Computer Science 2021-06-18 Li Zhang , Qing Wang , Kong Aik Lee , Lei Xie , Haizhou Li

Head-related transfer functions (HRTFs) are crucial for spatial soundfield reproduction in virtual reality applications. However, obtaining personalized, high-resolution HRTFs is a time-consuming and costly task. Recently, deep…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Xingyu Chen , Fei Ma , Yile Zhang , Amy Bastine , Prasanga N. Samarasinghe

Speaker embeddings achieve promising results on many speaker verification tasks. Phonetic information, as an important component of speech, is rarely considered in the extraction of speaker embeddings. In this paper, we introduce phonetic…

Sound · Computer Science 2018-06-15 Yi Liu , Liang He , Jia Liu , Michael T. Johnson

This paper aims to achieve single-channel target speech extraction (TSE) in enclosures by solely utilizing distance information. This is the first work that utilizes only distance cues without using speaker physiological information for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Runwu Shi , Benjamin Yen , Kazuhiro Nakadai