中文
相关论文

相关论文: Multi-channel Speech Separation Using Spatially Se…

200 篇论文

Speech enhancement in multichannel settings has been realized by utilizing the spatial information embedded in multiple microphone signals. Moreover, deep neural networks (DNNs) have been recently advanced in this field; however, studies on…

音频与语音处理 · 电气工程与系统科学 2024-10-28 Dongheon Lee , Seongrae Kim , Jung-Woo Choi

A robust multichannel speaker diarization and separation system is proposed by exploiting the spatio-temporal activity of the speakers. The system is realized in a hybrid architecture that combines the array signal processing units and the…

音频与语音处理 · 电气工程与系统科学 2024-01-31 Yicheng Hsu , Ssuhan Chen , Mingsian R. Bai

Although fully end-to-end speaker diarization systems have made significant progress in recent years, modular systems often achieve superior results in real-world scenarios due to their greater adaptability and robustness. Historically,…

音频与语音处理 · 电气工程与系统科学 2024-09-26 Ruoyu Wang , Shutong Niu , Gaobin Yang , Jun Du , Shuangqing Qian , Tian Gao , Jia Pan

Dereverberation of a moving speech source in the presence of other directional interferers, is a harder problem than that of stationary source and interference cancellation. We explore joint multi channel linear prediction (MCLP) and…

音频与语音处理 · 电气工程与系统科学 2019-10-23 Srikanth Raj Chetupalli , Thippur V. Sreenivas

This paper presents a neural method for distant speech recognition (DSR) that jointly separates and diarizes speech mixtures without supervision by isolated signals. A standard separation method for multi-talker DSR is a statistical…

音频与语音处理 · 电气工程与系统科学 2024-06-13 Yoshiaki Bando , Tomohiko Nakamura , Shinji Watanabe

In recent years there have been many deep learning approaches towards the multi-speaker source separation problem. Most use Long Short-Term Memory - Recurrent Neural Networks (LSTM-RNN) or Convolutional Neural Networks (CNN) to model the…

机器学习 · 计算机科学 2019-12-20 Jeroen Zegers , Hugo Van hamme

We propose a speaker selection mechanism (SSM) for the training of an end-to-end beamforming neural network, based on recent findings that a listener usually looks to the target speaker with a certain undershot angle. The mechanism allows…

音频与语音处理 · 电气工程与系统科学 2025-03-25 Luan Vinícius Fiorio , Bruno Defraene , Johan David , Alex Young , Frans Widdershoven , Wim van Houtum , Ronald M. Aarts

Multi-channel speech separation using speaker's directional information has demonstrated significant gains over blind speech separation. However, it has two limitations. First, substantial performance degradation is observed when the coming…

声音 · 计算机科学 2023-02-28 Rongzhi Gu , Shi-Xiong Zhang , Dong Yu

Many purely neural network based speech separation approaches have been proposed to improve objective assessment scores, but they often introduce nonlinear distortions that are harmful to modern automatic speech recognition (ASR) systems.…

音频与语音处理 · 电气工程与系统科学 2021-11-17 Zhuohuang Zhang , Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Donald S. Williamson , Dong Yu

Although deep-learning-based methods have markedly improved the performance of speech separation over the past few years, it remains an open question how to integrate multi-channel signals for speech separation. We propose two methods,…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Yuichiro Koyama , Oluwafemi Azeez , Bhiksha Raj

Non-negative Matrix Factorization (NMF) has already been applied to learn speaker characterizations from single or non-simultaneous speech for speaker recognition applications. It is also known for its good performance in (blind) source…

声音 · 计算机科学 2016-05-02 Jeroen Zegers , Hugo Van hamme

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

声音 · 计算机科学 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

The use of spatial information with multiple microphones can improve far-field automatic speech recognition (ASR) accuracy. However, conventional microphone array techniques degrade speech enhancement performance when there is an array…

音频与语音处理 · 电气工程与系统科学 2021-12-23 Kenichi Kumatani , Minhua Wu , Shiva Sundaram , Nikko Strom , Bjorn Hoffmeister

Speech separation involves extracting an individual speaker's voice from a multi-speaker audio signal. The increasing complexity of real-world environments, where multiple speakers might converse simultaneously, underscores the importance…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Renana Opochinsky , Mordehay Moradi , Sharon Gannot

The majority of multichannel speech enhancement algorithms are two-step procedures that first apply a linear spatial filter, a so-called beamformer, and combine it with a single-channel approach for postprocessing. However, the serial…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Kristina Tesch , Timo Gerkmann

The task of estimating the maximum number of concurrent speakers from single channel mixtures is important for various audio-based applications, such as blind source separation, speaker diarisation, audio surveillance or auditory scene…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Fabian-Robert Stöter , Soumitro Chakrabarty , Bernd Edler , Emanuël A. P. Habets

Speaker Diarization (SD) aims at grouping speech segments that belong to the same speaker. This task is required in many speech-processing applications, such as rich meeting transcription. In this context, distant microphone arrays usually…

声音 · 计算机科学 2024-06-06 Theo Mariotte , Anthony Larcher , Silvio Montresor , Jean-Hugh Thomas

Multichannel convolutive blind speech source separation refers to the problem of separating different speech sources from the observed multichannel mixtures without much a priori information about the mixing system. Multichannel nonnegative…

声音 · 计算机科学 2024-01-04 Jianyu Wang , Shanzheng Guan

In this paper, we propose two mask-based beamforming methods using a deep neural network (DNN) trained by multichannel loss functions. Beamforming technique using time-frequency (TF)-masks estimated by a DNN have been applied to many…

声音 · 计算机科学 2019-07-12 Yoshiki Masuyama , Masahito Togami , Tatsuya Komatsu

In this work, we extend our previously proposed offline SpatialNet for long-term streaming multichannel speech enhancement in both static and moving speaker scenarios. SpatialNet exploits spatial information, such as the spatial/steering…

声音 · 计算机科学 2024-06-21 Changsheng Quan , Xiaofei Li