中文
相关论文

相关论文: Cracking the cocktail party problem by multi-beam …

200 篇论文

The cocktail party problem aims at isolating any source of interest within a complex acoustic scene, and has long inspired audio source separation research. Recent efforts have mainly focused on separating speech from noise, speech from…

音频与语音处理 · 电气工程与系统科学 2022-03-25 Darius Petermann , Gordon Wichern , Zhong-Qiu Wang , Jonathan Le Roux

Multichannel convolutive blind speech source separation refers to the problem of separating different speech sources from the observed multichannel mixtures without much a priori information about the mixing system. Multichannel nonnegative…

声音 · 计算机科学 2024-01-04 Jianyu Wang , Shanzheng Guan

Recently, end-to-end models have become a popular approach as an alternative to traditional hybrid models in automatic speech recognition (ASR). The multi-speaker speech separation and recognition task is a central task in cocktail party…

计算与语言 · 计算机科学 2018-11-07 Xuankai Chang , Yanmin Qian , Kai Yu , Shinji Watanabe

We address talker-independent monaural speaker separation from the perspectives of deep learning and computational auditory scene analysis (CASA). Specifically, we decompose the multi-speaker separation task into the stages of simultaneous…

声音 · 计算机科学 2019-04-26 Yuzhou Liu , DeLiang Wang

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Kristina Tesch , Timo Gerkmann

Single-channel speech separation is a crucial task for enhancing speech recognition systems in multi-speaker environments. This paper investigates the robustness of state-of-the-art Neural Network models in scenarios where the pitch…

音频与语音处理 · 电气工程与系统科学 2024-07-23 Bunlong Lay , Sebastian Zaczek , Kristina Tesch , Timo Gerkmann

While current deep learning (DL)-based beamforming techniques have been proved effective in speech separation, they are often designed to process narrow-band (NB) frequencies independently which results in higher computational costs and…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Vinay Kothapally , Yong Xu , Meng Yu , Shi-Xiong Zhang , Dong Yu

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…

This paper introduces a new method for multi-channel time domain speech separation in reverberant environments. A fully-convolutional neural network structure has been used to directly separate speech from multiple microphone recordings,…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently proposed Weighted…

音频与语音处理 · 电气工程与系统科学 2020-11-19 Zhaoheng Ni , Yong Xu , Meng Yu , Bo Wu , Shixiong Zhang , Dong Yu , Michael I Mandel

In this letter, we present a novel multi-talker minimum variance distortionless response (MVDR) beamforming as the front-end of an automatic speech recognition (ASR) system in a dinner party scenario. The CHiME-5 dataset is selected to…

音频与语音处理 · 电气工程与系统科学 2019-10-18 Hangting Chen , Pengyuan Zhang , Yonghong Yan

The field of speech separation, addressing the "cocktail party problem", has seen revolutionary advances with DNNs. Speech separation enhances clarity in complex acoustic environments and serves as crucial pre-processing for speech…

声音 · 计算机科学 2025-08-15 Kai Li , Guo Chen , Wendi Sang , Yi Luo , Zhuo Chen , Shuai Wang , Shulin He , Zhong-Qiu Wang , Andong Li , Zhiyong Wu , Xiaolin Hu

Neural beamformers, which integrate both pre-separation and beamforming modules, have demonstrated impressive effectiveness in target speech extraction. Nevertheless, the performance of these beamformers is inherently limited by the…

声音 · 计算机科学 2023-09-08 Aoqi Guo , Sichong Qian , Baoxiang Li , Dazhi Gao

The goal of this work is to develop a meeting transcription system that can recognize speech even when utterances of different speakers are overlapped. While speech overlaps have been regarded as a major obstacle in accurately transcribing…

音频与语音处理 · 电气工程与系统科学 2018-10-10 Takuya Yoshioka , Hakan Erdogan , Zhuo Chen , Xiong Xiao , Fil Alleva

In this paper we propose a method of single-channel speaker-independent multi-speaker speech separation for an unknown number of speakers. As opposed to previous works, in which the number of speakers is assumed to be known in advance and…

声音 · 计算机科学 2019-09-04 Naoya Takahashi , Sudarsanam Parthasaarathy , Nabarun Goswami , Yuki Mitsufuji

We present a transformer-based architecture for voice separation of a target speaker from multiple other speakers and ambient noise. We achieve this by using two separate neural networks: (A) An enrolment network designed to craft…

音频与语音处理 · 电气工程与系统科学 2025-01-03 Akam Rahimi , Triantafyllos Afouras , Andrew Zisserman

Purely neural network (NN) based speech separation and enhancement methods, although can achieve good objective scores, inevitably cause nonlinear speech distortions that are harmful for the automatic speech recognition (ASR). On the other…

音频与语音处理 · 电气工程与系统科学 2020-08-03 Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Chao Weng , Jianming Liu , Dong Yu

Recently, there has been growing interest in multi-speaker speech recognition, where the utterances of multiple speakers are recognized from their mixture. Promising techniques have been proposed for this task, but earlier works have…

声音 · 计算机科学 2018-05-16 Hiroshi Seki , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux , John R. Hershey

This work proposes a multichannel speech separation method with narrow-band Conformer (named NBC). The network is trained to learn to automatically exploit narrow-band speech separation information, such as spatial vector clustering of…

声音 · 计算机科学 2022-07-04 Changsheng Quan , Xiaofei Li