中文
相关论文

相关论文: Guided Training: A Simple Method for Single-channe…

200 篇论文

Speech separation has been well developed, with the very successful permutation invariant training (PIT) approach, although the frequent label assignment switching happening during PIT training remains to be a problem when better…

声音 · 计算机科学 2021-08-24 Sung-Feng Huang , Shun-Po Chuang , Da-Rong Liu , Yi-Chen Chen , Gene-Ping Yang , Hung-yi Lee

In this paper, an architecture based on Long Short-Term Memory Networks has been proposed for the text-independent scenario which is aimed to capture the temporal speaker-related information by operating over traditional speech features.…

音频与语音处理 · 电气工程与系统科学 2018-09-10 Aryan Mobiny , Mohammad Najarian

We propose a speaker selection mechanism (SSM) for the training of an end-to-end beamforming neural network, based on recent findings that a listener usually looks to the target speaker with a certain undershot angle. The mechanism allows…

音频与语音处理 · 电气工程与系统科学 2025-03-25 Luan Vinícius Fiorio , Bruno Defraene , Johan David , Alex Young , Frans Widdershoven , Wim van Houtum , Ronald M. Aarts

Continuous speech separation for meeting pre-processing has recently become a focused research topic. Compared to the data in utterance-level speech separation, the meeting-style audio stream lasts longer, has an uncertain number of…

音频与语音处理 · 电气工程与系统科学 2022-02-11 Chenda Li , Lei Yang , Weiqin Wang , Yanmin Qian

In this paper, we address the problem of multichannel speech enhancement in the short-time Fourier transform (STFT) domain. A long short-time memory (LSTM) network takes as input a sequence of STFT coefficients associated with a frequency…

声音 · 计算机科学 2020-09-24 Xiaofei LI , Radu Horaud

Speech separation aims to separate individual voice from an audio mixture of multiple simultaneous talkers. Although audio-only approaches achieve satisfactory performance, they build on a strategy to handle the predefined conditions,…

声音 · 计算机科学 2020-12-01 Peng Zhang , Jiaming Xu , Jing shi , Yunzhe Hao , Bo Xu

Many of the recent advances in speech separation are primarily aimed at synthetic mixtures of short audio utterances with high degrees of overlap. Most of these approaches need an additional stitching step to stitch the separated speech…

音频与语音处理 · 电气工程与系统科学 2022-09-07 Rohit Paturi , Sundararajan Srinivasan , Katrin Kirchhoff , Daniel Garcia-Romero

Deep gated convolutional networks have been proved to be very effective in single channel speech separation. However current state-of-the-art framework often considers training the gated convolutional networks in time-frequency (TF) domain.…

声音 · 计算机科学 2019-03-19 Ziqiang Shi , Huibin Lin , Liu Liu , Rujie Liu , Shoji Hayakawa , Shouji Harada , Jiqing Han

In this paper, we introduce a novel semi-supervised learning framework for end-to-end speech separation. The proposed method first uses mixtures of unseparated sources and the mixture invariant training (MixIT) criterion to train a teacher…

声音 · 计算机科学 2021-09-10 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

Automatic transcription of meetings requires handling of overlapped speech, which calls for continuous speech separation (CSS) systems. The uPIT criterion was proposed for utterance-level separation with neural networks and introduces the…

音频与语音处理 · 电气工程与系统科学 2021-09-21 Thilo von Neumann , Keisuke Kinoshita , Christoph Boeddeker , Marc Delcroix , Reinhold Haeb-Umbach

In this paper, we propose a novel strategy for text-independent speaker identification system: Multi-Label Training (MLT). Instead of the commonly used one-to-one correspondence between the speech and the speaker label, we divide all the…

音频与语音处理 · 电气工程与系统科学 2024-08-19 Yuqi Xue

This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the…

声音 · 计算机科学 2022-04-13 Changsheng Quan , Xiaofei Li

Target speech separation refers to extracting the target speaker's speech from mixed signals. Despite the recent advances in deep learning based close-talk speech separation, the applications to real-world are still an open issue. Two main…

声音 · 计算机科学 2020-01-03 Rongzhi Gu , Yuexian Zou

Despite the recent success of speech separation models, they fail to separate sources properly while facing different sets of people or noisy environments. To tackle this problem, we proposed to apply meta-learning to the speech separation…

声音 · 计算机科学 2021-05-04 Yuan-Kuei Wu , Kuan-Po Huang , Yu Tsao , Hung-yi Lee

In neural network-based monaural speech separation techniques, it has been recently common to evaluate the loss using the permutation invariant training (PIT) loss. However, the ordinary PIT requires to try all $N!$ permutations between $N$…

声音 · 计算机科学 2021-05-18 Hideyuki Tachibana

Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information. However, in the task of target speech extraction, certain elements of global and local semantic information in the…

声音 · 计算机科学 2024-08-27 Zhaoxi Mu , Xinyu Yang , Sining Sun , Qing Yang

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Kristina Tesch , Timo Gerkmann

Transformer has shown advanced performance in speech separation, benefiting from its ability to capture global features. However, capturing local features and channel information of audio sequences in speech separation is equally important.…

声音 · 计算机科学 2023-03-08 Zhaoxi Mu , Xinyu Yang , Wenjing Zhu

Binaural speech separation in real-world scenarios often involves moving speakers. Most current speech separation methods use utterance-level permutation invariant training (u-PIT) for training. In inference time, however, the order of…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Cong Han , Nima Mesgarani

Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they…

声音 · 计算机科学 2024-08-30 Ke Chen , Jiaqi Su , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Zeyu Jin