中文
相关论文

相关论文: Single-channel speech separation using Soft-minimu…

200 篇论文

In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the component sources from…

音频与语音处理 · 电气工程与系统科学 2020-10-27 Scott Wisdom , Efthymios Tzinis , Hakan Erdogan , Ron J. Weiss , Kevin Wilson , John R. Hershey

In neural network-based monaural speech separation techniques, it has been recently common to evaluate the loss using the permutation invariant training (PIT) loss. However, the ordinary PIT requires to try all $N!$ permutations between $N$…

声音 · 计算机科学 2021-05-18 Hideyuki Tachibana

One solution to automatic speech recognition (ASR) of overlapping speakers is to separate speech and then perform ASR on the separated signals. Commonly, the separator produces artefacts which often degrade ASR performance. Addressing this…

Supervised neural network training has led to significant progress on single-channel sound separation. This approach relies on ground truth isolated sources, which precludes scaling to widely available mixture data and limits progress on…

音频与语音处理 · 电气工程与系统科学 2021-10-19 Scott Wisdom , Aren Jansen , Ron J. Weiss , Hakan Erdogan , John R. Hershey

The cocktail party problem comprises the challenging task of understanding a speech signal in a complex acoustic environment, where multiple speakers and background noise signals simultaneously interfere with the speech signal of interest.…

声音 · 计算机科学 2018-12-05 Morten Kolbæk

Many recent source separation systems are designed to separate a fixed number of sources out of a mixture. In the cases where the source activation patterns are unknown, such systems have to either adjust the number of outputs or to…

音频与语音处理 · 电气工程与系统科学 2020-08-19 Yi Luo , Nima Mesgarani

We introduce two unsupervised source separation methods, which involve self-supervised training from single-channel two-source speech mixtures. Our first method, mixture permutation invariant training (MixPIT), enables learning a neural…

音频与语音处理 · 电气工程与系统科学 2023-01-11 Ertuğ Karamatlı , Serap Kırbız

A major drawback of supervised speech separation (SSep) systems is their reliance on synthetic data, leading to poor real-world generalization. Mixture invariant training (MixIT) was proposed as an unsupervised alternative that uses real…

音频与语音处理 · 电气工程与系统科学 2024-11-22 Joonas Kalda , Clément Pagés , Ricard Marxer , Tanel Alumäe , Hervé Bredin

In this paper, we introduce a novel semi-supervised learning framework for end-to-end speech separation. The proposed method first uses mixtures of unseparated sources and the mixture invariant training (MixIT) criterion to train a teacher…

声音 · 计算机科学 2021-09-10 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

In this paper we propose a method of single-channel speaker-independent multi-speaker speech separation for an unknown number of speakers. As opposed to previous works, in which the number of speakers is assumed to be known in advance and…

声音 · 计算机科学 2019-09-04 Naoya Takahashi , Sudarsanam Parthasaarathy , Nabarun Goswami , Yuki Mitsufuji

Automatic transcription of meetings requires handling of overlapped speech, which calls for continuous speech separation (CSS) systems. The uPIT criterion was proposed for utterance-level separation with neural networks and introduces the…

音频与语音处理 · 电气工程与系统科学 2021-09-21 Thilo von Neumann , Keisuke Kinoshita , Christoph Boeddeker , Marc Delcroix , Reinhold Haeb-Umbach

In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory…

声音 · 计算机科学 2018-12-06 Morten Kolbæk , Dong Yu , Zheng-Hua Tan , Jesper Jensen

This paper addresses the problem of multi-channel multi-speech separation based on deep learning techniques. In the short time Fourier transform domain, we propose an end-to-end narrow-band network that directly takes as input the…

声音 · 计算机科学 2022-04-13 Changsheng Quan , Xiaofei Li

In this paper, we propose a novel strategy for text-independent speaker identification system: Multi-Label Training (MLT). Instead of the commonly used one-to-one correspondence between the speech and the speaker label, we divide all the…

音频与语音处理 · 电气工程与系统科学 2024-08-19 Yuqi Xue

Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they…

声音 · 计算机科学 2024-08-30 Ke Chen , Jiaqi Su , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Zeyu Jin

We present an upper bound for the Single Channel Speech Separation task, which is based on an assumption regarding the nature of short segments of speech. Using the bound, we are able to show that while the recent methods have made…

音频与语音处理 · 电气工程与系统科学 2023-05-23 Shahar Lutati , Eliya Nachmani , Lior Wolf

Recently, supervised speech separation has made great progress. However, limited by the nature of supervised training, most existing separation methods require ground-truth sources and are trained on synthetic datasets. This ground-truth…

音频与语音处理 · 电气工程与系统科学 2022-08-09 Jiangyu Han , Yanhua Long

Transformer has shown advanced performance in speech separation, benefiting from its ability to capture global features. However, capturing local features and channel information of audio sequences in speech separation is equally important.…

声音 · 计算机科学 2023-03-08 Zhaoxi Mu , Xinyu Yang , Wenjing Zhu

The recently-proposed mixture invariant training (MixIT) is an unsupervised method for training single-channel sound separation models in the sense that it does not require ground-truth isolated reference sources. In this paper, we…

声音 · 计算机科学 2021-10-22 Aswin Sivaraman , Scott Wisdom , Hakan Erdogan , John R. Hershey

Binaural speech separation in real-world scenarios often involves moving speakers. Most current speech separation methods use utterance-level permutation invariant training (u-PIT) for training. In inference time, however, the order of…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Cong Han , Nima Mesgarani