中文
相关论文

相关论文: Discriminative Learning for Monaural Speech Separa…

200 篇论文

Speech separation is a fundamental task in audio processing, typically addressed with fully supervised systems trained on paired mixtures. While effective, such systems typically rely on synthetic data pipelines, which may not reflect…

音频与语音处理 · 电气工程与系统科学 2025-09-30 Runwu Shi , Kai Li , Chang Li , Jiang Wang , Sihan Tan , Kazuhiro Nakadai

Despite the overwhelming success of deep learning in various speech processing tasks, the problem of separating simultaneous speakers in a mixture remains challenging. Two major difficulties in such systems are the arbitrary source…

声音 · 计算机科学 2017-11-30 Zhuo Chen , Yi Luo , Nima Mesgarani

We introduce two unsupervised source separation methods, which involve self-supervised training from single-channel two-source speech mixtures. Our first method, mixture permutation invariant training (MixPIT), enables learning a neural…

音频与语音处理 · 电气工程与系统科学 2023-01-11 Ertuğ Karamatlı , Serap Kırbız

Utterance-level permutation invariant training (uPIT) has achieved promising progress on single-channel multi-talker speech separation task. Long short-term memory (LSTM) and bidirectional LSTM (BLSTM) are widely used as the separation…

声音 · 计算机科学 2019-12-30 Lu Huang , Gaofeng Cheng , Pengyuan Zhang , Yi Yang , Shumin Xu , Jiasong Sun

Many of the recent advances in speech separation are primarily aimed at synthetic mixtures of short audio utterances with high degrees of overlap. Most of these approaches need an additional stitching step to stitch the separated speech…

音频与语音处理 · 电气工程与系统科学 2022-09-07 Rohit Paturi , Sundararajan Srinivasan , Katrin Kirchhoff , Daniel Garcia-Romero

Speech signals are inherently complex as they encompass both global acoustic characteristics and local semantic information. However, in the task of target speech extraction, certain elements of global and local semantic information in the…

声音 · 计算机科学 2024-08-27 Zhaoxi Mu , Xinyu Yang , Sining Sun , Qing Yang

We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation.…

声音 · 计算机科学 2021-05-25 Zhong-Qiu Wang , Peidong Wang , DeLiang Wang

Binaural speech separation in real-world scenarios often involves moving speakers. Most current speech separation methods use utterance-level permutation invariant training (u-PIT) for training. In inference time, however, the order of…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Cong Han , Nima Mesgarani

Single channel speech separation has experienced great progress in the last few years. However, training neural speech separation for a large number of speakers (e.g., more than 10 speakers) is out of reach for the current methods, which…

声音 · 计算机科学 2021-11-09 Shaked Dovrat , Eliya Nachmani , Lior Wolf

A great challenge in speaker representation learning using deep models is to design learning objectives that can enhance the discrimination of unseen speakers under unseen domains. This work proposes a supervised contrastive learning…

音频与语音处理 · 电气工程与系统科学 2022-11-18 Zhe Li , Man-Wai Mak

The current monaural state of the art tools for speech separation relies on supervised learning. This means that they must deal with permutation problem, they are impacted by the mismatch on the number of speakers used in training and…

声音 · 计算机科学 2024-10-10 Peter Ochieng

Learning speaker-specific features is vital in many applications like speaker recognition, diarization and speech recognition. This paper provides a novel approach, we term Neural Predictive Coding (NPC), to learn speaker-specific…

声音 · 计算机科学 2019-07-18 Arindam Jati , Panayiotis Georgiou

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

In this paper we propose a new method of speaker diarization that employs a deep learning architecture to learn speaker embeddings. In contrast to the traditional approaches that build their speaker embeddings using manually hand-crafted…

声音 · 计算机科学 2017-09-18 Pawel Cyrta , Tomasz Trzciński , Wojciech Stokowiec

Deep neural networks (DNNs) have achieved substantial predictive performance in various speech processing tasks. Particularly, it has been shown that a monaural speech separation task can be successfully solved with a DNN-based method…

音频与语音处理 · 电气工程与系统科学 2021-04-20 Chihiro Watanabe , Hirokazu Kameoka

Training speech separation models in the supervised setting raises a permutation problem: finding the best assignation between the model predictions and the ground truth separated signals. This inherently ambiguous task is customarily…

声音 · 计算机科学 2024-11-28 David Perera , François Derrida , Théo Mariotte , Gaël Richard , Slim Essid

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Kristina Tesch , Timo Gerkmann

In this paper we propose a method of single-channel speaker-independent multi-speaker speech separation for an unknown number of speakers. As opposed to previous works, in which the number of speakers is assumed to be known in advance and…

声音 · 计算机科学 2019-09-04 Naoya Takahashi , Sudarsanam Parthasaarathy , Nabarun Goswami , Yuki Mitsufuji

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

机器学习 · 计算机科学 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

音频与语音处理 · 电气工程与系统科学 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu