中文
相关论文

相关论文: Separating Varying Numbers of Sources with Auxilia…

200 篇论文

We propose a novel deep learning model, which supports permutation invariant training (PIT), for speaker independent multi-talker speech separation, commonly known as the cocktail-party problem. Different from most of the prior arts that…

计算与语言 · 计算机科学 2018-12-06 Dong Yu , Morten Kolbæk , Zheng-Hua Tan , Jesper Jensen

Discriminative models for source separation have recently been shown to produce impressive results. However, when operating on sources outside of the training set, these models can not perform as well and are cumbersome to update. Classical…

声音 · 计算机科学 2019-11-04 Shrikant Venkataramani , Efthymios Tzinis , Paris Smaragdis

Supervised deep learning approaches to underdetermined audio source separation achieve state-of-the-art performance but require a dataset of mixtures along with their corresponding isolated source signals. Such datasets can be extremely…

We propose RemixIT, a simple and novel self-supervised training method for speech enhancement. The proposed method is based on a continuously self-training scheme that overcomes limitations from previous studies including assumptions for…

声音 · 计算机科学 2022-11-14 Efthymios Tzinis , Yossi Adi , Vamsi K. Ithapu , Buye Xu , Anurag Kumar

Achieving robust speech separation for overlapping speakers in various acoustic environments with noise and reverberation remains an open challenge. Although existing datasets are available to train separators for specific scenarios, they…

声音 · 计算机科学 2024-08-30 Ke Chen , Jiaqi Su , Taylor Berg-Kirkpatrick , Shlomo Dubnov , Zeyu Jin

While there has been much recent progress using deep learning techniques to separate speech and music audio signals, these systems typically require large collections of isolated sources during the training process. When extending audio…

声音 · 计算机科学 2020-09-01 Fatemeh Pishdadian , Gordon Wichern , Jonathan Le Roux

The recently-proposed mixture invariant training (MixIT) is an unsupervised method for training single-channel sound separation models in the sense that it does not require ground-truth isolated reference sources. In this paper, we…

声音 · 计算机科学 2021-10-22 Aswin Sivaraman , Scott Wisdom , Hakan Erdogan , John R. Hershey

Binaural speech separation in real-world scenarios often involves moving speakers. Most current speech separation methods use utterance-level permutation invariant training (u-PIT) for training. In inference time, however, the order of…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Cong Han , Nima Mesgarani

Deep learning techniques for separating audio into different sound sources face several challenges. Standard architectures require training separate models for different types of audio sources. Although some universal separators employ a…

声音 · 计算机科学 2022-02-15 Ke Chen , Xingjian Du , Bilei Zhu , Zejun Ma , Taylor Berg-Kirkpatrick , Shlomo Dubnov

Audio source separation aims to separate a mixture into target sources. Previous audio source separation systems usually conduct one-step inference, which does not fully explore the separation ability of models. In this work, we reveal that…

声音 · 计算机科学 2025-05-27 Yongyi Zang , Jingyi Li , Qiuqiang Kong

Most approaches to multi-talker overlapped speech separation and recognition assume that the number of simultaneously active speakers is given, but in realistic situations, it is typically unknown. To cope with this, we extend an iterative…

音频与语音处理 · 电气工程与系统科学 2020-12-22 Thilo von Neumann , Christoph Boeddeker , Lukas Drude , Keisuke Kinoshita , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

Audio source separation is fundamental for machines to understand complex acoustic environments and underpins numerous audio applications. Current supervised deep learning approaches, while powerful, are limited by the need for extensive,…

The detection of anomalous sounds in machinery operation presents a significant challenge due to the difficulty in generalizing anomalous acoustic patterns. This task is typically approached as an unsupervised learning or novelty detection…

音频与语音处理 · 电气工程与系统科学 2024-10-30 Seunghyeon Shin , Seokjin Lee

Despite the recent significant advances witnessed in end-to-end (E2E) ASR system for code-switching, hunger for audio-text paired data limits the further improvement of the models' performance. In this paper, we propose a decoupled…

声音 · 计算机科学 2020-10-29 Shuai Zhang , Jiangyan Yi , Zhengkun Tian , Ye Bai , Jianhua Tao , Zhengqi wen

The separation of single-channel underwater acoustic signals is a challenging problem with practical significance. Few existing studies focus on the source separation problem with unknown numbers of signals, and how to evaluate the…

声音 · 计算机科学 2024-05-29 Qinggang Sun , Kejun Wang

This paper proposes a novel framework for unsupervised audio source separation using a deep autoencoder. The characteristics of unknown source signals mixed in the mixed input is automatically by properly configured autoencoders implemented…

声音 · 计算机科学 2014-12-24 Giljin Jang , Han-Gyu Kim , Yung-Hwan Oh

The framework of visually-guided sound source separation generally consists of three parts: visual feature extraction, multimodal feature fusion, and sound signal processing. An ongoing trend in this field has been to tailor involved visual…

声音 · 计算机科学 2023-06-21 Zengjie Song , Zhaoxiang Zhang

A new learning algorithm for speech separation networks is designed to explicitly reduce residual noise and artifacts in the separated signal in an unsupervised manner. Generative adversarial networks are known to be effective in…

音频与语音处理 · 电气工程与系统科学 2022-03-29 Kohei Saijo , Tetsuji Ogawa

In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory…

声音 · 计算机科学 2018-12-06 Morten Kolbæk , Dong Yu , Zheng-Hua Tan , Jesper Jensen

In music source separation (MSS), obtaining isolated sources or stems is highly costly, making pre-training on unlabeled data a promising approach. Although source-agnostic unsupervised learning like mixture-invariant training (MixIT) has…

音频与语音处理 · 电气工程与系统科学 2025-05-13 Kohei Saijo , Yoshiaki Bando