中文
相关论文

相关论文: NBC2: Multichannel Speech Separation with Revised …

200 篇论文

In recent years there have been many deep learning approaches towards the multi-speaker source separation problem. Most use Long Short-Term Memory - Recurrent Neural Networks (LSTM-RNN) or Convolutional Neural Networks (CNN) to model the…

机器学习 · 计算机科学 2019-12-20 Jeroen Zegers , Hugo Van hamme

In this work, we present DeFTAN-II, an efficient multichannel speech enhancement model based on transformer architecture and subgroup processing. Despite the success of transformers in speech enhancement, they face challenges in capturing…

音频与语音处理 · 电气工程与系统科学 2025-09-12 Dongheon Lee , Jung-Woo Choi

This paper presents FastFit, a novel neural vocoder architecture that replaces the U-Net encoder with multiple short-time Fourier transforms (STFTs) to achieve faster generation rates without sacrificing sample quality. We replaced each…

音频与语音处理 · 电气工程与系统科学 2023-05-19 Won Jang , Dan Lim , Heayoung Park

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

音频与语音处理 · 电气工程与系统科学 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

The recently proposed Conformer architecture has shown state-of-the-art performances in Automatic Speech Recognition by combining convolution with attention to model both local and global dependencies. In this paper, we study how to reduce…

音频与语音处理 · 电气工程与系统科学 2021-09-09 Maxime Burchi , Valentin Vielzeuf

We present a scalable and efficient neural waveform coding system for speech compression. We formulate the speech coding problem as an autoencoding task, where a convolutional neural network (CNN) performs encoding and decoding as a neural…

音频与语音处理 · 电气工程与系统科学 2021-11-30 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beak , Minje Kim

Target speech separation refers to extracting a target speaker's voice from an overlapped audio of simultaneous talkers. Previously the use of visual modality for target speech separation has demonstrated great potentials. This work…

音频与语音处理 · 电气工程与系统科学 2020-10-26 Rongzhi Gu , Shi-Xiong Zhang , Yong Xu , Lianwu Chen , Yuexian Zou , Dong Yu

A promising approach for multi-microphone speech separation involves two deep neural networks (DNN), where the predicted target speech from the first DNN is used to compute signal statistics for time-invariant minimum variance…

声音 · 计算机科学 2021-10-04 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Recently, deep neural networks (DNNs) have been successfully used for speech enhancement, and DNN-based speech enhancement is becoming an attractive research area. While time-frequency masking based on the short-time Fourier transform…

音频与语音处理 · 电气工程与系统科学 2020-08-21 Yuichiro Koyama , Tyler Vuong , Stefan Uhlich , Bhiksha Raj

Deep learning based single-channel speech enhancement tries to train a neural network model for the prediction of clean speech signal. There are a variety of popular network structures for single-channel speech enhancement, such as TCNN,…

音频与语音处理 · 电气工程与系统科学 2022-01-04 Xupeng Jia , Dongmei Li

We present a new method for separating a mixed audio sequence, in which multiple voices speak simultaneously. The new method employs gated neural networks that are trained to separate the voices at multiple processing steps, while…

音频与语音处理 · 电气工程与系统科学 2020-09-02 Eliya Nachmani , Yossi Adi , Lior Wolf

We propose methods to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models that are specifically friendly to mobile devices with limited power capacity and computation…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Peng Chen , Lingqiao Liu , Ian Reid

This paper proposes a Convolutional Neural Network (CNN) inspired by Multitask Learning (MTL) and based on speech features trained under the joint supervision of softmax loss and center loss, a powerful metric learning strategy, for the…

声音 · 计算机科学 2019-09-04 Suraj Tripathi , Abhiram Ramesh , Abhay Kumar , Chirag Singh , Promod Yenigalla

The segmentation of the pubic symphysis and fetal head (PSFH) constitutes a pivotal step in monitoring labor progression and identifying potential delivery complications. Despite the advances in deep learning, the lack of annotated medical…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Jianmei Jiang , Huijin Wang , Jieyun Bai , Shun Long , Shuangping Chen , Victor M. Campello , Karim Lekadir

Over the past few years, speech enhancement methods based on deep learning have greatly surpassed traditional methods based on spectral subtraction and spectral estimation. Many of these new techniques operate directly in the the short-time…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Jean-Marc Valin , Umut Isik , Neerad Phansalkar , Ritwik Giri , Karim Helwani , Arvindh Krishnaswamy

One of the most important parts of an end-to-end speaker verification system is the speaker embedding generation. In our previous paper, we reported that shortcut connections-based multi-layer aggregation improves the representational power…

音频与语音处理 · 电气工程与系统科学 2020-07-29 Soonshin Seo , Ji-Hwan Kim

Deep learning is progressively gaining popularity as a viable alternative to i-vectors for speaker recognition. Promising results have been recently obtained with Convolutional Neural Networks (CNNs) when fed by raw speech samples directly.…

音频与语音处理 · 电气工程与系统科学 2019-08-12 Mirco Ravanelli , Yoshua Bengio

Split-Federated (SplitFed) learning is an extension of federated learning that places minimal requirements on the clients computing infrastructure, since only a small portion of the overall model is deployed on the clients hardware. In…

计算机视觉与模式识别 · 计算机科学 2026-01-28 Zahra Hafezi Kafshgari , Ivan V. Bajic , Parvaneh Saeedi

We propose an end-to-end joint optimization framework of a multi-channel neural speech extraction and deep acoustic model without mel-filterbank (FBANK) extraction for overlapped speech recognition. First, based on a multi-channel…

音频与语音处理 · 电气工程与系统科学 2019-10-31 Bo Wu , Meng Yu , Lianwu Chen , Chao Weng , Dan Su , Dong Yu

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

声音 · 计算机科学 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee