中文
相关论文

相关论文: An Efficient Speech Separation Network Based on Re…

200 篇论文

Speech enhancement is a demanding task in automated speech processing pipelines, focusing on separating clean speech from noisy channels. Transformer based models have recently bested RNN and CNN models in speech enhancement, however at the…

声音 · 计算机科学 2023-08-07 Jinyu Long , Jetic Gū , Binhao Bai , Zhibo Yang , Ping Wei , Junli Li

This paper introduces a new method for multi-channel time domain speech separation in reverberant environments. A fully-convolutional neural network structure has been used to directly separate speech from multiple microphone recordings,…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

In this paper, we show that a simple self-supervised pre-trained audio model can achieve comparable inference efficiency to more complicated pre-trained models with speech transformer encoders. These speech transformers rely on mixing…

声音 · 计算机科学 2024-02-09 Sungho Jeon , Ching-Feng Yeh , Hakan Inan , Wei-Ning Hsu , Rashi Rungta , Yashar Mehdad , Daniel Bikel

2D convolutional neural networks (CNNs) have attracted significant attention for hyperspectral image super-resolution tasks. However, a key limitation is their reliance on local neighborhoods, which leads to a lack of global contextual…

图像与视频处理 · 电气工程与系统科学 2025-06-06 Usman Muhammad , Jorma Laaksonen

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

计算与语言 · 计算机科学 2016-10-12 Xiangang Li , Xihong Wu

At a cocktail party, humans exhibit an impressive ability to direct their attention. The auditory attention detection (AAD) approach seeks to identify the attended speaker by analyzing brain signals, such as EEG signals. However, current…

音频与语音处理 · 电气工程与系统科学 2024-11-19 Sheng Yan , Cunhang fan , Hongyu Zhang , Xiaoke Yang , Jianhua Tao , Zhao Lv

In NLP, convolutional neural networks (CNNs) have benefited less than recurrent neural networks (RNNs) from attention mechanisms. We hypothesize that this is because the attention in CNNs has been mainly implemented as attentive pooling…

计算与语言 · 计算机科学 2018-11-14 Wenpeng Yin , Hinrich Schütze

This paper proposes a Convolutional Neural Network (CNN) inspired by Multitask Learning (MTL) and based on speech features trained under the joint supervision of softmax loss and center loss, a powerful metric learning strategy, for the…

声音 · 计算机科学 2019-09-04 Suraj Tripathi , Abhiram Ramesh , Abhay Kumar , Chirag Singh , Promod Yenigalla

Attention mechanisms, such as local and non-local attention, play a fundamental role in recent deep learning based speech enhancement (SE) systems. However, natural speech contains many fast-changing and relatively brief acoustic events,…

音频与语音处理 · 电气工程与系统科学 2023-01-16 Xinmeng Xu , Weiping Tu , Yuhong Yang

This paper studies inference acceleration using distributed convolutional neural networks (CNNs) in collaborative edge computing network. To avoid inference accuracy loss in inference task partitioning, we propose receptive field-based…

分布式、并行与集群计算 · 计算机科学 2022-07-26 Nan Li , Alexandros Iosifidis , Qi Zhang

Medical images play an important role in clinical applications. Multimodal medical images could provide rich information about patients for physicians to diagnose. The image fusion technique is able to synthesize complementary information…

计算机视觉与模式识别 · 计算机科学 2022-12-12 Meng Zhou , Xiaolan Xu , Yuxuan Zhang

The deep convolutional neural networks (CNNs) using attention mechanism have achieved great success for dynamic scene deblurring. In most of these networks, only the features refined by the attention maps can be passed to the next layer and…

计算机视觉与模式识别 · 计算机科学 2023-01-31 Xia Hua , Mingxin Li , Junxiong Fei , Yu Shi , JianGuo Liu , Hanyu Hong

Integration of multiple microphone data is one of the key ways to achieve robust speech recognition in noisy environments or when the speaker is located at some distance from the input device. Signal processing techniques such as…

机器学习 · 计算机科学 2016-01-11 Suyoun Kim , Ian Lane

Speech separation refers to extracting each individual speech source in a given mixed signal. Recent advancements in speech separation and ongoing research in this area, have made these approaches as promising techniques for pre-processing…

机器学习 · 计算机科学 2019-12-18 Fahimeh Bahmaninezhad , Shi-Xiong Zhang , Yong Xu , Meng Yu , John H. L. Hansen , Dong Yu

Precise and accurate predictions over boundary areas are essential for semantic segmentation. However, the commonly-used convolutional operators tend to smooth and blur local detail cues, making it difficult for deep models to generate…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Haoru Tan , Sitong Wu , Jimin Pi

In speech enhancement, complex neural network has shown promising performance due to their effectiveness in processing complex-valued spectrum. Most of the recent speech enhancement approaches mainly focus on wide-band signal with a…

音频与语音处理 · 电气工程与系统科学 2021-11-17 Shubo Lv , Yihui Fu , Mengtao Xing , Jiayao Sun , Lei Xie , Jun Huang , Yannan Wang , Tao Yu

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

计算与语言 · 计算机科学 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

We propose a new end-to-end neural acoustic model for automatic speech recognition. The model is composed of multiple blocks with residual connections between them. Each block consists of one or more modules with 1D time-channel separable…

音频与语音处理 · 电气工程与系统科学 2019-10-24 Samuel Kriman , Stanislav Beliaev , Boris Ginsburg , Jocelyn Huang , Oleksii Kuchaiev , Vitaly Lavrukhin , Ryan Leary , Jason Li , Yang Zhang

Radio frequency fingerprinting (RFF) is a promising device authentication technique for securing the Internet of things. It exploits the intrinsic and unique hardware impairments of the transmitters for RF device identification. In…

信号处理 · 电气工程与系统科学 2023-06-26 Yuan Zeng , Yi Gong , Jiawei Liu , Shangao Lin , Zidong Han , Ruoxiao Cao , Kaibin Huang , Khaled Ben Letaief

This work proposes a multichannel narrow-band speech separation network. In the short-time Fourier transform (STFT) domain, the proposed network processes each frequency independently, and all frequencies use a shared network. For each…

声音 · 计算机科学 2022-12-06 Changsheng Quan , Xiaofei Li