English
Related papers

Related papers: Depthwise Separable Convolutions Versus Recurrent …

200 papers

Deep Neural Network (DNN) acoustic models have yielded many state-of-the-art results in Automatic Speech Recognition (ASR) tasks. More recently, Recurrent Neural Network (RNN) models have been shown to outperform DNNs counterparts. However,…

Machine Learning · Computer Science 2015-04-08 William Chan , Nan Rosemary Ke , Ian Lane

Deep Convolutional Neural Networks (DCNNs) are used extensively in medical image segmentation and hence 3D navigation for robot-assisted Minimally Invasive Surgeries (MISs). However, current DCNNs usually use down sampling layers for…

Machine Learning · Computer Science 2020-06-05 Xiao-Yun Zhou , Jian-Qing Zheng , Peichao Li , Guang-Zhong Yang

Deep convolutional neural networks (DCNNs) have recently demonstrated high-quality results in single-image super-resolution (SR). DCNNs often suffer from over-parametrization and large amounts of redundancy, which results in inefficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Yinglan Ma , Hongyu Xiong , Zhe Hu , Lizhuang Ma

Estimating time-frequency domain masks for speech enhancement using deep learning approaches has recently become a popular field of research. In this paper, we propose a mask-based speech enhancement framework by using concatenated…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-29 Ziyi Xu , Maximilian Strake , Tim Fingscheidt

Neural networks with Auto-regressive structures, such as Recurrent Neural Networks (RNNs), have become the most appealing structures for acoustic modeling of parametric text to speech synthesis (TTS) in ecent studies. Despite the prominent…

Sound · Computer Science 2018-11-30 Dabiao Ma , Zhiba Su , Yuhao Lu , Wenxuan Wang , Zhen Li

Convolutional Neural Networks (CNNs) have been successfully used in various Music Information Retrieval (MIR) tasks, both as end-to-end models and as feature extractors for more complex systems. However, the MIR field is still dominated by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Khaled Koutini , Hamid Eghbal-Zadeh , Verena Haunschmid , Paul Primus , Shreyan Chowdhury , Gerhard Widmer

In some DNNs for audio source separation, the relevant model parameters are independent of the sampling frequency of the audio used for training. Considering the application of dialogue separation, this is shown for two DNN architectures: a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-07 Jouni Paulus , Matteo Torcoli

Convolution is one of the basic building blocks of CNN architectures. Despite its common use, standard convolution has two main shortcomings: Content-agnostic and Computation-heavy. Dynamic filters are content-adaptive, while further…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Jingkai Zhou , Varun Jampani , Zhixiong Pi , Qiong Liu , Ming-Hsuan Yang

Recent progress in speech separation has been largely driven by advances in deep neural networks, yet their high computational and memory requirements hinder deployment on resource-constrained devices. A significant inefficiency in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-09 Mohamed Elminshawi , Srikanth Raj Chetupalli , Emanuël A. P. Habets

We present an efficient speech separation neural network, ARFDCN, which combines dilated convolutions, multi-scale fusion (MSF), and channel attention to overcome the limited receptive field of convolution-based networks and the high…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-12 Junyu Wang

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

Despite the appeal of deep neural networks that largely replace the traditional handmade filters, they still suffer from isolated cases that cannot be properly handled only by the training of convolutional filters. Abnormal factors,…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Jonghwa Yim , Kyung-Ah Sohn

This study explores the field of audio classification from raw waveform using Convolutional Neural Networks (CNNs), a method that eliminates the need for extracting specialised features in the pre-processing step. Unlike recent trends in…

Sound · Computer Science 2024-12-03 Kazi Nazmul Haque , Rajib Rana , Tasnim Jarin , Bjorn W. Schuller

Singing techniques are used for expressive vocal performances by employing temporal fluctuations of the timbre, the pitch, and other components of the voice. Their classification is a challenging task, because of mainly two factors: 1) the…

Sound · Computer Science 2022-06-27 Yuya Yamamoto , Juhan Nam , Hiroko Terasawa

Recurrent neural networks (RNNs) are a widely used deep architecture for sequence modeling, generation, and prediction. Despite success in applications such as machine translation and voice recognition, these stateful models have several…

Computation and Language · Computer Science 2020-04-23 Ankur Mali , Alexander Ororbia , Daniel Kifer , Clyde Lee Giles

Deep denoising models require extensive real-world training data, which is challenging to acquire. Current noise synthesis techniques struggle to accurately model complex noise distributions. We propose a novel Realistic Noise Synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Qi Wu , Mingyan Han , Ting Jiang , Chengzhi Jiang , Jinting Luo , Man Jiang , Haoqiang Fan , Shuaicheng Liu

Recurrent neural networks (RNNs) are a powerful model for sequential data. End-to-end training methods such as Connectionist Temporal Classification make it possible to train RNNs for sequence labelling problems where the input-output…

Neural and Evolutionary Computing · Computer Science 2013-03-26 Alex Graves , Abdel-rahman Mohamed , Geoffrey Hinton

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several residual blocks…

Image and Video Processing · Electrical Eng. & Systems 2019-04-12 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

In recent studies, diffusion models have shown promise as priors for solving audio inverse problems. These models allow us to sample from the posterior distribution of a target signal given an observed signal by manipulating the diffusion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Emilian Postolache , Emanuele Rodolà , György Fazekas

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan