English
Related papers

Related papers: FFC-SE: Fast Fourier Convolution for Speech Enhanc…

200 papers

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

The neural network and quantum computing are both significant and appealing fields, with their interactive disciplines promising for large-scale computing tasks that are untackled by conventional computers. However, both developments are…

Quantum Physics · Physics 2021-06-22 Feihong Shen , Jun Liu

Audio-visual speech enhancement system is regarded to be one of promising solutions for isolating and enhancing speech of desired speaker. Conventional methods focus on predicting clean speech spectrum via a naive convolution neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-28 Xinmeng Xu , Jianjun Hao

Fully Convolution Networks (FCN) have achieved great success in dense prediction tasks including semantic segmentation. In this paper, we start from discussing FCN by understanding its architecture limitations in building a strong…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Bing Shuai , Ting Liu , Gang Wang

Convolutional recurrent networks (CRN) integrating a convolutional encoder-decoder (CED) structure and a recurrent structure have achieved promising performance for monaural speech enhancement. However, feature representation across…

Sound · Computer Science 2024-12-02 Shengkui Zhao , Bin Ma , Karn N. Watcharasupat , Woon-Seng Gan

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

Convolutional neural networks (CNN) and Transformer have wildly succeeded in multimedia applications. However, more effort needs to be made to harmonize these two architectures effectively to satisfy speech enhancement. This paper aims to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Xinmeng Xu , Weiping Tu , Yuhong Yang

This paper proposes to use Fast Fourier Transformation-based U-Net (a refined fully convolutional networks) and perform image convolution in neural networks. Leveraging the Fast Fourier Transformation, it reduces the image convolution costs…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Varsha Nair , Moitrayee Chatterjee , Neda Tavakoli , Akbar Siami Namin , Craig Snoeyink

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

We propose Sequential Feature Filtering Classifier (FFC), a simple but effective classifier for convolutional neural networks (CNNs). With sequential LayerNorm and ReLU, FFC zeroes out low-activation units and preserves high-activation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Minseok Seo , Jaemin Lee , Jongchan Park , Dong-Geol Choi

It is highly desirable that speech enhancement algorithms can achieve good performance while keeping low latency for many applications, such as digital hearing aids, acoustically transparent hearing devices, and public address systems. To…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-01 Chengshi Zheng , Wenzhe Liu , Andong Li , Yuxuan Ke , Xiaodong Li

Minimal changes to neural architectures (e.g. changing a single hyperparameter in a key layer), can lead to significant gains in predictive performance in Convolutional Neural Networks (CNNs). In this work, we present a new approach to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Mats L. Richter , Christopher Pal

Recent vision transformers, large-kernel CNNs and MLPs have attained remarkable successes in broad vision tasks thanks to their effective information fusion in the global scope. However, their efficient deployments, especially on mobile…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Zhipeng Huang , Zhizheng Zhang , Cuiling Lan , Zheng-Jun Zha , Yan Lu , Baining Guo

Brain-inspired machine learning is gaining increasing consideration, particularly in computer vision. Several studies investigated the inclusion of top-down feedback connections in convolutional networks; however, it remains unclear how and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Andrea Alamia , Milad Mozafari , Bhavin Choksi , Rufin VanRullen

We propose a multi-scale octave convolution layer to learn robust speech representations efficiently. Octave convolutions were introduced by Chen et al [1] in the computer vision field to reduce the spatial redundancy of the feature maps by…

Computation and Language · Computer Science 2019-11-01 Joanna Rownicka , Peter Bell , Steve Renals

The combined electric and acoustic stimulation (EAS) has demonstrated better speech recognition than conventional cochlear implant (CI) and yielded satisfactory performance under quiet conditions. However, when noise signals are involved,…

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie

In hearing aids, the presence of babble noise degrades hearing intelligibility of human speech greatly. However, removing the babble without creating artifacts in human speech is a challenging task in a low SNR environment. Here, we sought…

Machine Learning · Computer Science 2016-09-23 Se Rim Park , Jinwon Lee

We present a novel method to provide efficient and highly detailed reconstructions. Inspired by wavelets, we learn a neural field that decompose the signal both spatially and frequency-wise. We follow the recent grid-based paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zhijie Wu , Yuhe Jin , Kwang Moo Yi

Dilated convolution, which expands the receptive field by inserting gaps between its consecutive elements, is widely employed in computer vision. In this study, we propose three strategies to improve individual phases of dilated convolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Linwei Chen , Lin Gu , Ying Fu