English
Related papers

Related papers: iSTFTNet2: Faster and More Lightweight iSTFT-Based…

200 papers

The goal of this paper is to generate realistic audio with a lightweight and fast diffusion-based vocoder, named FreGrad. Our framework consists of the following three key components: (1) We employ discrete wavelet transform that decomposes…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-19 Tan Dat Nguyen , Ji-Hoon Kim , Youngjoon Jang , Jaehun Kim , Joon Son Chung

Low-light image enhancement is a classical computer vision problem aiming to recover normal-exposure images from low-light images. However, convolutional neural networks commonly used in this field are good at sampling low-frequency local…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Yunliang Zhuang , Zhuoran Zheng , Chen Lyu

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

Learning convolutional neural networks (CNNs) with low bitwidth is challenging because performance may drop significantly after quantization. Prior arts often discretize the network weights by carefully tuning hyper-parameters of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chaofan Tao , Rui Lin , Quan Chen , Zhaoyang Zhang , Ping Luo , Ngai Wong

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

Sound · Computer Science 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

Deep learning-based speech enhancement methods have significantly improved speech quality and intelligibility. Convolutional neural networks (CNNs) have been proven to be essential components of many high-performance models. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Dahan Wang , Xiaobin Rong , Shiruo Sun , Yuxiang Hu , Changbao Zhu , Jing Lu

The recent WSNet [1] is a new model compression method through sampling filterweights from a compact set and has demonstrated to be effective for 1D convolutionneural networks (CNNs). However, the weights sampling strategy of WSNet…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Daquan Zhou , Xiaojie Jin , Qibin Hou , Kaixin Wang , Jianchao Yang , Jiashi Feng

In recent years, neural networks have been used to solve phase retrieval problems in imaging with superior accuracy and speed than traditional techniques, especially in the presence of noise. However, in the context of interferometric…

Untrained neural networks (UNNs) offer high-fidelity electromagnetic inverse scattering reconstruction but are computationally limited by high-dimensional spatial-domain optimization. We propose a Real-Time Physics-Driven Fourier-Spectral…

Machine Learning · Computer Science 2026-02-17 Yutong Du , Zicheng Liu , Yi Huang , Bazargul Matkerim , Bo Qi , Yali Zong , Peixian Han

In this paper, we optimize a faster region-based convolutional neural network (FRCNN) for 1-dimensional (1D) signal processing and electromagnetic spectrum sensing. We target a cluttered radio frequency (RF) environment, where multiple RF…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Todd Morehouse , Charles Montes , Ruolin Zhou

This paper describes the IDLab submission for the text-independent task of the Short-duration Speaker Verification Challenge 2021 (SdSVC-21). This speaker verification competition focuses on short duration test recordings and cross-lingual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-10 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck

We focus on the word-level visual lipreading, which requires recognizing the word being spoken, given only the video but not the audio. State-of-the-art methods explore the use of end-to-end neural networks, including a shallow (up to three…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Xinshuo Weng , Kris Kitani

The synchrosqueezing transform, a kind of reassignment method, aims to sharpen the time-frequency representation and to separate the components of a multicomponent non-stationary signal. In this paper, we consider the short-time Fourier…

Signal Processing · Electrical Eng. & Systems 2019-09-27 Lin Li , Haiyan Cai , Hongxia Han , Qingtang Jiang , Hongbing Ji

Todays interactive devices such as smart-phone assistants and smart speakers often deal with short-duration speech segments. As a result, speaker recognition systems integrated into such devices will be much better suited with models…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-25 Amirhossein Hajavi , Ali Etemad

In this paper, we propose a two-stage heterogeneous lightweight network for monaural speech enhancement. Specifically, we design a novel two-stage framework consisting of a coarse-grained full-band mask estimation stage and a fine-grained…

Sound · Computer Science 2023-05-22 Feng Dang , Qi Hu , Pengyuan Zhang

In this work, we explore the constant-Q transform (CQT) for speech emotion recognition (SER). The CQT-based time-frequency analysis provides variable spectro-temporal resolution with higher frequency resolution at lower frequencies. Since…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Premjeet Singh , Goutam Saha , Md Sahidullah

In this letter, a lightweight one-dimensional convolutional neural network (1-D CNN)-based timing synchronization (TS) method is proposed to reduce the computational complexity and processing delay and hold the timing accuracy in orthogonal…

Signal Processing · Electrical Eng. & Systems 2022-09-15 Chaojin Qing , Shuhai Tang , Xi Cai , Jiafan Wang

Convolutional neural networks (CNNs) with dilated filters such as the Wavenet or the Temporal Convolutional Network (TCN) have shown good results in a variety of sequence modelling tasks. However, efficiently modelling long-term…

Machine Learning · Computer Science 2019-11-18 Daniel Stoller , Mi Tian , Sebastian Ewert , Simon Dixon

Convolutional neural networks (CNNs) and transformer architectures offer strengths for modeling temporal data: CNNs excel at capturing local patterns and translational invariances, while transformers effectively model long-range…

Machine Learning · Computer Science 2025-10-09 Stefano F. Stefenon , João P. Matos-Carvalho , Valderi R. Q. Leithardt , Kin-Choong Yow

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie