English
Related papers

Related papers: Neural Vocoder is All You Need for Speech Super-re…

200 papers

This paper proposes a novel neural denoising vocoder that can generate clean speech waveforms from noisy mel-spectrograms. The proposed neural denoising vocoder consists of two components, i.e., a spectrum predictor and a enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-20 Hui-Peng Du , Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Super-Resolution (SR) is a critical task in computer vision, focusing on reconstructing high-resolution (HR) images from low-resolution (LR) inputs. The field has seen significant progress through various challenges, particularly in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Babak Naderi , Ross Cutler , Juhee Cho , Nabakumar Khongbantabam , Dejan Ivkovic

Despite the rapid progress in speech enhancement (SE) research, enhancing the quality of desired speech in environments with strong noise and interfering speakers remains challenging. In this paper, we extend the application of the recently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-07 Jianwei Yu , Yi Luo , Hangting Chen , Rongzhi Gu , Chao Weng

The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the…

Image and Video Processing · Electrical Eng. & Systems 2024-12-16 Jing Sun , Qiangqiang Yuan , Huanfeng Shen , Jie Li , Liangpei Zhang

High-resolution radar range profile (RRP) is crucial for accurate target recognition and scene perception. To get a high-resolution RRP, many methods have been developed, such as multiple signal classification (MUSIC), orthogonal matching…

Signal Processing · Electrical Eng. & Systems 2025-10-21 Ziwen Wang , Jianping Wang , Pucheng Li , Zegang Ding

State-of-the-art statistical parametric speech synthesis (SPSS) generally uses a vocoder to represent speech signals and parameterize them into features for subsequent modeling. Magnitude spectrum has been a dominant feature over the years.…

Sound · Computer Science 2015-10-08 Bo Fan , Siu Wa Lee , Xiaohai Tian , Lei Xie , Minghui Dong

Humans have the ability to utilize visual cues, such as lip movements and visual scenes, to enhance auditory perception, particularly in noisy environments. However, current Automatic Speech Recognition (ASR) or Audio-Visual Speech…

Computation and Language · Computer Science 2025-04-11 Lakshmipathi Balaji , Karan Singla

Recent research in speaker verification has increasingly focused on achieving robust and reliable recognition under challenging channel conditions and noisy environments. Identifying speakers in radio communications is particularly…

Sound · Computer Science 2024-06-18 Wenhao Yang , Jianguo Wei , Wenhuan Lu , Lei Li , Xugang Lu

Visual speech recognition (VSR), which decodes spoken words from video data, offers significant benefits, particularly when audio is unavailable. However, the high dimensionality of video data leads to prohibitive computational costs that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Iason Ioannis Panagos , Giorgos Sfikas , Christophoros Nikou

Video super-resolution (VSR) is a prominent research topic in low-level computer vision, where deep learning technologies have played a significant role. The rapid progress in deep learning and its applications in VSR has led to a…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Arbind Agrahari Baniya , Tsz-Kwan Lee , Peter Eklund , Sunil Aryal

Automatic Speech Recognition (ASR) systems are known to exhibit difficulties when transcribing children's speech. This can mainly be attributed to the absence of large children's speech corpora to train robust ASR models and the resulting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jenthe Thienpondt , Kris Demuynck

Hyperspectral images are crucial for many research works. Spectral super-resolution (SSR) is a method used to obtain high spatial resolution (HR) hyperspectral images from HR multispectral images. Traditional SSR methods include…

Image and Video Processing · Electrical Eng. & Systems 2020-12-09 Jiang He , Jie Li , Qiangqiang Yuan , Huanfeng Shen , Liangpei Zhang

Recently, image super-resolution has been widely studied and achieved significant progress by leveraging the power of deep convolutional neural networks. However, there has been limited advancement in video super-resolution (VSR) due to the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Chao Li , Dongliang He , Xiao Liu , Yukang Ding , Shilei Wen

Purely neural network (NN) based speech separation and enhancement methods, although can achieve good objective scores, inevitably cause nonlinear speech distortions that are harmful for the automatic speech recognition (ASR). On the other…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-03 Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Chao Weng , Jianming Liu , Dong Yu

Audiovisual speech recognition (AVSR) is a method to alleviate the adverse effect of noise in the acoustic signal. Leveraging recent developments in deep neural network-based speech recognition, we present an AVSR neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Michael Wand , Ngoc Thang Vu , Juergen Schmidhuber

Traditional speech enhancement systems produce speech with compromised quality. Here we propose to use the high quality speech generation capability of neural vocoders for better quality speech enhancement. We term this parametric…

Sound · Computer Science 2019-11-15 Soumi Maiti , Michael I Mandel

High Resolution (HR) medical images provide rich anatomical structure details to facilitate early and accurate diagnosis. In MRI, restricted by hardware capacity, scan time, and patient cooperation ability, isotropic 3D HR image acquisition…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Qing Wu , Yuwei Li , Yawen Sun , Yan Zhou , Hongjiang Wei , Jingyi Yu , Yuyao Zhang

Most neural network speech enhancement models ignore speech production mathematical models by directly mapping Fourier transform spectrums or waveforms. In this work, we propose a neural source filter network for speech enhancement.…

Sound · Computer Science 2022-10-31 Shulin He , Wei Rao , Jinjiang Liu , Jun Chen , Yukai Ju , Xueliang Zhang , Yannan Wang , Shidong Shang

Individuals with hearing impairments face challenges in their ability to comprehend speech, particularly in noisy environments. The aim of this study is to explore the effectiveness of audio-visual speech enhancement (AVSE) in enhancing the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-07 Richard Lee Lai , Jen-Cheng Hou , I-Chun Chern , Kuo-Hsuan Hung , Yi-Ting Chen , Mandar Gogate , Tughrul Arslan , Amir Hussain , Yu Tsao