English
Related papers

Related papers: Enhancing Gappy Speech Audio Signals with Generati…

200 papers

We present VoiceRestore, a novel approach to restoring the quality of speech recordings using flow-matching Transformers trained in a self-supervised manner on synthetic data. Our method tackles a wide range of degradations frequently found…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Stanislav Kirdey

Data augmentation has proven to be a promising prospect in improving the performance of deep learning models by adding variability to training data. In previous work with developing a noise robust acoustic-to-articulatory speech inversion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yashish M. Siriwardena , Ahmed Adel Attia , Ganesh Sivaraman , Carol Espy-Wilson

Generative adversarial nets (GAN) has been successfully introduced for generating text to alleviate the exposure bias. However, discriminators in these models only evaluate the entire sequence, which causes feedback sparsity and mode…

Machine Learning · Computer Science 2019-05-31 Xingyuan Chen , Yanzhe Li , Peng Jin , Jiuhua Zhang , Xinyu Dai , Jiajun Chen , Gang Song

With the rapid development of neural networks in recent years, the ability of various networks to enhance the magnitude spectrum of noisy speech in the single-channel speech enhancement domain has become exceptionally outstanding. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Shiqi Zhang , Zheng Qiu , Daiki Takeuchi , Noboru Harada , Shoji Makino

Multi-channel speech enhancement aims to extract clean speech from a noisy mixture using signals captured from multiple microphones. Recently proposed methods tackle this problem by incorporating deep neural network models with spatial…

Sound · Computer Science 2021-02-16 Panagiotis Tzirakis , Anurag Kumar , Jacob Donley

Estimating the perceived quality of an audio signal is critical for many multimedia and audio processing systems. Providers strive to offer optimal and reliable services in order to increase the user quality of experience (QoE). In this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-03-19 Anderson R. Avila , Hannes Gamper , Chandan Reddy , Ross Cutler , Ivan Tashev , Johannes Gehrke

In this paper, we propose multi-band MelGAN, a much faster waveform generation model targeting to high-quality text-to-speech. Specifically, we improve the original MelGAN by the following aspects. First, we increase the receptive field of…

Sound · Computer Science 2020-11-18 Geng Yang , Shan Yang , Kai Liu , Peng Fang , Wei Chen , Lei Xie

Thanks to the growing availability of spoofing databases and rapid advances in using them, systems for detecting voice spoofing attacks are becoming more and more capable, and error rates close to zero are being reached for the ASVspoof2015…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-05 Jaime Lorenzo-Trueba , Fuming Fang , Xin Wang , Isao Echizen , Junichi Yamagishi , Tomi Kinnunen

In this paper, we present Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial network (GAN) that enhances audio measured with body-conduction microphones. This type of capture equipment suppresses ambient noise at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-18 Julien Hauret , Thomas Joubaud , Véronique Zimpfer , Éric Bavu

In this work, we propose Mel-FullSubNet, a single-channel Mel-spectrogram denoising and dereverberation network for improving both speech quality and automatic speech recognition (ASR) performance. Mel-FullSubNet takes as input the noisy…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Rui Zhou , Xian Li , Ying Fang , Xiaofei Li

Spectral subtraction, widely used for its simplicity, has been employed to address the Robot Ego Speech Filtering (RESF) problem for detecting speech contents of human interruption from robot's single-channel microphone recordings when it…

Robotics · Computer Science 2024-09-11 Yue Li , Koen V. Hindriks , Florian A. Kunneman

Speech bandwidth expansion is crucial for expanding the frequency range of low-bandwidth speech signals, thereby improving audio quality, clarity and perceptibility in digital applications. Its applications span telephony, compression,…

Sound · Computer Science 2024-07-30 Mahmoud Salhab , Haidar Harmanani

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

In this paper, we compare different audio signal representations, including the raw audio waveform and a variety of time-frequency representations, for the task of audio synthesis with Generative Adversarial Networks (GANs). We conduct the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Javier Nistal , Stefan Lattner , Gaël Richard

This paper addresses the challenge of audio-visual single-microphone speech separation and enhancement in the presence of real-world environmental noise. Our approach is based on generative inverse sampling, where we model clean speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Yochai Yemini , Yoav Ellinson , Rami Ben-Ari , Sharon Gannot , Ethan Fetaya

With active research in audio compression techniques yielding substantial breakthroughs, spectral reconstruction of low-quality audio waves remains a less indulged topic. In this paper, we propose a novel approach for reconstructing higher…

Sound · Computer Science 2021-08-10 Darshan Deshpande , Harshavardhan Abichandani

A novel variant of the Janssen method for audio inpainting is presented and compared to other popular audio inpainting methods based on autoregressive (AR) modeling. Both conceptual differences and practical implications are discussed. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-09 Ondřej Mokrý , Pavel Rajmic

Real-world speech communication is rarely affected by a single type of degradation. Instead, it suffers from a complex interplay of acoustic interference, codec compression, and, increasingly, secondary artifacts introduced by upstream…

Sound · Computer Science 2025-12-30 Junan Zhang , Mengyao Zhu , Xin Xu , Hui Bu , Zhenhua Ling , Zhizheng Wu

Automatic Speech Recognition services (ASRs) inherit deep neural networks' vulnerabilities like crafted adversarial examples. Existing methods often suffer from low efficiency because the target phases are added to the entire audio sample,…

Sound · Computer Science 2022-02-14 Yuantian Miao , Chao Chen , Lei Pan , Jun Zhang , Yang Xiang

Generative Adversarial Networks (GANs) are a promising approach to language generation. The latest works introducing novel GAN models for language generation use n-gram based metrics for evaluation and only report single scores of the best…

Computation and Language · Computer Science 2019-07-19 Stanislau Semeniuta , Aliaksei Severyn , Sylvain Gelly