English
Related papers

Related papers: A Neural Speech Codec for Noise Robust Speech Codi…

200 papers

The ever-growing size of neural networks poses serious challenges on resource-constrained devices, such as embedded sensors. Compression algorithms that reduce their size can mitigate these problems, provided that model performance stays…

Machine Learning · Computer Science 2025-05-27 Alexander Conzelmann , Robert Bamler

We propose a multi-stage framework for universal speech enhancement, designed for the Interspeech 2025 URGENT Challenge. Our system first employs a Sparse Compression Network to robustly separate sources and extract an initial clean speech…

Sound · Computer Science 2025-06-03 Nabarun Goswami , Tatsuya Harada

In recent years, the introduction of neural networks (NNs) into the field of speech enhancement has brought significant improvements. However, many of the proposed methods are quite demanding in terms of computational complexity and memory…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-19 Ernst Seidel , Pejman Mowlaee , Tim Fingscheidt

Overfitted neural video codecs offer a decoding complexity orders of magnitude smaller than their autoencoder counterparts. Yet, this low complexity comes at the cost of limited compression efficiency, in part due to their difficulty…

Image and Video Processing · Electrical Eng. & Systems 2025-03-27 Thomas Leguay , Théo Ladune , Pierrick Philippe , Olivier Deforges

A divide and conquer strategy for enhancement of noisy speeches in adverse environments involving lower levels of SNR is presented in this paper, where the total system of speech enhancement is divided into two separate steps. The first…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-09 Md Tauhidul Islam , Celia Shahnaz , Wei-Ping Zhu , M. Omair Ahmad

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication reliability over…

Information Theory · Computer Science 2023-06-09 Junghoon Kim , Taejoon Kim , David Love , Christopher Brinton

Dysarthric speech reconstruction (DSR) aims to transform dysarthric speech into normal speech. It still suffers from low speaker similarity and poor prosody naturalness. In this paper, we propose a multi-modal DSR model by leveraging neural…

Sound · Computer Science 2024-06-25 Xueyuan Chen , Dongchao Yang , Dingdong Wang , Xixin Wu , Zhiyong Wu , Helen Meng

Despite noise suppression being a mature area in signal processing, it remains highly dependent on fine tuning of estimator algorithms and parameters. In this paper, we demonstrate a hybrid DSP/deep learning approach to noise suppression. A…

Sound · Computer Science 2018-06-04 Jean-Marc Valin

With the emergence of neural audio codecs, which encode multiple streams of discrete tokens from audio, large language models have recently gained attention as a promising approach for zero-shot Text-to-Speech (TTS) synthesis. Despite the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-04 Jaehyeon Kim , Keon Lee , Seungjun Chung , Jaewoong Cho

This paper proposes a novel technique to obtain better downstream ASR performance from a joint encoder-decoder self-supervised model when trained with speech pooled from two different channels (narrow and wide band). The joint…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Vrunda N. Sukhadia , A. Arunkumar , S. Umesh

We consider the problem of simultaneous reduction of acoustic echo, reverberation and noise. In real scenarios, these distortion sources may occur simultaneously and reducing them implies combining the corresponding distortion-specific…

Sound · Computer Science 2020-07-28 Guillaume Carbajal , Romain Serizel , Emmanuel Vincent , Eric Humbert

Automatic detection of synthetic speech is becoming increasingly important as current synthesis methods are both near indistinguishable from human speech and widely accessible to the public. Audio watermarking and other active disclosure…

Sound · Computer Science 2024-09-23 Lauri Juvela , Xin Wang

The emergence of audio language models is empowered by neural audio codecs, which establish critical mappings between continuous waveforms and discrete tokens compatible with language model paradigms. The evolutionary trends from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-28 Yidi Jiang , Qian Chen , Shengpeng Ji , Yu Xi , Wen Wang , Chong Zhang , Xianghu Yue , ShiLiang Zhang , Haizhou Li

Speech enhancement algorithms based on deep learning have greatly surpassed their traditional counterparts and are now being considered for the task of removing acoustic echo from hands-free communication systems. This is a challenging…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-11 Jean-Marc Valin , Srikanth Tenneti , Karim Helwani , Umut Isik , Arvindh Krishnaswamy

Any-to-any singing voice conversion (SVC) is confronted with the challenge of ``timbre leakage'' issue caused by inadequate disentanglement between the content and the speaker timbre. To address this issue, this study introduces NeuCoSVC, a…

Sound · Computer Science 2024-01-09 Binzhu Sha , Xu Li , Zhiyong Wu , Ying Shan , Helen Meng

Self-supervised frameworks that learn denoising models with merely individual noisy images have shown strong capability and promising performance in various image denoising tasks. Existing self-supervised denoising frameworks are mostly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Yaochen Xie , Zhengyang Wang , Shuiwang Ji

Hybrid meetings have become increasingly necessary during the post-COVID period and also brought new challenges for solving audio-related problems. In particular, the interplay between acoustic echo and acoustic howling in a hybrid meeting…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-05 Hao Zhang , Meng Yu , Dong Yu

Large language model (LLM) based zero-shot text-to-speech (TTS) methods tend to preserve the acoustic environment of the audio prompt, leading to degradation in synthesized speech quality when the audio prompt contains noise. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ye-Xin Lu , Hui-Peng Du , Fei Liu , Yang Ai , Zhen-Hua Ling

Enhancing coded speech suffering from far-end acoustic background noise, quantization noise, and potentially transmission errors, is a challenging task. In this work we propose two postprocessing approaches applying convolutional neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-01-25 Ziyue Zhao , Huijun Liu , Tim Fingscheidt

Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading…

Signal Processing · Electrical Eng. & Systems 2023-04-20 Qiyu Hu , Guangyi Zhang , Zhijin Qin , Yunlong Cai , Guanding Yu , Geoffrey Ye Li