English
Related papers

Related papers: ADNAC: Audio Denoiser using Neural Audio Codec

200 papers

Enhancing the sound quality of historical music recordings is a long-standing problem. This paper presents a novel denoising method based on a fully-convolutional deep neural network. A two-stage U-Net model architecture is designed to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Eloi Moliner , Vesa Välimäki

This paper comprehensively reviews recent advances in underwater acoustic signal denoising, an area critical for improving the reliability and clarity of underwater communication and monitoring systems. Despite significant progress in the…

Sound · Computer Science 2024-07-19 Ruobin Gao , Maohan Liang , Heng Dong , Xuewen Luo , P. N. Suganthan

Conventional audio coding technologies commonly leverage human perception of sound, or psychoacoustics, to reduce the bitrate while preserving the perceptual quality of the decoded audio signals. For neural audio codecs, however, the…

Sound · Computer Science 2021-01-05 Kai Zhen , Mi Suk Lee , Jongmo Sung , Seungkwon Beack , Minje Kim

EEG and audio are inherently distinct modalities, differing in sampling rate, channel structure, and scale. Yet, we show that pretrained neural audio codecs can serve as effective starting points for EEG compression, provided that the data…

Machine Learning · Computer Science 2025-12-01 Ard Kastrati , Luca Lanzendörfer , Riccardo Rigoni , John Staib Matilla , Roger Wattenhofer

Neural audio codecs are initially introduced to compress audio data into compact codes to reduce transmission latency. Researchers recently discovered the potential of codecs as suitable tokenizers for converting continuous audio into…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-21 Haibin Wu , Xuanjun Chen , Yi-Cheng Lin , Kai-wei Chang , Ho-Lam Chung , Alexander H. Liu , Hung-yi Lee

We present an end-to-end deep learning approach to denoising speech signals by processing the raw waveform directly. Given input audio containing speech corrupted by an additive background signal, the system aims to produce a processed…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-18 Francois G. Germain , Qifeng Chen , Vladlen Koltun

Neural audio codecs have recently gained traction for their ability to compress high-fidelity audio and provide discrete tokens for generative modeling. However, leading approaches often rely on resource-intensive models and complex…

Sound · Computer Science 2025-08-18 Linwei Zhai , Han Ding , Cui Zhao , fei wang , Ge Wang , Wang Zhi , Wei Xi

Neural audio codecs (NACs) achieve low-bitrate compression by learning compact audio representations, which can also serve as features for perceptual quality evaluation. We introduce DACe, an enhanced, higher-fidelity version of the…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-23 Arijit Biswas , Lars Villemoes

Audio codecs are typically transform-domain based and efficiently code stationary audio signals, but they struggle with speech and signals containing dense transient events such as applause. Specifically, with these two classes of signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-28 Arijit Biswas , Dai Jia

The bio-acoustic information contained within heart sound signals are utilized by physicians world-wide for auscultation purpose. However, the heart sounds are inherently susceptible to noise contamination. Various sources of noises like…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Ayan Mukherjee , Rohan Banerjee , Avik Ghose

Neural audio codecs have recently enabled high-fidelity reconstruction at high compression rates, especially for speech. However, speech and non-speech audio exhibit fundamentally different spectral characteristics: speech energy…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-11 Haoran Wang , Jiatong Shi , Jinchuan Tian , Bohan Li , Kai Yu , Shinji Watanabe

Audio watermarking is widely used for leaking source tracing. The robustness of the watermark determines the traceability of the algorithm. With the development of digital technology, audio re-recording (AR) has become an efficient and…

Sound · Computer Science 2023-04-04 Chang Liu , Jie Zhang , Han Fang , Zehua Ma , Weiming Zhang , Nenghai Yu

Neural audio codecs, leveraging quantization algorithms, have significantly impacted various speech/audio tasks. While high-fidelity reconstruction is paramount for human perception, audio coding for machines (ACoM) prioritizes efficient…

Sound · Computer Science 2025-08-06 Anastasia Kuznetsova , Inseon Jang , Wootaek Lim , Minje Kim

We introduce a state-of-the-art real-time, high-fidelity, audio codec leveraging neural networks. It consists in a streaming encoder-decoder architecture with quantized latent space trained in an end-to-end fashion. We simplify and speed-up…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Alexandre Défossez , Jade Copet , Gabriel Synnaeve , Yossi Adi

In neural-based audio feature extraction, ensuring that representations capture disentangled information is crucial for model interpretability. However, existing disentanglement methods often rely on assumptions that are highly dependent on…

Sound · Computer Science 2025-10-07 Benoit Ginies , Xiaoyu Bie , Olivier Fercoq , Gaël Richard

Existing deep learning-based speech denoising approaches require clean speech signals to be available for training. This paper presents a deep learning-based approach to improve speech denoising in real-world audio environments by not…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-25 Nasim Alamdari , Arian Azarang , Nasser Kehtarnavaz

The emergence of audio language models is empowered by neural audio codecs, which establish critical mappings between continuous waveforms and discrete tokens compatible with language model paradigms. The evolutionary trends from…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-28 Yidi Jiang , Qian Chen , Shengpeng Ji , Yu Xi , Wen Wang , Chong Zhang , Xianghu Yue , ShiLiang Zhang , Haizhou Li

Lifelong audio feature extraction involves learning new sound classes incrementally, which is essential for adapting to new data distributions over time. However, optimizing the model only on new data can lead to catastrophic forgetting of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-08 Xilin Jiang , Yinghao Aaron Li , Nima Mesgarani

Neural audio codecs, neural networks which compress a waveform into discrete tokens, play a crucial role in the recent development of audio generative models. State-of-the-art codecs rely on the end-to-end training of an autoencoder and a…

Sound · Computer Science 2025-03-26 Zineb Lahrichi , Gaëtan Hadjeres , Gael Richard , Geoffroy Peeters

Neural audio coding has been shown to outperform classical audio coding at extremely low bitrates. However, the practical application of neural audio codecs is still limited by their elevated complexity. To address this challenge, we have…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-20 Jiawei Jiang , Linping Xu , Dejun Zhang , Qingbo Huang , Xianjun Xia , Yijian Xiao