中文
相关论文

相关论文: High Fidelity Neural Audio Compression

200 篇论文

High-fidelity general audio compression at ultra-low bitrates is crucial for applications ranging from low-bandwidth communication to generative audio-language modeling. Traditional audio compression methods and contemporary neural codecs…

音频与语音处理 · 电气工程与系统科学 2026-02-03 Hao Ma , Ruihao Jing , Shansong Liu , Cheng Gong , Chi Zhang , Xiao-Lei Zhang , Xuelong Li

A good audio codec for live applications such as telecommunication is characterized by three key properties: (1) compression, i.e.\ the bitrate that is required to transmit the signal should be as low as possible; (2) latency, i.e.\…

音频与语音处理 · 电气工程与系统科学 2023-05-29 Yi-Chiao Wu , Israel D. Gebru , Dejan Marković , Alexander Richard

The escalating challenges of managing vast sensor-generated data, particularly in audio applications, necessitate innovative solutions. Current systems face significant computational and storage demands, especially in real-time applications…

Neural audio codecs have recently gained traction for their ability to compress high-fidelity audio and provide discrete tokens for generative modeling. However, leading approaches often rely on resource-intensive models and complex…

声音 · 计算机科学 2025-08-18 Linwei Zhai , Han Ding , Cui Zhao , fei wang , Ge Wang , Wang Zhi , Wei Xi

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

声音 · 计算机科学 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

Recently, denoising diffusion models have demonstrated remarkable performance among generative models in various domains. However, in the speech domain, the application of diffusion models for synthesizing time-varying audio faces…

音频与语音处理 · 电气工程与系统科学 2023-06-13 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

Speech coding facilitates the transmission of speech over low-bandwidth networks with minimal distortion. Neural-network based speech codecs have recently demonstrated significant improvements in quality over traditional approaches. While…

声音 · 计算机科学 2022-07-07 Ali Siahkoohi , Michael Chinen , Tom Denton , W. Bastiaan Kleijn , Jan Skoglund

While existing speech audio codecs designed for compression exploit limited forms of temporal redundancy and allow for multi-scale representations, they tend to represent all features of audio in the same way. In contrast, generative voice…

声音 · 计算机科学 2025-09-22 Ryan Collette , Ross Greenwood , Serena Nicoll

We present a scalable and efficient neural waveform coding system for speech compression. We formulate the speech coding problem as an autoencoding task, where a convolutional neural network (CNN) performs encoding and decoding as a neural…

音频与语音处理 · 电气工程与系统科学 2021-11-30 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beak , Minje Kim

Recent advancements in end-to-end neural speech codecs enable compressing audio at extremely low bitrates while maintaining high-fidelity reconstruction. Meanwhile, low computational complexity and low latency are crucial for real-time…

音频与语音处理 · 电气工程与系统科学 2026-01-21 Leyan Yang , Ronghui Hu , Yang Xu , Jing Lu

With recent research advancements, deep learning models are becoming attractive and powerful choices for speech enhancement in real-time applications. While state-of-the-art models can achieve outstanding results in terms of speech quality…

音频与语音处理 · 电气工程与系统科学 2021-05-20 Sebastian Braun , Hannes Gamper , Chandan K. A. Reddy , Ivan Tashev

Speech compression is commonly used to send voice over radio channels in applications such as mobile telephony and two-way push-to-talk (PTT) radio. In classical systems, the speech codec is combined with forward error correction,…

音频与语音处理 · 电气工程与系统科学 2025-07-29 David Rowe , Jean-Marc Valin

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

声音 · 计算机科学 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

While significant improvements have been made in recent years in terms of end-to-end automatic speech recognition (ASR) performance, such improvements were obtained through the use of very large neural networks, unfit for embedded use on…

计算与语言 · 计算机科学 2020-03-25 Alex Bie , Bharat Venkitesh , Joao Monteiro , Md. Akmal Haidar , Mehdi Rezagholizadeh

This paper proposes a novel neural audio codec, named APCodec+, which is an improved version of APCodec. The APCodec+ takes the audio amplitude and phase spectra as the coding object, and employs an adversarial training strategy.…

音频与语音处理 · 电气工程与系统科学 2024-10-31 Hui-Peng Du , Yang Ai , Rui-Chen Zheng , Zhen-Hua Ling

Bandwidth extension, the task of reconstructing the high-frequency components of an audio signal from its low-pass counterpart, is a long-standing problem in audio processing. While traditional approaches have evolved alongside the broader…

声音 · 计算机科学 2025-11-27 Benoît Giniès , Xiaoyu Bie , Olivier Fercoq , Gaël Richard

Audio autoencoders learn useful, compressed audio representations, but their non-linear latent spaces prevent intuitive algebraic manipulation such as mixing or scaling. We introduce a simple training methodology to induce linearity in a…

声音 · 计算机科学 2026-01-29 Bernardo Torres , Manuel Moussallam , Gabriel Meseguer-Brocal

We propose a method named AudioFormer,which learns audio feature representations through the acquisition of discrete acoustic codes and subsequently fine-tunes them for audio classification tasks. Initially,we introduce a novel perspective…

声音 · 计算机科学 2023-08-28 Zhaohui Li , Haitao Wang , Xinghua Jiang

This paper introduces a novel neural audio codec targeting high waveform sampling rates and low bitrates named APCodec, which seamlessly integrates the strengths of parametric codecs and waveform codecs. The APCodec revolutionizes the…

声音 · 计算机科学 2024-09-25 Yang Ai , Xiao-Hang Jiang , Ye-Xin Lu , Hui-Peng Du , Zhen-Hua Ling

Neural audio codecs, leveraging quantization algorithms, have significantly impacted various speech/audio tasks. While high-fidelity reconstruction is paramount for human perception, audio coding for machines (ACoM) prioritizes efficient…

声音 · 计算机科学 2025-08-06 Anastasia Kuznetsova , Inseon Jang , Wootaek Lim , Minje Kim