English
Related papers

Related papers: PURE Codec: Progressive Unfolding of Residual Entr…

200 papers

Quantization methods have been introduced to perform large scale approximate nearest search tasks. Residual Vector Quantization (RVQ) is one of the effective quantization methods. RVQ uses a multi-stage codebook learning scheme to lower the…

Computer Vision and Pattern Recognition · Computer Science 2015-09-18 Shicong Liu , Hongtao Lu , Junru Shao

In bandwidth-constrained communication such as satellite and underwater channels, speech must often be transmitted at ultra-low bitrates where intelligibility is the primary objective. At such extreme compression levels, codecs trained with…

Sound · Computer Science 2026-04-21 Junyi Wang , Chi Zhang , Jing Qian , Haifeng Luo , Hao Wang , Zengrui Jin , Chao Zhang

Vector Quantization (VQ) has become the cornerstone of tokenization for many multimodal Large Language Models and diffusion synthesis. However, existing VQ paradigms suffer from a fundamental conflict: they enforce discretization before the…

Machine Learning · Computer Science 2026-03-25 Wenhao Zhao , Qiran Zou , Zhouhan Lin , Dianbo Liu

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan

Preserving speech intelligibility is a minimum requirement for speech codecs in communication. Recently, very low-bitrate neural codecs have gained interest for replacing classical codecs, reinforcing the need to evaluate whether…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-06 Lyonel Behringer , Anna Leschanowsky , Anjana Rajasekhar , Emily Kratsch , Guillaume Fuchs

In bandwidth-constrained communication such as satellite and underwater channels, speech must often be transmitted at ultra-low bitrates where intelligibility is the primary objective. At such extreme compression levels, codecs trained with…

Sound · Computer Science 2026-05-20 Junyi Wang , Chi Zhang , Jing Qian , Haifeng Luo , Hao Wang , Zengrui Jin , Chao Zhang

Quantum computing (QC) promises significant advantages on certain hard computational tasks over classical computers. However, current quantum hardware, also known as noisy intermediate-scale quantum computers (NISQ), are still unable to…

Quantum Physics · Physics 2022-12-23 Elisha Siddiqui Matekole , Esther Ye , Ramya Iyer , Samuel Yen-Chi Chen

Automatic speech recognition (ASR) has gained remarkable successes thanks to recent advances of deep learning, but it usually degrades significantly under real-world noisy conditions. Recent works introduce speech enhancement (SE) as…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-19 Yuchen Hu , Chen Chen , Qiushi Zhu , Eng Siong Chng

Low and ultra-low-bitrate neural speech coding achieves unprecedented coding gain by generating speech signals from compact speech features. This paper introduces additional coding efficiency in neural speech coding by reducing the temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-07 Haici Yang , Wootaek Lim , Minje Kim

Historically, most speech models in machine-learning have used the mel-spectrogram as a speech representation. Recently, discrete audio tokens produced by neural audio codecs have become a popular alternate speech representation for speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-05 Ryan Langman , Ante Jukić , Kunal Dhawan , Nithin Rao Koluguri , Jason Li

KV cache compression methods have mainly relied on scalar quantization techniques to reduce the memory requirements during decoding. In this work, we apply residual vector quantization, which has been widely used for high fidelity audio…

Machine Learning · Computer Science 2024-10-22 Ankur Kumar

Speech quality estimation has recently undergone a paradigm shift from human-hearing expert designs to machine-learning models. However, current models rely mainly on supervised learning, which is time-consuming and expensive for label…

Sound · Computer Science 2024-02-27 Szu-Wei Fu , Kuo-Hsuan Hung , Yu Tsao , Yu-Chiang Frank Wang

Superdense Coding is a cornerstone in secure quantum communication, exploiting pre-shared entanglement to encode two classical bits within a single qubit. However, noise and decoherence deteriorate entanglement quality, restricting both…

Quantum Physics · Physics 2025-04-18 Syed Emad Uddin Shubha , Tasnuva Farheen

Quantum kernel methods are promising for near-term quantum ma- chine learning, yet their behavior under data corruption remains insuf- ficiently understood. We analyze how quantum feature constructions degrade under controlled additive…

Machine Learning · Computer Science 2026-02-24 Pablo Herrero Gómez , Antonio Jimeno Morenilla , David Muñoz-Hernández , Higinio Mora Mora

Neural audio signal codecs have attracted significant attention in recent years. In essence, the impressive low bitrate achieved by such encoders is enabled by learning an abstract representation that captures the properties of encoded…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-06 Mhd Modar Halimeh , Matteo Torcoli , Philipp Grundhuber , Emanuël A. P. Habets

Noise suppression (NS) algorithms are effective in improving speech quality in many cases. However, aggressive noise suppression can damage the target speech, reducing both speech intelligibility and quality despite removing the noise. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-11 Kyungguen Byun , Jason Filos , Erik Visser , Sunkuk Moon

Recent advancements in Neural Audio Codec (NAC) models have inspired their use in various speech processing tasks, including speech enhancement (SE). In this work, we propose a novel, efficient SE approach by leveraging the pre-quantization…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-18 Haoyang Li , Jia Qi Yip , Tianyu Fan , Eng Siong Chng

Neural Audio Codecs, initially designed as a compression technique, have gained more attention recently for speech generation. Codec models represent each audio frame as a sequence of tokens, i.e., discrete embeddings. The discrete and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-31 Alexander H. Liu , Qirui Wang , Yuan Gong , James Glass

The continuous improvements on image compression with variational autoencoders have lead to learned codecs competitive with conventional approaches in terms of rate-distortion efficiency. Nonetheless, taking the quantization into account…

Machine Learning · Computer Science 2025-06-11 Florian Borzechowski , Michael Schäfer , Heiko Schwarz , Jonathan Pfaff , Detlev Marpe , Thomas Wiegand

Recently, neural networks have proven to be effective in performing speech coding task at low bitrates. However, under-utilization of intra-frame correlations and the error of quantizer specifically degrade the reconstructed audio quality.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-05 Linping Xu , Jiawei Jiang , Dejun Zhang , Xianjun Xia , Li Chen , Yijian Xiao , Piao Ding , Shenyi Song , Sixing Yin , Ferdous Sohel