English
Related papers

Related papers: CQNV: A combination of coarsely quantized bitstrea…

200 papers

Recent advancements in neural audio codec (NAC) unlock new potential in audio signal processing. Studies have increasingly explored leveraging the latent features of NAC for various speech signal processing tasks. This paper introduces the…

Sound · Computer Science 2024-09-17 Yuan Fang , Jinglin Bai , Jiajie Wang , Xueliang Zhang

Video compression is indispensable to most video analysis systems. Despite saving transportation bandwidth, it also deteriorates downstream video understanding tasks, especially at low-bitrate settings. To systematically investigate this…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Yuan Tian , Guo Lu , Yichao Yan , Guangtao Zhai , Li Chen , Zhiyong Gao

We propose a novel neural waveform compression method to catalyze emerging speech semantic communications. By introducing nonlinear transform and variational modeling, we effectively capture the dependencies within speech frames and…

Sound · Computer Science 2022-12-14 Shengshi Yao , Zixuan Xiao , Sixian Wang , Jincheng Dai , Kai Niu , Ping Zhang

Hierarchical quantum classifiers, such as quantum convolutional neural networks (QCNNs), represent recent progress toward designing effective and feasible architectures for quantum classification. However, their performance on near-term…

Quantum Physics · Physics 2026-02-26 Taehyun Kim , Israel F. Araujo , Daniel K. Park

This paper investigates different trade-offs between the number of model parameters and enhanced speech qualities by employing several deep tensor-to-vector regression models for speech enhancement. We find that a hybrid architecture,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Jun Qi , Hu Hu , Yannan Wang , Chao-Han Huck Yang , Sabato Marco Siniscalchi , Chin-Hui Lee

Speech codecs learn compact representations of speech signals to facilitate data transmission. Many recent deep neural network (DNN) based end-to-end speech codecs achieve low bitrates and high perceptual quality at the cost of model…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Kai Zhen , Jongmo Sung , Mi Suk Lee , Seungkwon Beack , Minje Kim

Neural vocoders have recently advanced waveform generation, yielding natural and expressive audio. Among these approaches, iSTFT-based vocoders have recently gained attention. They predict a complex-valued spectrogram and then synthesize…

Sound · Computer Science 2026-03-13 Hyung-Seok Oh , Deok-Hyeon Cho , Seung-Bin Kim , Seong-Whan Lee

In response to the rapid growth of global videomtraffic and the limitations of traditional wireless transmission systems, we propose a novel dual-stage vector quantization framework, VQ-DeepVSC, tailored to enhance video transmission over…

Networking and Internet Architecture · Computer Science 2024-09-06 Yongyi Miao , Zhongdang Li , Yang Wang , Die Hu , Jun Yan , Youfang Wang

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

This work proposes the use of clean speech vocoder parameters as the target for a neural network performing speech enhancement. These parameters have been designed for text-to-speech synthesis so that they both produce high-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-03 Soumi Maiti , Michael I Mandel

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

Language models have been effectively applied to modeling natural signals, such as images, video, speech, and audio. A crucial component of these models is the codec tokenizer, which compresses high-dimensional natural signals into…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-26 Shengpeng Ji , Ziyue Jiang , Wen Wang , Yifu Chen , Minghui Fang , Jialong Zuo , Qian Yang , Xize Cheng , Zehan Wang , Ruiqi Li , Ziang Zhang , Xiaoda Yang , Rongjie Huang , Yidi Jiang , Qian Chen , Siqi Zheng , Zhou Zhao

This paper introduces a novel neural audio codec targeting high waveform sampling rates and low bitrates named APCodec, which seamlessly integrates the strengths of parametric codecs and waveform codecs. The APCodec revolutionizes the…

Sound · Computer Science 2024-09-25 Yang Ai , Xiao-Hang Jiang , Ye-Xin Lu , Hui-Peng Du , Zhen-Hua Ling

Audio coding is an essential module in the real-time communication system. Neural audio codecs can compress audio samples with a low bitrate due to the strong modeling and generative capabilities of deep neural networks. To address the poor…

Sound · Computer Science 2023-10-18 Wenzhe Liu , Wei Xiao , Meng Wang , Shan Yang , Yupeng Shi , Yuyong Kang , Dan Su , Shidong Shang , Dong Yu

Effective employment of deep neural networks (DNNs) in mobile devices and embedded systems is hampered by requirements for memory and computational power. This paper presents a non-uniform quantization approach which allows for dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Niccoló Nicodemo , Gaurav Naithani , Konstantinos Drossos , Tuomas Virtanen , Roberto Saletti

This paper presents a video encoding method in which noise is encoded using a novel parametric model representing spectral envelope and spatial distribution of energy. The proposed method has been experimentally assessed using video test…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Olgierd Stankiewicz

Modern compression algorithms are often the result of laborious domain-specific research; industry standards such as MP3, JPEG, and AMR-WB took years to develop and were largely hand-designed. We present a deep neural network model which…

Sound · Computer Science 2021-07-09 Srihari Kankanahalli

Variational Quantum Computing (VQC) faces fundamental scalability barriers, primarily due to barren plateaus and sensitivity to quantum noise. To address these challenges, we introduce TensorHyper-VQC, a novel tensor-train (TT)-guided…

Quantum Physics · Physics 2026-02-10 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hsiu Hsieh

In recent years, neural networks (NNs) have driven significant advances in machine learning. However, as tasks grow more complex, NNs often require large numbers of trainable parameters, which increases computational and energy demands.…

Neural vocoders have recently demonstrated high quality speech synthesis, but typically require a high computational complexity. LPCNet was proposed as a way to reduce the complexity of neural synthesis by using linear prediction (LP) to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Krishna Subramani , Jean-Marc Valin , Umut Isik , Paris Smaragdis , Arvindh Krishnaswamy