English
Related papers

Related papers: Exploiting Latent Properties to Optimize Neural Co…

200 papers

Perceptual video compression leverages generative priors to reconstruct realistic textures and motions at low bitrates. However, existing perceptual codecs often lack native support for variable bitrate and progressive delivery, and their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Daowen Li , Ruixiao Dong , Ying Chen , Kai Li , Ding Ding , Li Li

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

One of the major differentiators unlocked by learned codecs relative to their hard-coded traditional counterparts is their ability to be optimized directly to appeal to the human visual system. Despite this potential, a perceptual yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Kedar Tatwawadi , Parisa Rahimzadeh , Zhanghao Sun , Zhiqi Chen , Ziyun Yang , Sanjay Nair , Divija Hasteer , Oren Rippel

Neural speech codecs have gained great attention for their outstanding reconstruction with discrete token representations. It is a crucial component in generative tasks such as speech coding and large language models (LLM). However, most…

Sound · Computer Science 2025-07-01 Youqiang Zheng , Weiping Tu , Yueteng Kang , Jie Chen , Yike Zhang , Li Xiao , Yuhong Yang , Long Ma

Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is required for rate…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Mu Li , Wangmeng Zuo , Shuhang Gu , Debin Zhao , David Zhang

In this paper, we propose a partition-masked Convolution Neural Network (CNN) to achieve compressed-video enhancement for the state-of-the-art coding standard, High Efficiency Video Coding (HECV). More precisely, our method utilizes the…

Multimedia · Computer Science 2019-12-30 Xiaoyi He , Qiang Hu , Xintong Han , Xiaoyun Zhang , Chongyang Zhang , Weiyao Lin

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Han-Yu Lin , Li-Wei Chen , Hung-Shin Lee

Error correction codes are a crucial part of the physical communication layer, ensuring the reliable transfer of data over noisy channels. The design of optimal linear block codes capable of being efficiently decoded is of major concern,…

Information Theory · Computer Science 2024-05-08 Yoni Choukroun , Lior Wolf

Neural image compression, based on auto-encoders and overfitted representations, relies on a latent representation of the coded signal. This representation needs to be compact and uses low resolution feature maps. In the decoding process,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-02 Pierrick Philippe , Théo Ladune , Gordon Clare , Félix Henry , Théophile Blard , Thomas Leguay

Encoding videos into discrete tokens could align with text tokens to facilitate concise and unified multi-modal LLMs, yet introducing significant spatiotemporal compression compared to continuous video representation. Previous discrete…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yupeng Zhou , Zhen Li , Ziheng Ouyang , Yuming Chen , Ruoyi Du , Daquan Zhou , Bin Fu , Yihao Liu , Peng Gao , Ming-Ming Cheng , Qibin Hou

Quantum error correction (QEC) is essential for enabling quantum advantages, with decoding as a central algorithmic primitive. Owing to its importance and intrinsic difficulty, substantial effort has been made to QEC decoder design, among…

Quantum Physics · Physics 2026-05-13 Ge Yan , Shanchuan Li , Yuxuan Du

Neural speech codecs aim to compress input signals into minimal bits while maintaining content quality in a low-latency manner. However, existing neural codecs often trade model complexity for reconstruction performance. These codecs…

Sound · Computer Science 2024-10-04 Yuzhe Gu , Enmao Diao

Previous DCASE challenges contributed to an increase in the performance of acoustic scene classification systems. State-of-the-art classifiers demand significant processing capabilities and memory which is challenging for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-10 Nagashree K. S. Rao , Nils Peters

Pre-trained convolutional neural networks (CNNs) are powerful off-the-shelf feature generators and have been shown to perform very well on a variety of tasks. Unfortunately, the generated features are high dimensional and expensive to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Saurabh Singh , Sami Abu-El-Haija , Nick Johnston , Johannes Ballé , Abhinav Shrivastava , George Toderici

Current neural audio codecs typically use residual vector quantization (RVQ) to discretize speech signals. However, they often experience codebook collapse, which reduces the effective codebook size and leads to suboptimal performance. To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-12 Rui-Chen Zheng , Hui-Peng Du , Xiao-Hang Jiang , Yang Ai , Zhen-Hua Ling

In this paper, a hybrid video compression framework is proposed that serves as a demonstrative showcase of deep learning-based approaches extending beyond the confines of traditional coding methodologies. The proposed hybrid framework is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Yanchen Zhao , Wenxuan He , Chuanmin Jia , Qizhe Wang , Junru Li , Yue Li , Chaoyi Lin , Kai Zhang , Li Zhang , Siwei Ma

Gradient aggregation has long been identified as a major bottleneck in today's large-scale distributed machine learning training systems. One promising solution to mitigate such bottlenecks is gradient compression, directly reducing…

Machine Learning · Computer Science 2024-10-30 Wenchen Han , Shay Vargaftik , Michael Mitzenmacher , Brad Karp , Ran Ben Basat

The use of modern Natural Language Processing (NLP) techniques has shown to be beneficial for software engineering tasks, such as vulnerability detection and type inference. However, training deep NLP models requires significant…

Software Engineering · Computer Science 2023-09-12 Anastasiia Grishina , Max Hort , Leon Moonen

Neural image compression has been shown to outperform traditional image codecs in terms of rate-distortion performance. However, quantization introduces errors in the compression process, which can degrade the quality of the compressed…

Machine Learning · Computer Science 2024-03-27 Wei Luo , Bo Chen

How to efficiently utilize the temporal features is crucial, yet challenging, for video restoration. The temporal features usually contain various noisy and uncorrelated information, and they may interfere with the restoration of the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Cong Huang , Jiahao Li , Bin Li , Dong Liu , Yan Lu