English
Related papers

Related papers: Flexible Neural Image Compression via Code Editing

200 papers

Error correction code is a major part of the communication physical layer, ensuring the reliable transfer of data over noisy channels. Recently, neural decoders were shown to outperform classical decoding techniques. However, the existing…

Machine Learning · Computer Science 2022-03-30 Yoni Choukroun , Lior Wolf

Neural codecs have demonstrated strong performance in high-fidelity compression of audio signals at low bitrates. The token-based representations produced by these codecs have proven particularly useful for generative modeling. While much…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-16 Patrick O'Reilly , Prem Seetharaman , Jiaqi Su , Zeyu Jin , Bryan Pardo

In this paper, a hybrid video compression framework is proposed that serves as a demonstrative showcase of deep learning-based approaches extending beyond the confines of traditional coding methodologies. The proposed hybrid framework is…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Yanchen Zhao , Wenxuan He , Chuanmin Jia , Qizhe Wang , Junru Li , Yue Li , Chaoyi Lin , Kai Zhang , Li Zhang , Siwei Ma

While recent machine learning research has revealed connections between deep generative models such as VAEs and rate-distortion losses used in learned compression, most of this work has focused on images. In a similar spirit, we view…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruihan Yang , Yibo Yang , Joseph Marino , Stephan Mandt

Good quality video coding for low bit-rate applications is important for transmission over narrow-bandwidth channels and for storage with limited memory capacity. In this work, we develop a previous analysis for image compression at low…

Multimedia · Computer Science 2015-04-27 Yehuda Dar , Alfred M. Bruckstein

End-to-end image/video codecs are getting competitive compared to traditional compression techniques that have been developed through decades of manual engineering efforts. These trainable codecs have many advantages over traditional…

Image and Video Processing · Electrical Eng. & Systems 2023-08-03 Muhammet Balcilar , Bharath Bhushan Damodaran , Karam Naser , Franck Galpin , Pierre Hellier

Neural data compression has been shown to outperform classical methods in terms of $RD$ performance, with results still improving rapidly. At a high level, neural compression is based on an autoencoder that tries to reconstruct the input…

Machine Learning · Computer Science 2021-06-02 Ties van Rozendaal , Iris A. M. Huijben , Taco S. Cohen

Quantizing a floating-point neural network to its fixed-point representation is crucial for Learned Image Compression (LIC) because it improves decoding consistency for interoperability and reduces space-time complexity for implementation.…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Junqi Shi , Ming Lu , Zhan Ma

The proliferation of high resolution videos posts great storage and bandwidth pressure on cloud video services, driving the development of next-generation video codecs. Despite great progress made in neural video coding, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yueyu Hu , Chenhao Zhang , Onur G. Guleryuz , Debargha Mukherjee , Yao Wang

Image coding for machines (ICM) aims at reducing the bitrate required to represent an image while minimizing the drop in machine vision analysis accuracy. In many use cases, such as surveillance, it is also important that the visual quality…

Image and Video Processing · Electrical Eng. & Systems 2024-01-22 Nam Le , Honglei Zhang , Francesco Cricri , Ramin G. Youvalari , Hamed Rezazadegan Tavakoli , Emre Aksu , Miska M. Hannuksela , Esa Rahtu

Neural Image Compression (NIC) has revolutionized image compression with its superior rate-distortion performance and multi-task capabilities, supporting both human visual perception and machine vision tasks. However, its widespread…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Yufeng Zhang , Wenrui Dai , Hang Yu , Shizhan Liu , Junhui Hou , Jianguo Li , Weiyao Lin

Inter-individual variability in fine-grained functional brain organization poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but typically require paired…

Neurons and Cognition · Quantitative Biology 2024-08-02 Haibao Wang , Jun Kai Ho , Fan L. Cheng , Shuntaro C. Aoki , Yusuke Muraki , Misato Tanaka , Yukiyasu Kamitani

Could we compress images via standard codecs while avoiding visible artifacts? The answer is obvious -- this is doable as long as the bit budget is generous enough. What if the allocated bit-rate for compression is insufficient? Then…

Image and Video Processing · Electrical Eng. & Systems 2021-08-11 Hossein Talebi , Damien Kelly , Xiyang Luo , Ignacio Garcia Dorado , Feng Yang , Peyman Milanfar , Michael Elad

In recent years, large visual language models (LVLMs) have shown impressive performance and promising generalization capability in multi-modal tasks, thus replacing humans as receivers of visual information in various application scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Binzhe Li , Shurun Wang , Shiqi Wang , Yan Ye

Over recent years, deep learning-based computer vision systems have been applied to images at an ever-increasing pace, oftentimes representing the only type of consumption for those images. Given the dramatic explosion in the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Nam Le , Honglei Zhang , Francesco Cricri , Ramin Ghaznavi-Youvalari , Esa Rahtu

Deep image compression systems mainly contain four components: encoder, quantizer, entropy model, and decoder. To optimize these four components, a joint rate-distortion framework was proposed, and many deep neural network-based methods…

Image and Video Processing · Electrical Eng. & Systems 2020-07-27 Zhisheng Zhong , Hiroaki Akutsu , Kiyoharu Aizawa

Despite demonstrating superior rate-distortion (RD) performance, learning-based image compression (LIC) algorithms have been found to be vulnerable to malicious perturbations in recent studies. However, the adversarial attacks considered in…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Lei Wang , King Ngi Ngan , Fanman Meng , Hongliang Li

This paper presents a novel convolutional neural network (CNN) based image compression framework via scalable auto-encoder (SAE). Specifically, our SAE based deep image codec consists of hierarchical coding layers, each of which is an…

Multimedia · Computer Science 2019-04-02 Chuanmin Jia , Zhaoyi Liu , Yao Wang , Siwei Ma , Wen Gao

Distributed Image Compression (DIC) is crucial for multi-view transmission, especially when operating at extremely low bitrates (< 0.1 bpp). Its core challenge is effectively utilizing side information to achieve high-quality reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Guojun Xu , Mingyang Zhang , Jianwen Xiang , Cheng Tan , Yanchao Yang , Junwei Zhou

Scalable image coding for both humans and machines is a technique that has gained a lot of attention recently. This technology enables the hierarchical decoding of images for human vision and image recognition models. It is a highly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Takahiro Shindo , Yui Tatsumi , Taiju Watanabe , Hiroshi Watanabe