English
Related papers

Related papers: Switchable Token-Specific Codebook Quantization Fo…

200 papers

Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present a significant bottleneck for current tokenizers, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haotian Ye , Qiyuan He , Jiaqi Han , Puheng Li , Jiaojiao Fan , Zekun Hao , Fitsum Reda , Yogesh Balaji , Huayu Chen , Sheng Liu , Angela Yao , James Zou , Stefano Ermon , Haoxiang Wang , Ming-Yu Liu

Scaling laws enable the optimal selection of data amount and language model size, yet the impact of the data unit, the token, on this relationship remains underexplored. In this work, we systematically investigate how the information…

Computation and Language · Computer Science 2026-05-27 Tomasz Limisiewicz , Artidoro Pagnoni , Srini Iyer , Mike Lewis , Sachin Mehta , Alisa Liu , Margaret Li , Gargi Ghosh , Luke Zettlemoyer

Image compression is one of the most fundamental techniques and commonly used applications in the image and video processing field. Earlier methods built a well-designed pipeline, and efforts were made to improve all modules of the pipeline…

Image and Video Processing · Electrical Eng. & Systems 2021-03-29 Yueyu Hu , Wenhan Yang , Zhan Ma , Jiaying Liu

As an increasing amount of image and video content will be analyzed by machines, there is demand for a new codec paradigm that is capable of compressing visual input primarily for the purpose of computer vision inference, while secondarily…

Image and Video Processing · Electrical Eng. & Systems 2023-01-12 Ezgi Ozyilkan , Mateen Ulhaq , Hyomin Choi , Fabien Racape

Current methods which compress multisets at an optimal rate have computational complexity that scales linearly with alphabet size, making them too slow to be practical in many real-world settings. We show how to convert a compression…

Information Theory · Computer Science 2023-02-28 Daniel Severo , James Townsend , Ashish Khisti , Alireza Makhzani , Karen Ullrich

"Compression Tells Intelligence", is supported by research in artificial intelligence, particularly concerning (multimodal) large language models (LLMs/MLLMs), where compression efficiency often correlates with improved model performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xin Jin , Jinming Liu , Yuntao Wei , Junyan Lin , Zhicheng Wang , Jianguo Huang , Xudong Yang , Yanxiao Liu , Wenjun Zeng

We address the problem of efficiently compressing video for conferencing-type applications. We build on recent approaches based on image animation, which can achieve good reconstruction quality at very low bitrate by representing face…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Goluck Konuko , Stéphane Lathuilière , Giuseppe Valenzise

Image Coding for Machines (ICM) has become increasingly important with the rapid integration of computer vision technology into real-world applications. However, most neural network-based ICM frameworks operate at a fixed rate, thus…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Yui Tatsumi , Ziyue Zeng , Hiroshi Watanabe

Quantization is one of the core components in lossy image compression. For neural image compression, end-to-end optimization requires differentiable approximations of quantization, which can generally be grouped into three categories:…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Zongyu Guo , Zhizheng Zhang , Runsen Feng , Zhibo Chen

We identify an issue in multi-task learnable compression, in which a representation learned for one task does not positively contribute to the rate-distortion performance of a different task as much as expected, given the estimated amount…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Anderson de Andrade , Ivan Bajić

Fine-grained image recognition is challenging because discriminative clues are usually fragmented, whether from a single image or multiple images. Despite their significant improvements, most existing methods still focus on the most…

Multimedia · Computer Science 2022-06-07 Xinda Liu , Lili Wang , Xiaoguang Han

Today, visual data is often analyzed by a neural network without any human being involved, which demands for specialized codecs. For standard-compliant codec adaptations towards certain information sinks, HEVC or VVC provide the possibility…

Image and Video Processing · Electrical Eng. & Systems 2023-01-23 Kristian Fischer , Fabian Brand , Christian Herglotz , André Kaup

We present Channel-wise Vector Quantization (CVQ), a novel image tokenization paradigm that replaces patch-wise tokens with channel-wise tokens. Unlike conventional vector quantization, which assigns a discrete token to each patch feature…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wei Song , Tianhang Wang , Yitong Chen , Tong Zhang , Zuxuan Wu , Ming Li , Jiaqi Wang , Kaicheng Yu

Feature compression is a promising direction for coding for machines. Existing methods have made substantial progress, but they require designing and training separate neural network models to meet different specifications of compression…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Md Adnan Faisal Hossain , Zhihao Duan , Yuning Huang , Fengqing Zhu

The high efficiency in computation and storage makes hashing (including binary hashing and quantization) a common strategy in large-scale retrieval systems. To alleviate the reliance on expensive annotations, unsupervised deep hashing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Jinpeng Wang , Ziyun Zeng , Bin Chen , Tao Dai , Shu-Tao Xia

Learned progressive image compression is gaining momentum as it allows improved image reconstruction as more bits are decoded at the receiver. We propose a progressive image compression method in which an image is first represented as a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Alberto Presta , Enzo Tartaglione , Attilio Fiandrotti , Marco Grangetto , Pamela Cosman

Recent advancements in machine learning achieved by Deep Neural Networks (DNNs) have been significant. While demonstrating high accuracy, DNNs are associated with a huge number of parameters and computations, which leads to high memory…

Machine Learning · Computer Science 2023-12-20 Babak Rokh , Ali Azarpeyvand , Alireza Khanteymoori

In this paper, we propose a scalable image compression scheme, including the base layer for feature representation and enhancement layer for texture representation. More specifically, the base layer is designed as the deep learning feature…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Shurun Wang , Shiqi Wang , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

Recent advances in learned image compression (LIC) have enabled practical deployments, spurring active research into image compression for machines and progressive coding schemes. However, their integration remains under-explored: prior…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Jungwoo Kim , Jun-Hyuk Kim , Jong-Seok Lee

The exponential growth of visual data in digital communications has intensified the need for efficient compression techniques that balance rate-distortion performance with computational feasibility. While recent neural compression…

Image and Video Processing · Electrical Eng. & Systems 2025-05-21 Karthik Sivakoti