English
Related papers

Related papers: One-D-Piece: Image Tokenizer Meets Quality-Control…

200 papers

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

Diffusion-based image compression methods have achieved notable progress, delivering high perceptual quality at low bitrates. However, their practical deployment is hindered by significant inference latency and heavy computational overhead,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yiwen Jia , Hao Wei , Yanhui Zhou , Chenyang Ge

Prevalent lossy image compression schemes can be divided into: 1) explicit image compression (EIC), including traditional standards and neural end-to-end algorithms; 2) implicit image compression (IIC) based on implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Qi Zheng , Haozhi Wang , Zihao Liu , Jiaming Liu , Peiye Liu , Zhijian Hao , Yanheng Lu , Dimin Niu , Jinjia Zhou , Minge Jing , Yibo Fan

Text and faces are among the most perceptually salient and practically important patterns in visual generation, yet they remain challenging for autoregressive generators built on discrete tokenization. A central bottleneck is the tokenizer:…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yang Yue , Fangyun Wei , Tianyu He , Jinjing Zhao , Zanlin Ni , Zeyu Liu , Jiayi Guo , Lei Shi , Yue Dong , Li Chen , Ji Li , Gao Huang , Dong Chen

Autoregressive (AR) models have recently shown strong performance in image generation, where a critical component is the visual tokenizer (VT) that maps continuous pixel inputs to discrete token sequences. The quality of the VT largely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Huawei Lin , Tong Geng , Zhaozhuo Xu , Weijie Zhao

The paper presents a non-uniform quantization method for the Detail components in the JPEG2000 standard. Incorporating the fact that the coefficients lying towards the ends of the histogram plot of each Detail component represent the…

Multimedia · Computer Science 2014-08-18 Madhur Srivastava , Satish K. Singh , Prasanta K. Panigrahi

The image tokenizer is a critical component in AR image generation, as it determines how rich and structured visual content is encoded into compact representations. Existing quantization-based tokenizers such as VQ-GAN primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yiang Shi , Xiaoyang Guo , Wei Yin , Mingkai Jia , Qian Zhang , Xiaolin Hu , Wenyu Liu , Xinggang Wang

End-to-end deep trainable models are about to exceed the performance of the traditional handcrafted compression techniques on videos and images. The core idea is to learn a non-linear transformation, modeled as a deep neural network,…

Image and Video Processing · Electrical Eng. & Systems 2022-09-05 Muhammet Balcilar , Bharath Damodaran , Pierre Hellier

Slow inference speed is one of the most crucial concerns for deploying multi-view 3D detectors to tasks with high real-time requirements like autonomous driving. Although many sparse query-based methods have already attempted to improve the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dingyuan Zhang , Dingkang Liang , Zichang Tan , Xiaoqing Ye , Cheng Zhang , Jingdong Wang , Xiang Bai

Video Coding for Machines (VCM) is committed to bridging to an extent separate research tracks of video/image compression and feature compression, and attempts to optimize compactness and efficiency jointly from a unified perspective of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Wenhan Yang , Haofeng Huang , Yueyu Hu , Ling-Yu Duan , Jiaying Liu

Noisy images are a challenge to image compression algorithms due to the inherent difficulty of compressing noise. As noise cannot easily be discerned from image details, such as high-frequency signals, its presence leads to extra bits…

Image and Video Processing · Electrical Eng. & Systems 2024-02-09 Yuxin Xie , Li Yu , Farhad Pakdaman , Moncef Gabbouj

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

Efficient image tokenization with high compression ratios remains a critical challenge for training generative models. We present SoftVQ-VAE, a continuous image tokenizer that leverages soft categorical posteriors to aggregate multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Hao Chen , Ze Wang , Xiang Li , Ximeng Sun , Fangyi Chen , Jiang Liu , Jindong Wang , Bhiksha Raj , Zicheng Liu , Emad Barsoum

Recent image generation schemes typically capture image distribution in a pre-constructed latent space relying on a frozen image tokenizer. Though the performance of tokenizer plays an essential role to the successful generation, its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Kai Qiu , Xiang Li , Jason Kuen , Hao Chen , Xiaohao Xu , Jiuxiang Gu , Yinyi Luo , Bhiksha Raj , Zhe Lin , Marios Savvides

Noise is ubiquitous during image acquisition. Sufficient denoising is often an important first step for image processing. In recent decades, deep neural networks (DNNs) have been widely used for image denoising. Most DNN-based image…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Chenyin Gao , Shu Yang , Anru R. Zhang

In this paper we propose a novel approach to model compression termed Architecture Compression. Instead of operating on the weight or filter space of the network like classical model compression methods, our approach operates on the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Anubhav Ashok

Large-scale image datasets are fundamental to deep learning, but their high storage demands pose challenges for deployment in resource-constrained environments. While existing approaches reduce dataset size by discarding samples, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Chenyue Yu , Lingao Xiao , Jinhong Deng , Ivor W. Tsang , Yang He

In this work, we propose using a unified representation, termed Factorized Features, for low-level vision tasks, where we test on Single Image Super-Resolution (SISR) and \textbf{Image Compression}. Motivated by the shared principles…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Yang-Che Sun , Cheng Yu Yeo , Ernie Chu , Jun-Cheng Chen , Yu-Lun Liu

Visual autoregressive (AR) generation offers a promising path toward unifying vision and language models, yet its performance remains suboptimal against diffusion models. Prior work often attributes this gap to tokenizer limitations and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Qiyuan He , Yicong Li , Haotian Ye , Jinghao Wang , Xinyao Liao , Pheng-Ann Heng , Stefano Ermon , James Zou , Angela Yao

Lossy compression brings artifacts into the compressed image and degrades the visual quality. In recent years, many compression artifacts removal methods based on convolutional neural network (CNN) have been developed with great success.…

Image and Video Processing · Electrical Eng. & Systems 2020-10-22 Jianwei Li , Yongtao Wang , Haihua Xie , Kai-Kuang Ma