English
Related papers

Related papers: CODA: Repurposing Continuous VAEs for Discrete Tok…

200 papers

Vision transformers have been widely explored in various vision tasks. Due to heavy computational cost, much interest has aroused for compressing vision transformer dynamically in the aspect of tokens. Current methods mainly pay attention…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Fanhu Zeng , Deli Yu , Zhenglun Kong , Hao Tang

Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extending state-of-the-art video tokenizers to achieve a temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Aniruddha Mahapatra , Long Mai , David Bourgin , Yitian Zhang , Feng Liu

With the ever-increasing volume of visual data, the efficient and lossless transmission, along with its subsequent interpretation and understanding, has become a critical bottleneck in modern information systems. The emerged codebook-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yongbo Wang , Haonan Wang , Guodong Mu , Ruixin Zhang , Jiaqi Chen , Jingyun Zhang , Jun Wang , Yuan Xie , Zhizhong Zhang , Shouhong Ding

Image compression has been investigated as a fundamental research topic for many decades. Recently, deep learning has achieved great success in many computer vision tasks, and is gradually being used in image compression. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Discrete image tokenization is a key bottleneck for scalable visual generation: a tokenizer must remain compact for efficient latent-space priors while preserving semantic structure and using discrete capacity effectively. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Idil Bilge Altun , Mert Onur Cakiroglu , Elham Buxton , Mehmet Dalkilic , Hasan Kurban

Visual instruction tuning aims to enable large language models to comprehend the visual world, with a pivotal challenge lying in establishing an effective vision-to-language projection. However, existing methods often grapple with the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Bonan li , Zicheng Zhang , Songhua Liu , Weihao Yu , Xinchao Wang

Reducing token count is crucial for efficient training and inference of latent diffusion models, especially at high resolution. A common strategy is to build high-compression image tokenizers with more channels per token. However, when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xin Cai , Zhiyuan You , Zhoutong Zhang , Tianfan Xue

Multimodal Large Language Models have demonstrated remarkable capabilities in video understanding, yet face prohibitive computational costs and performance degradation from ''context rot'' due to massive visual token redundancy. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shida Wang , YongXiang Hua , Zhou Tao , Haoyu Cao , Linli Xu

Language modality within the vision language pretraining framework is innately discretized, endowing each word in the language vocabulary a semantic meaning. In contrast, visual modality is inherently continuous and high-dimensional, which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Xiaoyuan Guo , Jiali Duan , C. -C. Jay Kuo , Judy Wawira Gichoya , Imon Banerjee

Language models have been effectively applied to modeling natural signals, such as images, video, speech, and audio. A crucial component of these models is the codec tokenizer, which compresses high-dimensional natural signals into…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-26 Shengpeng Ji , Ziyue Jiang , Wen Wang , Yifu Chen , Minghui Fang , Jialong Zuo , Qian Yang , Xize Cheng , Zehan Wang , Ruiqi Li , Ziang Zhang , Xiaoda Yang , Rongjie Huang , Yidi Jiang , Qian Chen , Siqi Zheng , Zhou Zhao

Recent 3D content generation pipelines commonly employ Variational Autoencoders (VAEs) to encode shapes into compact latent representations for diffusion-based generation. However, the widely adopted uniform point sampling strategy in Shape…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Rui Chen , Jianfeng Zhang , Yixun Liang , Guan Luo , Weiyu Li , Jiarui Liu , Xiu Li , Xiaoxiao Long , Jiashi Feng , Ping Tan

Neural compression offers a domain-agnostic approach to creating codecs for lossy or lossless compression via deep generative models. For sequence compression, however, most deep sequence models have costs that scale with the sequence…

Machine Learning · Computer Science 2022-12-29 Ricky T. Q. Chen , Matthew Le , Matthew Muckley , Maximilian Nickel , Karen Ullrich

Token-based video representation has emerged as a promising approach for enabling large language models (LLMs) to interpret video content. However, existing token reduction techniques, such as pruning and merging, often disrupt essential…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haichao Zhang , Yun Fu

We present AToken, the first unified visual tokenizer that achieves both high-fidelity reconstruction and semantic understanding across images, videos, and 3D assets. Unlike existing tokenizers that specialize in either reconstruction or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Jiasen Lu , Liangchen Song , Mingze Xu , Byeongjoo Ahn , Yanjun Wang , Chen Chen , Afshin Dehghan , Yinfei Yang

Discrete visual tokenizers translate images into ordered sequences of codes, providing a natural representation for structural description of scenes. Yet existing adaptive tokenizers either require post-hoc search or select among a discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Piotr Wyrwiński , Kacper Dobek , Krzysztof Krawiec

Existing vector quantization (VQ) based autoregressive models follow a two-stage generation paradigm that first learns a codebook to encode images as discrete codes, and then completes generation based on the learned codebook. However, they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Mengqi Huang , Zhendong Mao , Zhuowei Chen , Yongdong Zhang

Vision transformers have established a precedent of patchifying images into uniformly-sized chunks before processing. We hypothesize that this design choice may limit models in learning comprehensive and compositional representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Neha Kalibhat , Priyatham Kattakinda , Sumit Nawathe , Arman Zarei , Nikita Seleznev , Samuel Sharpe , Senthil Kumar , Soheil Feizi

The unification of understanding and generation within a single multi-modal large model (MLLM) remains one significant challenge, largely due to the dichotomy between continuous and discrete visual tokenizations. Continuous tokenizer (CT)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yizhu Chen , Chen Ju , Zhicheng Wang , Shuai Xiao , Xu Chen , Jinsong Lan , Xiaoyong Zhu , Ying Chen

Although deep convolutional neural network has been proved to efficiently eliminate coding artifacts caused by the coarse quantization of traditional codec, it's difficult to train any neural network in front of the encoder for gradient's…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Lijun Zhao , Huihui Bai , Anhong Wang , Yao Zhao

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt