English
Related papers

Related papers: MacTok: Robust Continuous Tokenization for Image G…

200 papers

Visual generative and understanding models typically rely on distinct tokenizers to process images, presenting a key challenge for unifying them within a single framework. Recent studies attempt to address this by connecting the training of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chuofan Ma , Yi Jiang , Junfeng Wu , Jihan Yang , Xin Yu , Zehuan Yuan , Bingyue Peng , Xiaojuan Qi

Visual tokenizer is a critical component for vision generation. However, the existing tokenizers often face unsatisfactory trade-off between compression ratios and reconstruction fidelity. To fill this gap, we introduce a powerful and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Shaobin Zhuang , Yiwei Guo , Canmiao Fu , Zhipeng Huang , Zeyue Tian , Xiaohui Li , Fangyikang Wang , Ying Zhang , Chen Li , Yali Wang

Efficient video tokenization remains a key bottleneck in learning general purpose vision models that are capable of processing long video sequences. Prevailing approaches are restricted to encoding videos to a fixed number of tokens, where…

Machine Learning · Computer Science 2025-02-04 Wilson Yan , Volodymyr Mnih , Aleksandra Faust , Matei Zaharia , Pieter Abbeel , Hao Liu

Bridging different modalities lies at the heart of cross-modality generation. While conventional approaches treat the text modality as a conditioning signal that gradually guides the denoising process from Gaussian noise to the target image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Ju He , Qihang Yu , Qihao Liu , Liang-Chieh Chen

In this work, we propose aligning pretrained visual encoders to serve as tokenizers for latent diffusion models in image generation. Unlike training a variational autoencoder (VAE) from scratch, which primarily emphasizes low-level details,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Bowei Chen , Sai Bi , Hao Tan , He Zhang , Tianyuan Zhang , Zhengqi Li , Yuanjun Xiong , Jianming Zhang , Kai Zhang

Building a unified visual tokenizer is essential for bridging the gap between visual understanding and generation. Yet existing approaches struggle with the inherent conflict between these tasks, as a single token space is forced to support…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yiwei Guo , Shaobin Zhuang , Zhipeng Huang , Canmiao Fu , Chen Li , Jing Lyu , Yali Wang

We introduce CompTok, a training framework for learning visual tokenizers whose tokens are enhanced for compositionality. CompTok uses a token-conditioned diffusion decoder. By employing an InfoGAN-style objective, where we train a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Bingchen Zhao , Qiushan Guo , Ye Wang , Yixuan Huang , Zhonghua Zhai , Yu Tian

Accurate and effective discrete image tokenization is crucial for long image sequence processing. However, current methods rigidly compress all content at a fixed rate, ignoring the variable information density of images and leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiusheng Huang , Xin Jiang , Jun Zhao , Kang Liu , Yequan Wang

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

Image tokenization plays a critical role in reducing the computational demands of modeling high-resolution images, significantly improving the efficiency of image and multimodal understanding and generation. Recent advances in 1D latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Ze Wang , Hao Chen , Benran Hu , Jiang Liu , Ximeng Sun , Jialian Wu , Yusheng Su , Xiaodong Yu , Emad Barsoum , Zicheng Liu

Image tokenization has significantly advanced visual generation and multimodal modeling, particularly when paired with autoregressive models. However, current methods face challenges in balancing efficiency and fidelity: high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Qingsong Xie , Zhao Zhang , Zhe Huang , Yanhao Zhang , Haonan Lu , Zhenyu Yang

Effectively handling temporal redundancy remains a key challenge in learning video models. Prevailing approaches often treat each set of frames independently, failing to effectively capture the temporal dependencies and redundancies…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Xiang Fan , Xiaohang Sun , Kushan Thakkar , Zhu Liu , Vimal Bhat , Ranjay Krishna , Xiang Hao

Unified multimodal large language models (MLLMs) aim to unify image understanding and image generation within a single framework, where a shared visual tokenizer serves as the sole interface that maps high-dimensional images into a limited…

Machine Learning · Computer Science 2026-04-07 Lv Tang , Tianyi Zheng , Bo Li , Xingyu Li

Recent image generation schemes typically capture image distribution in a pre-constructed latent space relying on a frozen image tokenizer. Though the performance of tokenizer plays an essential role to the successful generation, its…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Kai Qiu , Xiang Li , Jason Kuen , Hao Chen , Xiaohao Xu , Jiuxiang Gu , Yinyi Luo , Bhiksha Raj , Zhe Lin , Marios Savvides

In this work, we present a novel direction to build an image tokenizer directly on top of a frozen vision foundation model, which is a largely underexplored area. Specifically, we employ a frozen vision foundation model as the encoder of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Anlin Zheng , Xin Wen , Xuanyang Zhang , Chuofan Ma , Tiancai Wang , Gang Yu , Xiangyu Zhang , Xiaojuan Qi

Pixel-wise capabilities are essential for building interactive intelligent systems. However, pixel-wise multi-modal LLMs (MLLMs) remain difficult to scale due to complex region-level encoders, specialized segmentation decoders, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yikang Zhou , Tao Zhang , Dengxian Gong , Yuanzheng Wu , Ye Tian , Haochen Wang , Haobo Yuan , Jiacong Wang , Lu Qi , Hao Fei , Anran Wang , Zhuochen Wang , Yujing Wang , Cheng Chen , Shunping Ji , Xiangtai Li

This paper presents the \textbf{S}emantic-a\textbf{W}ar\textbf{E} spatial-t\textbf{E}mporal \textbf{T}okenizer (SweetTok), a novel video tokenizer to overcome the limitations in current video tokenization methods for compacted yet effective…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhentao Tan , Ben Xue , Jian Jia , Junhao Wang , Wencai Ye , Shaoyun Shi , Mingjie Sun , Wenjin Wu , Quan Chen , Peng Jiang

Large Audio Language Models (LALMs) have emerged with strong performance across diverse audio understanding tasks and can be further enhanced by neural audio codecs. Transitioning from multi-layer residual vector quantizers to a…

Sound · Computer Science 2025-12-05 Jingyi Li , Zhiyuan Zhao , Zhisheng Zhang , Yunfei Liu , Lijian Lin , Ye Zhu , Jiahao Wu , Qiuqiang Kong , Yu Li

Autoregressive image generation aims to predict the next token based on previous ones. However, this process is challenged by the bidirectional dependencies inherent in conventional image tokenizations, which creates a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Pingyu Wu , Kai Zhu , Yu Liu , Longxiang Tang , Jian Yang , Yansong Peng , Wei Zhai , Yang Cao , Zheng-Jun Zha

We completely discard the conventional spatial prior in image representation and introduce a novel discrete visual tokenizer: Self-consistency Tokenizer (Selftok). At its design core, we compose an autoregressive (AR) prior -- mirroring the…