English
Related papers

Related papers: GloTok: Global Perspective Tokenizer for Image Rec…

200 papers

Efficient video tokenization remains a key bottleneck in learning general purpose vision models that are capable of processing long video sequences. Prevailing approaches are restricted to encoding videos to a fixed number of tokens, where…

Machine Learning · Computer Science 2025-02-04 Wilson Yan , Volodymyr Mnih , Aleksandra Faust , Matei Zaharia , Pieter Abbeel , Hao Liu

Audio tokenizers are fundamental to unifying audio understanding and generation. Understanding requires high-level semantics, while generation demands semantic and acoustic details. Existing unified tokenizers jointly encode both in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-28 Zhisheng Zhang , Xiang Li , Yixuan Zhou , Jing Peng , Guoyang Zeng , Zhiyong Wu

Unified Multimodal Large Language Models (MLLMs) require a visual representation that simultaneously supports high-fidelity reconstruction, complex semantic extraction, and generative suitability. However, existing visual tokenizers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Shaobin Zhuang , Yuang Ai , Jiaming Han , Weijia Mao , Xiaohui Li , Fangyikang Wang , Xiao Wang , Yan Li , Shanchuan Lin , Kun Xu , Zhenheng Yang , Huaibo Huang , Xiangyu Yue , Hao Chen , Yali Wang

Image tokenizers are crucial for visual generative models, e.g., diffusion models (DMs) and autoregressive (AR) models, as they construct the latent representation for modeling. Increasing token length is a common approach to improve the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Xiang Li , Kai Qiu , Hao Chen , Jason Kuen , Jiuxiang Gu , Bhiksha Raj , Zhe Lin

Visual tokenizers are fundamental to image generation. They convert visual data into discrete tokens, enabling transformer-based models to excel at image generation. Despite their success, VQ-based tokenizers like VQGAN face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Zechen Bai , Jianxiong Gao , Ziteng Gao , Pichao Wang , Zheng Zhang , Tong He , Mike Zheng Shou

Although existing unified models achieve strong performance in vision-language understanding and text-to-image generation, they remain limited in addressing image perception and manipulation -- capabilities increasingly demanded in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Bin Lin , Zongjian Li , Xinhua Cheng , Yuwei Niu , Yang Ye , Xianyi He , Shenghai Yuan , Wangbo Yu , Shaodong Wang , Yunyang Ge , Yatian Pang , Li Yuan

We propose V2Flow, a novel tokenizer that produces discrete visual tokens capable of high-fidelity reconstruction, while ensuring structural and latent distribution alignment with the vocabulary space of large language models (LLMs).…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guiwei Zhang , Tianyu Zhang , Mohan Zhou , Yalong Bai , Biye Li

Multimodal large language models (MLLMs) have made significant advancements in vision understanding and reasoning. However, the autoregressive Transformer architecture used by MLLMs requries tokenization on input images, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Xiangxuan Ren , Zhongdao Wang , Liping Hou , Pin Tang , Guoqing Wang , Chao Ma

Image-text matching has been a hot research topic bridging the vision and language areas. It remains challenging because the current representation of image usually lacks global semantic concepts as in its corresponding text caption. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kunpeng Li , Yulun Zhang , Kai Li , Yuanyuan Li , Yun Fu

We present AToken, the first unified visual tokenizer that achieves both high-fidelity reconstruction and semantic understanding across images, videos, and 3D assets. Unlike existing tokenizers that specialize in either reconstruction or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Jiasen Lu , Liangchen Song , Mingze Xu , Byeongjoo Ahn , Yanjun Wang , Chen Chen , Afshin Dehghan , Yinfei Yang

Unifying multimodal understanding, generation and reconstruction representation in a single tokenizer remains a key challenge in building unified models. Previous research predominantly attempts to address this in a dual encoder paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Sinan Du , Jiahao Guo , Bo Li , Shuhao Cui , Zhengzhuo Xu , Yifu Luo , Yongxian Wei , Kun Gai , Xinggang Wang , Kai Wu , Chun Yuan

Recent advances in visual generation have emphasized the importance of Latent Generative Models (LGMs), which critically depend on effective visual tokenizers to bridge pixels and semantic representations. However, tokenizers constructed on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingkai Jia , Mingxiao Li , Zhijian Shu , Anlin Zheng , Liaoyuan Fan , Jiaxin Guo , Tianxing Shi , Dongyue Lu , Zeming Li , Xiaoyang Guo , Xiaojuan Qi , Xiao-Xiao Long , Qian Zhang , Ping Tan , Wei Yin

In this work, we reveal the limitations of visual tokenizers and VAEs in preserving fine-grained features, and propose a benchmark to evaluate reconstruction performance for two challenging visual contents: text and face. Visual tokenizers…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Junfeng Wu , Dongliang Luo , Weizhi Zhao , Zhihao Xie , Yuanhao Wang , Junyi Li , Xudong Xie , Yuliang Liu , Xiang Bai

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang

Measuring concept generalization, i.e., the extent to which models trained on a set of (seen) visual concepts can be leveraged to recognize a new set of (unseen) concepts, is a popular way of evaluating visual representations, especially in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Mert Bulent Sariyildiz , Yannis Kalantidis , Diane Larlus , Karteek Alahari

Most existing methods in vision-language retrieval match two modalities by either comparing their global feature vectors which misses sufficient information and lacks interpretability, detecting objects in images or videos and aligning the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiaohan Zou , Changqiao Wu , Lele Cheng , Zhongyuan Wang

Discrete video VAEs underpin modern text-to-video generation and video understanding systems, yet existing tokenizers typically learn visual codebooks at a single scale with limited vocabularies and shallow language supervision, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Onkar Susladkar , Tushar Prakash , Adheesh Juvekar , Kiet A. Nguyen , Dong-Hwan Jang , Inderjit S Dhillon , Ismini Lourentzou

In this work, we introduce Vision-Language Generative Pre-trained Transformer (VL-GPT), a transformer model proficient at concurrently perceiving and generating visual and linguistic data. VL-GPT achieves a unified pre-training approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jinguo Zhu , Xiaohan Ding , Yixiao Ge , Yuying Ge , Sijie Zhao , Hengshuang Zhao , Xiaohua Wang , Ying Shan

This paper explores the possibility of learning custom tokens for representing new concepts in Vision-Language Models (VLMs). Our aim is to learn tokens that can be effective for both discriminative and generative tasks while composing well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Pramuditha Perera , Matthew Trager , Luca Zancato , Alessandro Achille , Stefano Soatto

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee