English
Related papers

Related papers: EVATok: Adaptive Length Video Tokenization for Eff…

200 papers

We propose AdapTok, an adaptive temporal causal video tokenizer that can flexibly allocate tokens for different frames based on video content. AdapTok is equipped with a block-wise masking strategy that randomly drops tail tokens of each…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Yan Li , Changyao Tian , Renqiu Xia , Ning Liao , Weiwei Guo , Junchi Yan , Hongsheng Li , Jifeng Dai , Hao Li , Xue Yang

Efficient video tokenization remains a key bottleneck in learning general purpose vision models that are capable of processing long video sequences. Prevailing approaches are restricted to encoding videos to a fixed number of tokens, where…

Machine Learning · Computer Science 2025-02-04 Wilson Yan , Volodymyr Mnih , Aleksandra Faust , Matei Zaharia , Pieter Abbeel , Hao Liu

This work presents VTok, a unified video tokenization framework that can be used for both generation and understanding tasks. Unlike the leading vision-language systems that tokenize videos through a naive frame-sampling strategy, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Feng Wang , Yichun Shi , Ceyuan Yang , Qiushan Guo , Jingxiang Sun , Alan Yuille , Peng Wang

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

In autoregressive (AR) image generation, visual tokenizers compress images into compact discrete latent tokens, enabling efficient training of downstream autoregressive models for visual generation via next-token prediction. While scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Tianwei Xiong , Jun Hao Liew , Zilong Huang , Jiashi Feng , Xihui Liu

Masked-based autoregressive models have demonstrated promising image generation capability in continuous space. However, their potential for video generation remains under-explored. In this paper, we propose \textbf{VideoMAR}, a concise and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Hu Yu , Biao Gong , Hangjie Yuan , DanDan Zheng , Weilong Chai , Jingdong Chen , Kecheng Zheng , Feng Zhao

Autoregressive (AR) models have recently shown strong performance in image generation, where a critical component is the visual tokenizer (VT) that maps continuous pixel inputs to discrete token sequences. The quality of the VT largely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Huawei Lin , Tong Geng , Zhaozhuo Xu , Weijie Zhao

Efficient tokenization of videos remains a challenge in training vision models that can process long videos. One promising direction is to develop a tokenizer that can encode long video clips, as it would enable the tokenizer to leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Huiwon Jang , Sihyun Yu , Jinwoo Shin , Pieter Abbeel , Younggyo Seo

VQ-based image generation typically follows a two-stage pipeline: a tokenizer encodes images into discrete tokens, and a generative model learns their dependencies for reconstruction. However, improved tokenization in the first stage does…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Bin Wu , Mengqi Huang , Weinan Jia , Zhendong Mao

Visual tokenizers map high-dimensional raw pixels into a compressed representation for downstream modeling. Beyond compression, tokenizers dictate what information is preserved and how it is organized. A de facto standard approach to video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Andrei Atanov , Jesse Allardice , Roman Bachmann , Oğuzhan Fatih Kar , R Devon Hjelm , David Griffiths , Peter Fu , Afshin Dehghan , Amir Zamir

Encoding video content into compact latent tokens has become a fundamental step in video generation and understanding, driven by the need to address the inherent redundancy in pixel-level representations. Consequently, there is a growing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Anni Tang , Tianyu He , Junliang Guo , Xinle Cheng , Li Song , Jiang Bian

Modern video generation frameworks based on Latent Diffusion Models suffer from inefficiencies in tokenization due to the Frame-Proportional Information Assumption. Existing tokenizers provide fixed temporal compression rates, causing the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Tianxiong Zhong , Xingye Tian , Boyuan Jiang , Xuebo Wang , Xin Tao , Pengfei Wan , Zhiwei Zhang

The development of unified multimodal large language models (MLLMs) is fundamentally challenged by the granularity gap between visual understanding and generation: understanding requires high-level semantic abstractions, while image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yan Li , Ning Liao , Xiangyu Zhao , Shaofeng Zhang , Xiaoxing Wang , Yifan Yang , Junchi Yan , Xue Yang

Tokenization in video models, typically through patchification, generates an excessive and redundant number of tokens. This severely limits video efficiency and scalability. While recent trajectory-based tokenizers offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Zheng , Jieyu Zhang , Jianing Zhang , Weikai Huang , Ashutosh Kumar , Quan Kong , Oncel Tuzel , Chun-Liang Li , Ranjay Krishna

Token-based video representation has emerged as a promising approach for enabling large language models (LLMs) to interpret video content. However, existing token reduction techniques, such as pruning and merging, often disrupt essential…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haichao Zhang , Yun Fu

Recent advances in autoregressive (AR) models with continuous tokens for image generation show promising results by eliminating the need for discrete tokenization. However, these models face efficiency challenges due to their sequential…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Zhihang Yuan , Yuzhang Shang , Hanling Zhang , Tongcheng Fang , Rui Xie , Bingxin Xu , Yan Yan , Shengen Yan , Guohao Dai , Yu Wang

Real-time transmission of video over wireless networks remains highly challenging, even with advanced deep models, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In this paper, we propose…

Information Theory · Computer Science 2025-10-30 Zhenyu Liu , Yi Ma , Rahim Tafazolli , Zhi Ding

Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present a significant bottleneck for current tokenizers, which…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haotian Ye , Qiyuan He , Jiaqi Han , Puheng Li , Jiaojiao Fan , Zekun Hao , Fitsum Reda , Yogesh Balaji , Huayu Chen , Sheng Liu , Angela Yao , James Zou , Stefano Ermon , Haoxiang Wang , Ming-Yu Liu

Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ruiqing Yang , Kaixin Zhang , Zheng Zhang , Shan You , Tao Huang

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang
‹ Prev 1 2 3 10 Next ›