English
Related papers

Related papers: VidTok: A Versatile and Open-Source Video Tokenize…

200 papers

We present AToken, the first unified visual tokenizer that achieves both high-fidelity reconstruction and semantic understanding across images, videos, and 3D assets. Unlike existing tokenizers that specialize in either reconstruction or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Jiasen Lu , Liangchen Song , Mingze Xu , Byeongjoo Ahn , Yanjun Wang , Chen Chen , Afshin Dehghan , Yinfei Yang

The development of unified multimodal large language models (MLLMs) is fundamentally challenged by the granularity gap between visual understanding and generation: understanding requires high-level semantic abstractions, while image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yan Li , Ning Liao , Xiangyu Zhao , Shaofeng Zhang , Xiaoxing Wang , Yifan Yang , Junchi Yan , Xue Yang

In this work, we propose aligning pretrained visual encoders to serve as tokenizers for latent diffusion models in image generation. Unlike training a variational autoencoder (VAE) from scratch, which primarily emphasizes low-level details,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Bowei Chen , Sai Bi , Hao Tan , He Zhang , Tianyuan Zhang , Zhengqi Li , Yuanjun Xiong , Jianming Zhang , Kai Zhang

Visual tokenization via auto-encoding empowers state-of-the-art image and video generative models by compressing pixels into a latent space. Although scaling Transformer-based generators has been central to recent advances, the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Philippe Hansen-Estruch , David Yan , Ching-Yao Chung , Orr Zohar , Jialiang Wang , Tingbo Hou , Tao Xu , Sriram Vishwanath , Peter Vajda , Xinlei Chen

VQ-based image generation typically follows a two-stage pipeline: a tokenizer encodes images into discrete tokens, and a generative model learns their dependencies for reconstruction. However, improved tokenization in the first stage does…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Bin Wu , Mengqi Huang , Weinan Jia , Zhendong Mao

In autoregressive (AR) image generation, visual tokenizers compress images into compact discrete latent tokens, enabling efficient training of downstream autoregressive models for visual generation via next-token prediction. While scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Tianwei Xiong , Jun Hao Liew , Zilong Huang , Jiashi Feng , Xihui Liu

Recent advances in Video Large Language Models (VLLMs) have significantly enhanced their ability to understand video content. Nonetheless, processing long videos remains challenging due to high computational demands and the redundancy…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mengyue Wang , Shuo Chen , Kristian Kersting , Volker Tresp , Yunpu Ma

Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extending state-of-the-art video tokenizers to achieve a temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Aniruddha Mahapatra , Long Mai , David Bourgin , Yitian Zhang , Feng Liu

Versatile Video Coding (VVC) is the most recent international video coding standard jointly developed by ITU-T and ISO/IEC, which has been finalized in July 2020. VVC allows for significant bit-rate reductions around 50% for the same…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Adam Wieckowski , Christian Lehmann , Benjamin Bross , Detlev Marpe , Thibaud Biatek , Mickael Raulet , Jean Le Feuvre

Image tokenization, the process of transforming raw image pixels into a compact low-dimensional latent representation, has proven crucial for scalable and efficient image generation. However, mainstream image tokenization methods generally…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Kaiwen Zha , Lijun Yu , Alireza Fathi , David A. Ross , Cordelia Schmid , Dina Katabi , Xiuye Gu

Typical video modeling methods, such as LLava, represent videos as sequences of visual tokens, which are then processed by the LLM backbone for effective video understanding. However, this approach leads to a massive number of visual…

Computation and Language · Computer Science 2025-06-05 Hongzhi Zhang , Jingyuan Zhang , Xingguang Ji , Qi Wang , Fuzheng Zhang

We present pure-transformer based models for video classification, drawing upon the recent success of such models in image classification. Our model extracts spatio-temporal tokens from the input video, which are then encoded by a series of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Anurag Arnab , Mostafa Dehghani , Georg Heigold , Chen Sun , Mario Lučić , Cordelia Schmid

Visual tokenization remains a core challenge in unifying visual understanding and generation within the autoregressive paradigm. Existing methods typically employ tokenizers in discrete latent spaces to align with the tokens from large…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ziyuan Huang , DanDan Zheng , Cheng Zou , Rui Liu , Xiaolong Wang , Kaixiang Ji , Weilong Chai , Jianxin Sun , Libin Wang , Yongjie Lv , Taozhi Huang , Jiajia Liu , Qingpei Guo , Ming Yang , Jingdong Chen , Jun Zhou

This paper presents ViTOC (Vision Transformer and Object-aware Captioner), a novel vision-language model for image captioning that addresses the challenges of accuracy and diversity in generated descriptions. Unlike conventional approaches,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Feiyang Huang

Real-time transmission of visual data over wireless networks remains highly challenging, even when leveraging advanced deep neural networks, particularly under severe channel conditions such as limited bandwidth and weak connectivity. In…

Information Theory · Computer Science 2025-05-06 Zhenyu Liu , Yi Ma , Rahim Tafazolli

We present SceneTok, a novel tokenizer for encoding view sets of scenes into a compressed and diffusable set of unstructured tokens. Existing approaches for 3D scene representation and generation commonly use 3D data structures or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mohammad Asim , Christopher Wewer , Jan Eric Lenssen

The fundamental challenge in scaling Video Large Language Models (Video LLMs) to long-form video lies in managing the explosion of visual-token context length. Existing strategies predominantly focus on "post-hoc" token reduction --…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jihwan Kim , Nikhil Parthasarathy , Danfeng Qin , Junhwa Hur , Deqing Sun , Bohyung Han , Ming-Hsuan Yang , Boqing Gong

In recent years, there has been a significant surge of interest in unifying image comprehension and generation within Large Language Models (LLMs). This growing interest has prompted us to explore extending this unification to videos. The…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yuying Ge , Yizhuo Li , Yixiao Ge , Ying Shan

Visual tokenizers are fundamental to image generation. They convert visual data into discrete tokens, enabling transformer-based models to excel at image generation. Despite their success, VQ-based tokenizers like VQGAN face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Zechen Bai , Jianxiong Gao , Ziteng Gao , Pichao Wang , Zheng Zhang , Tong He , Mike Zheng Shou

Image tokenization has enabled major advances in autoregressive image generation by providing compressed, discrete representations that are more efficient to process than raw pixels. While traditional approaches use 2D grid tokenization,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Roman Bachmann , Jesse Allardice , David Mizrahi , Enrico Fini , Oğuzhan Fatih Kar , Elmira Amirloo , Alaaeldin El-Nouby , Amir Zamir , Afshin Dehghan