English
Related papers

Related papers: Image Understanding Makes for A Good Tokenizer for…

200 papers

Computer vision has achieved remarkable success by (a) representing images as uniformly-arranged pixel arrays and (b) convolving highly-localized features. However, convolutions treat all image pixels equally regardless of importance;…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Bichen Wu , Chenfeng Xu , Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Zhicheng Yan , Masayoshi Tomizuka , Joseph Gonzalez , Kurt Keutzer , Peter Vajda

Generative training has been demonstrated to be powerful for building visual-language models. However, on zero-shot discriminative benchmarks, there is still a performance gap between models trained with generative and discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Chenglin Yang , Siyuan Qiao , Yuan Cao , Yu Zhang , Tao Zhu , Alan Yuille , Jiahui Yu

Recent works have made notable advancements in enhancing unified models for text-to-image generation through the Chain-of-Thought (CoT). However, these reasoning methods separate the processes of understanding and generation, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuanhuiyi Lyu , Chi Kit Wong , Chenfei Liao , Lutao Jiang , Xu Zheng , Zexin Lu , Linfeng Zhang , Xuming Hu

Visual tokenization remains a core challenge in unifying visual understanding and generation within the autoregressive paradigm. Existing methods typically employ tokenizers in discrete latent spaces to align with the tokens from large…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ziyuan Huang , DanDan Zheng , Cheng Zou , Rui Liu , Xiaolong Wang , Kaixiang Ji , Weilong Chai , Jianxin Sun , Libin Wang , Yongjie Lv , Taozhi Huang , Jiajia Liu , Qingpei Guo , Ming Yang , Jingdong Chen , Jun Zhou

Image Quality Assessment (IQA) models are employed in many practical image and video processing pipelines to reduce storage, minimize transmission costs, and improve the Quality of Experience (QoE) of millions of viewers. These models are…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Krishna Srikar Durbha , Asvin Kumar Venkataramanan , Rajesh Sureddi , Alan C. Bovik

In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jianfeng Wang , Zhengyuan Yang , Xiaowei Hu , Linjie Li , Kevin Lin , Zhe Gan , Zicheng Liu , Ce Liu , Lijuan Wang

With growing abilities of generative models, artificial content detection becomes an increasingly important and difficult task. However, all popular approaches to this problem suffer from poor generalization across domains and generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Tatiana Gaintseva , Laida Kushnareva , German Magai , Irina Piontkovskaya , Sergey Nikolenko , Martin Benning , Serguei Barannikov , Gregory Slabaugh

Recently, AIGC image quality assessment (AIGCIQA), which aims to assess the quality of AI-generated images (AIGIs) from a human perception perspective, has emerged as a new topic in computer vision. Unlike common image quality assessment…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jiquan Yuan , Xinyan Cao , Jinming Che , Qinyuan Wang , Sen Liang , Wei Ren , Jinlong Lin , Xixin Cao

While Large Language Models (LLMs) are the dominant models for generative tasks in language, they do not perform as well as diffusion models on image and video generation. To effectively use LLMs for visual generation, one crucial component…

Fine-grained knowledge is crucial for vision-language models to obtain a better understanding of the real world. While there has been work trying to acquire this kind of knowledge in the space of vision and language, it has mostly focused…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Melika Behjati , James Henderson

With the rapid development of generative technologies, AI-Generated Images (AIGIs) have been widely applied in various aspects of daily life. However, due to the immaturity of the technology, the quality of the generated images varies, so…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zhenchen Tang , Zichuan Wang , Bo Peng , Jing Dong

Discrete image tokenizers have emerged as a key component of modern vision and multimodal systems, providing a sequential interface for transformer-based architectures. However, most existing approaches remain primarily optimized for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Aram Davtyan , Yusuf Sahin , Yasaman Haghighi , Sebastian Stapf , Pablo Acuaviva , Alexandre Alahi , Paolo Favaro

PICNet pioneered the generation of multiple and diverse results for image completion task, but it required a careful balance between $\mathcal{KL}$ loss (diversity) and reconstruction loss (quality), resulting in a limited diversity and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Chuanxia Zheng , Guoxian Song , Tat-Jen Cham , Jianfei Cai , Dinh Phung , Linjie Luo

Vision tokenizers have gained a lot of attraction due to their scalability and compactness; previous works depend on old-school GAN-based hyperparameters, biased comparisons, and a lack of comprehensive analysis of the scaling behaviours.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jiangtao Wang , Zhen Qin , Yifan Zhang , Vincent Tao Hu , Björn Ommer , Rania Briq , Stefan Kesselheim

Image encoders, a fundamental component of vision-language models (VLMs), are typically pretrained independently before being aligned with a language model. This standard paradigm results in encoders that process images agnostically,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Raghuveer Thirukovalluru , Xiaochuang Han , Bhuwan Dhingra , Emily Dinan , Maha Elbayad

Most existing image tokenizers encode images into a fixed number of tokens or patches, overlooking the inherent variability in image complexity. To address this, we introduce Content-Adaptive Tokenizer (CAT), which dynamically adjusts…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Junhong Shen , Kushal Tirumala , Michihiro Yasunaga , Ishan Misra , Luke Zettlemoyer , Lili Yu , Chunting Zhou

Effective recommendation is crucial for large-scale online platforms. Traditional recommendation systems primarily rely on ID tokens to uniquely identify items, which can effectively capture specific item relationships but suffer from…

Information Retrieval · Computer Science 2025-02-25 Guanyu Lin , Zhigang Hua , Tao Feng , Shuang Yang , Bo Long , Jiaxuan You

The past decades have witnessed the rapid development of image and video coding techniques in the era of big data. However, the signal fidelity-driven coding pipeline design limits the capability of the existing image/video coding…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Yueyu Hu , Shuai Yang , Wenhan Yang , Ling-Yu Duan , Jiaying Liu

Text-to-image generative models often reflect the biases of the training data, leading to unequal representations of underrepresented groups. This study investigates inclusive text-to-image generative models that generate images based on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Cheng Zhang , Xuanbai Chen , Siqi Chai , Chen Henry Wu , Dmitry Lagun , Thabo Beeler , Fernando De la Torre

We present Qwen-Image, an image generation foundation model in the Qwen series that achieves significant advances in complex text rendering and precise image editing. To address the challenges of complex text rendering, we design a…