English
Related papers

Related papers: Fine-Tuning Visual Autoregressive Models for Subje…

200 papers

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

Autoregressive (AR) modeling has achieved remarkable success in natural language processing by enabling models to generate text with coherence and contextual understanding through next token prediction. Recently, in image generation, VAR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Sucheng Ren , Qihang Yu , Ju He , Xiaohui Shen , Alan Yuille , Liang-Chieh Chen

Recent advances in autoregressive (AR) generative models have produced increasingly powerful systems for media synthesis. Among them, next-scale prediction has emerged as a popular paradigm, where models generate images in a coarse-to-fine…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Gengze Zhou , Chongjian Ge , Hao Tan , Feng Liu , Yicong Hong

Visual Autoregressive (VAR) models have emerged as a powerful paradigm for image synthesis by performing hierarchical next-scale prediction. However, VAR models are inherently prone to cascading error propagation, where subtle coarse-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ligong Bi , Tao Huang , Jianyuan Guo , Chang Xu

While visual autoregressive modeling (VAR) strategies have shed light on image generation with the autoregressive models, their potential for segmentation, a task that requires precise low-level spatial perception, remains unexplored.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Hengshuang Zhao

Conditional visual generation has witnessed remarkable progress with the advent of diffusion models (DMs), especially in tasks like control-to-image generation. However, challenges such as expensive computational cost, high inference…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Xiang Li , Kai Qiu , Hao Chen , Jason Kuen , Zhe Lin , Rita Singh , Bhiksha Raj

Visual Auto-Regressive (VAR) models significantly reduce inference steps through the "next-scale" prediction paradigm. However, progressive multi-scale generation incurs substantial memory overhead due to cumulative KV caching, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Xiaoyue Chen , Yuling Shi , Kaiyuan Li , Huandong Wang , Yong Li , Xiaodong Gu , Xinlei Chen , Mingbao Lin

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junhao Li , Xinhao Zhong , Yi sun , Yuxia Qiao , Bin Chen , Shu-Tao Xia , Yaowei Wang

Large text-to-image models achieved a remarkable leap in the evolution of AI, enabling high-quality and diverse synthesis of images from a given text prompt. However, these models lack the ability to mimic the appearance of subjects in a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Nataniel Ruiz , Yuanzhen Li , Varun Jampani , Yael Pritch , Michael Rubinstein , Kfir Aberman

Visual Autoregressive (VAR) modeling departs from the next-token prediction paradigm of traditional Autoregressive (AR) models through next-scale prediction, enabling high-quality image generation. However, the VAR paradigm suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Senmao Li , Kai Wang , Salman Khan , Fahad Shahbaz Khan , Jian Yang , Yaxing Wang

Autoregressive (AR) models for image generation typically adopt a two-stage paradigm of vector quantization and raster-scan ``next-token prediction", inspired by its great success in language modeling. However, due to the huge modality gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hu Yu , Hao Luo , Hangjie Yuan , Yu Rong , Jie Huang , Feng Zhao

Autoregressive (AR) image generators offer a language-model-friendly approach to image generation by predicting discrete image tokens in a causal sequence. However, unlike diffusion models, AR models lack a mechanism to refine previous…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Cheng Cheng , Lin Song , Di An , Yicheng Xiao , Xuchong Zhang , Hongbin Sun , Ying Shan

Controllable image synthesis, which enables fine-grained control over generated outputs, has emerged as a key focus in visual generative modeling. However, controllable generation remains challenging for Visual Autoregressive (VAR) models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ryan Xu , Dongyang Jin , Yancheng Bai , Rui Lan , Xu Duan , Lei Sun , Xiangxiang Chu

Visual Autoregressive (VAR) modeling approach for image generation proposes autoregressive processing across hierarchical scales, decoding multiple tokens per scale in parallel. This method achieves high-quality generation while…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Hong-Kai Zheng , Piji Li

Recent studies have demonstrated the importance of high-quality visual representations in image generation and have highlighted the limitations of generative models in image understanding. As a generative paradigm originally designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Xiaoyu Yue , Zidong Wang , Yuqing Wang , Wenlong Zhang , Xihui Liu , Wanli Ouyang , Lei Bai , Luping Zhou

Remote sensing change detection aims to localize and characterize scene changes between two time points and is central to applications such as environmental monitoring and disaster assessment. Meanwhile, visual autoregressive models (VARs)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yilmaz Korkmaz , Vishal M. Patel

We propose a monocular depth estimation method based on visual autoregressive (VAR) priors, offering an alternative to diffusion-based approaches. Our method adapts a large-scale text-to-image VAR model and introduces a scale-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Amir El-Ghoussani , André Kaup , Nassir Navab , Gustavo Carneiro , Vasileios Belagiannis

As large-scale text-to-image generation models have made remarkable progress in the field of text-to-image generation, many fine-tuning methods have been proposed. However, these models often struggle with novel objects, especially with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jianxiang Lu , Cong Xie , Hui Guo

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Text-to-image generation with visual autoregressive~(VAR) models has recently achieved impressive advances in generation fidelity and inference efficiency. While control mechanisms have been explored for diffusion models, enabling precise…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Keli Liu , Zhendong Wang , Wengang Zhou , Shaodong Xu , Ruixiao Dong , Houqiang Li