English
Related papers

Related papers: CAR: Controllable Autoregressive Modeling for Visu…

200 papers

Autoregressive and diffusion models represent two complementary generative paradigms. Autoregressive models excel at sequential planning and constraint composition, yet struggle with tasks that require explicit spatial or physical…

Artificial Intelligence · Computer Science 2026-02-03 Mu Yuan , Liekang Zeng , Guoliang Xing , Lan Zhang , Yunhao Liu

Diffusion models have recently gained significant attention in robotics due to their ability to generate multi-modal distributions of system states and behaviors. However, a key challenge remains: ensuring precise control over the generated…

Robotics · Computer Science 2025-10-01 Luobin Wang , Hongzhan Yu , Chenning Yu , Sicun Gao , Henrik Christensen

Generative models have advanced significantly in realistic image synthesis, with diffusion models excelling in quality and stability. Recent multi-view diffusion models improve 3D-aware street view generation, but they struggle to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Ji Li , Zhiwei Li , Shihao Li , Zhenjiang Yu , Boyang Wang , Haiou Liu

We build on the Visual Autoregressive Modeling (VAR) framework and formulate style transfer as conditional discrete sequence modeling in a learned latent space. Images are decomposed into multi-scale representations and tokenized into…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Liqi Jing , Dingming Zhang , Peinian Li , Lichen Zhu , Yang Xu , Hanyu Xing

Recent advances in diffusion-based controllable visual generation have led to remarkable improvements in image quality. However, these powerful models are typically deployed on cloud servers due to their large computational demands, raising…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuhe Liu , Zhenxiong Tan , Yujia Hu , Songhua Liu , Xinchao Wang

With the rapid development of AI-generated content (AIGC), video generation has emerged as one of its most dynamic and impactful subfields. In particular, the advancement of video generation foundation models has led to growing demand for…

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

Classifier-free guidance (CFG) has become a widely adopted and practical approach for enhancing generation quality and improving condition alignment. Recent studies have explored guidance mechanisms for unconditional generation, yet these…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chaoyang Wang , Tianmeng Yang , Jingdong Wang , Yunhai Tong

Controllable layout generation refers to the process of creating a plausible visual arrangement of elements within a graphic design (e.g., document and web designs) with constraints representing design intentions. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jian Chen , Ruiyi Zhang , Yufan Zhou , Rajiv Jain , Zhiqiang Xu , Ryan Rossi , Changyou Chen

Interior design is a complex and creative discipline involving aesthetics, functionality, ergonomics, and materials science. Effective solutions must meet diverse requirements, typically producing multiple deliverables such as renderings…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yuxuan Yang , Tao Geng

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junhao Li , Xinhao Zhong , Yi sun , Yuxia Qiao , Bin Chen , Shu-Tao Xia , Yaowei Wang

While modern diffusion models excel at generating high-quality and diverse images, they still struggle with high-fidelity compositional and multimodal control, particularly when users simultaneously specify text prompts, subject references,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yusuf Dalva , Guocheng Gordon Qian , Maya Goldenberg , Tsai-Shien Chen , Kfir Aberman , Sergey Tulyakov , Pinar Yanardag , Kuan-Chieh Jackson Wang

Autoregressive (AR) transformers have emerged as a powerful paradigm for visual generation, largely due to their scalability, computational efficiency and unified architecture with language and vision. Among them, next scale prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Amandeep Kumar , Nithin Gopalakrishnan Nair , Vishal M. Patel

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Recently, autoregressive (AR) models have shown strong potential in image generation, offering better scalability and easier integration with unified multi-modal systems compared to diffusion-based methods. However, extending AR models to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Dongyang Jin , Ryan Xu , Jianhao Zeng , Rui Lan , Yancheng Bai , Lei Sun , Xiangxiang Chu

Recent progress in panoramic image generation has underscored two critical limitations in existing approaches. First, most methods are built upon diffusion models, which are inherently ill-suited for equirectangular projection (ERP)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chaoyang Wang , Xiangtai Li , Lu Qi , Xiaofan Lin , Jinbin Bai , Qianyu Zhou , Yunhai Tong

Autoregressive visual generation has garnered increasing attention due to its scalability and compatibility with other modalities compared with diffusion models. Most existing methods construct visual sequences as spatial patches for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yuanhui Huang , Weiliang Chen , Wenzhao Zheng , Yueqi Duan , Jie Zhou , Jiwen Lu

This article makes discrete masked models for the generative modeling of discrete data controllable. The goal is to generate samples of a discrete random variable that adheres to a posterior distribution, satisfies specific constraints, or…

Machine Learning · Computer Science 2024-10-04 Wei Guo , Yuchen Zhu , Molei Tao , Yongxin Chen

Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Thomas Lucas , Jakob Verbeek

Recent advances in diffusion models have brought remarkable visual fidelity to instruction-guided image editing. However, their global denoising process inherently entangles the edited region with the entire image context, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Qingyang Mao , Qi Cai , Yehao Li , Yingwei Pan , Mingyue Cheng , Ting Yao , Qi Liu , Tao Mei