English
Related papers

Related papers: From "What" to "How": Constrained Reasoning for Au…

200 papers

Recently, Vector Quantized AutoRegressive (VQ-AR) models have shown remarkable results in text-to-image synthesis by equally predicting discrete image tokens from the top left to bottom right in the latent space. Although the simple…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Zhengcong Fei , Mingyuan Fan , Li Zhu , Junshi Huang

Current text-to-image (T2I) generation models struggle to align spatial composition with the input text, especially in complex scenes. Even layout-based approaches yield suboptimal spatial control, as their generation process is decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheyuan Liu , Munan Ning , Qihui Zhang , Shuo Yang , Zhongrui Wang , Yiwei Yang , Xianzhe Xu , Yibing Song , Weihua Chen , Fan Wang , Li Yuan

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Quantitative T1rho mapping has shown promise in clinical and research studies. However, it suffers from long scan times. Deep learning-based techniques have been successfully applied in accelerated quantitative MR parameter mapping.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-25 Yuanyuan Liu , Jinwen Xie , Zhuo-Xu Cui , Qingyong Zhu , Jing Cheng , Dong Liang , Yanjie Zhu

Conditional image generation is an active research topic including text2image and image translation. Recently image manipulation with linguistic instruction brings new challenges of multimodal conditional generation. However, traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Zhenhuan Liu , Jincan Deng , Liang Li , Shaofei Cai , Qianqian Xu , Shuhui Wang , Qingming Huang

Text-to-Motion generation has become a fundamental task in human-machine interaction, enabling the synthesis of realistic human motions from natural language descriptions. Although recent advances in large language models and reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Runqi Ouyang , Haoyun Li , Zhenyuan Zhang , Xiaofeng Wang , Zeyu Zhang , Zheng Zhu , Guan Huang , Sirui Han , Xingang Wang

Traditional rendering pipelines rely on complex assets, accurate materials and lighting, and substantial computational resources to produce realistic imagery, yet they still face challenges in scalability and realism for populated dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Gonzalo Gomez-Nogales , Yicong Hong , Chongjian Ge , Peiye Zhuang , Marc Comino-Trinidad , Dan Casas , Yi Zhou

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…

In this work, we first revisit the sampling issues in current autoregressive (AR) image generation models and identify that image tokens, unlike text tokens, exhibit lower information density and non-uniform spatial distribution.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xiaoxiao Ma , Feng Zhao , Pengyang Ling , Haibo Qiu , Zhixiang Wei , Hu Yu , Jie Huang , Zhixiong Zeng , Lin Ma

Recent progress in text-guided image inpainting, based on the unprecedented success of text-to-image diffusion models, has led to exceptionally realistic and visually plausible results. However, there is still significant potential for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Hayk Manukyan , Andranik Sargsyan , Barsegh Atanyan , Zhangyang Wang , Shant Navasardyan , Humphrey Shi

Modern text-to-image generation systems have enabled the creation of remarkably realistic and high-quality visuals, yet they often falter when handling the inherent ambiguities in user prompts. In this work, we present Twin-Co, a framework…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jianhui Wang , Yangfan He , Yan Zhong , Xinyuan Song , Jiayi Su , Yuheng Feng , Ruoyu Wang , Hongyang He , Wenyu Zhu , Xinhang Yuan , Miao Zhang , Keqin Li , Jiaqi Chen , Tianyu Shi , Xueqian Wang

In the current research landscape, multimodal autoregressive (AR) models have shown exceptional capabilities across various domains, including visual understanding and generation. However, complex tasks such as style-aligned text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yi Wu , Lingting Zhu , Shengju Qian , Lei Liu , Wandi Qiao , Lequan Yu , Bin Li

The inherent generative power of denoising diffusion models makes them well-suited for image restoration tasks where the objective is to find the optimal high-quality image within the generative space that closely resembles the input image.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zheng Ding , Xuaner Zhang , Zhuowen Tu , Zhihao Xia

Autoregressive conditional image generation algorithms are capable of generating photorealistic images that are consistent with given textual or image conditions, and have great potential for a wide range of applications. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Qiaoying Qu , Shiyu Shen

Regional prompting, or compositional generation, which enables fine-grained spatial control, has gained increasing attention for its practicality in real-world applications. However, previous methods either introduce additional trainable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Zhennan Chen , Yajie Li , Haofan Wang , Zhibo Chen , Zhengkai Jiang , Jun Li , Qian Wang , Jian Yang , Ying Tai

Inspired by the remarkable success of autoregressive models in language modeling, this paradigm has been widely adopted in visual generation. However, the sequential token-by-token decoding mechanism inherent in traditional autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Siyang Wang , Hanting Li , Wei Li , Jie Hu , Xinghao Chen , Feng Zhao

Class-conditional generative models have emerged as accurate and robust classifiers, with diffusion models demonstrating clear advantages over other visual generative paradigms, including autoregressive (AR) models. In this work, we revisit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Ilia Sudakov , Artem Babenko , Dmitry Baranchuk

A single image can convey a compelling story through logically connected visual clues, forming Chains-of-Reasoning (CoRs). We define these semantically rich images as Storytelling Images. By conveying multi-layered information that inspires…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Xiujie Song , Qi Jia , Shota Watanabe , Xiaoyi Pang , Ruijie Chen , Mengyue Wu , Kenny Q. Zhu

We introduce a simple recurrent variational auto-encoder architecture that significantly improves image modeling. The system represents the state-of-the-art in latent variable models for both the ImageNet and Omniglot datasets. We show that…

Machine Learning · Statistics 2016-05-02 Karol Gregor , Frederic Besse , Danilo Jimenez Rezende , Ivo Danihelka , Daan Wierstra

Recent studies extend the autoregression paradigm to text-to-image generation, achieving performance comparable to diffusion models. However, our new PairComp benchmark -- featuring test cases of paired prompts with similar syntax but…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Kaihang Pan , Wendong Bu , Yuruo Wu , Yang Wu , Kai Shen , Yunfei Li , Hang Zhao , Juncheng Li , Siliang Tang , Yueting Zhuang