English
Related papers

Related papers: From "What" to "How": Constrained Reasoning for Au…

200 papers

Robotic assistance in scientific laboratories requires procedurally correct long-horizon manipulation, reliable execution under limited supervision, and robustness in low-demonstration regimes. Such conditions greatly challenge end-to-end…

Robotics · Computer Science 2026-02-11 Jinghan Yang , Jingyi Hou , Xinbo Yu , Wei He , Yifan Wu

Existing super-resolution (SR) models primarily focus on restoring local texture details, often neglecting the global semantic information within the scene. This oversight can lead to the omission of crucial semantic details or the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Haoze Sun , Wenbo Li , Jianzhuang Liu , Haoyu Chen , Renjing Pei , Xueyi Zou , Youliang Yan , Yujiu Yang

Despite the remarkable progress of image captioning, existing captioners typically lack the controllable capability to generate desired image captions, e.g., describing the image in a rough or detailed manner, in a factual or emotional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Ning Wang , Jiahao Xie , Jihao Wu , Mingbo Jia , Linlin Li

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

Existing multimodal large language models have achieved high-fidelity visual perception and exploratory visual generation. However, a precision paradox persists in complex reasoning tasks: optical perception systems transcribe symbols…

Computation and Language · Computer Science 2026-04-30 Jingxuan Wei , Honghao He , Caijun Jia , Siyuan Li , Zheng Sun , Yuhang Xu , Yuanyuan Lin , Linzhuang Sun , Yuchen Wu , Bihui Yu , Xiangxiang Zhang , Cheng Tan

Recent works have made notable advancements in enhancing unified models for text-to-image generation through the Chain-of-Thought (CoT). However, these reasoning methods separate the processes of understanding and generation, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuanhuiyi Lyu , Chi Kit Wong , Chenfei Liao , Lutao Jiang , Xu Zheng , Zexin Lu , Linfeng Zhang , Xuming Hu

Existing vector quantization (VQ) based autoregressive models follow a two-stage generation paradigm that first learns a codebook to encode images as discrete codes, and then completes generation based on the learned codebook. However, they…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Mengqi Huang , Zhendong Mao , Zhuowei Chen , Yongdong Zhang

Recent progress in multimodal reasoning has been significantly advanced by textual Chain-of-Thought (CoT), a paradigm where models conduct reasoning within language. This text-centric approach, however, treats vision as a static, initial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zhaochen Su , Peng Xia , Hangyu Guo , Zhenhua Liu , Yan Ma , Xiaoye Qu , Jiaqi Liu , Yanshu Li , Kaide Zeng , Zhengyuan Yang , Linjie Li , Yu Cheng , Heng Ji , Junxian He , Yi R. Fung

Autoregressive models for text sometimes generate repetitive and low-quality output because errors accumulate during the steps of generation. This issue is often attributed to exposure bias - the difference between how a model is trained,…

Computation and Language · Computer Science 2024-03-26 Yizhe Zhang , Jiatao Gu , Zhuofeng Wu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

Recent advances in multi-modal large language models (MLLMs) and chain-of-thought (CoT) reasoning have led to significant progress in image and text generation tasks. However, the field of 3D human pose generation still faces critical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Junuk Cha , Jihyeon Kim

Computer vision is hard because of a large variability in lighting, shape, and texture; in addition the image signal is non-additive due to occlusion. Generative models promised to account for this variability by accurately modelling the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-10 Varun Jampani , Sebastian Nowozin , Matthew Loper , Peter V. Gehler

State-of-the-art T2I models are capable of generating high-resolution images given textual prompts. However, they still struggle with accurately depicting compositional scenes that specify multiple objects, attributes, and spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yixin Wan , Kai-Wei Chang

Despite recent advancements in text-to-image models, achieving semantically accurate images in text-to-image diffusion models is a persistent challenge. While existing initial latent optimization methods have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Aravindan Sundaram , Ujjayan Pal , Abhimanyu Chauhan , Aishwarya Agarwal , Srikrishna Karanam

Text-to-image models produce images that align well with natural language prompts, but compositional generation has long been a central challenge. Models often struggle to satisfy multiple concepts within a single prompt, frequently…

Artificial Intelligence · Computer Science 2026-03-20 Jungmyung Wi , Hyunsoo Kim , Donghyun Kim

Generative models are increasingly powerful, yet users struggle to guide them through prompts. The generative process is difficult to control and unpredictable, and user instructions may be ambiguous or under-specified. Prior prompt…

Human-Computer Interaction · Computer Science 2026-02-16 Zhipeng Li , Yi-Chi Liao , Christian Holz

Recursive Self-Improvement (RSI) enables intelligence systems to autonomously refine their capabilities. This paper explores the application of RSI in text-to-image diffusion models, addressing the challenge of training collapse caused by…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xulu Zhang , Xiaoyong Wei , Jinlin Wu , Jiaxin Wu , Zhaoxiang Zhang , Zhen Lei , Qing Li

The unified autoregressive (AR) model excels at multimodal understanding and generation. However, its full potential in the domain of customized image generation has yet to be fully realized. Existing customization approaches for unified AR…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fangtai Wu , Mushui Liu , Weijie He , Zhao Wang , Yunlong Yu

Recent studies have demonstrated the efficacy of using Reinforcement Learning (RL) in building reasoning models that articulate chains of thoughts prior to producing final answers. However, despite ongoing advances that aim at enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yue Fan , Xuehai He , Diji Yang , Kaizhi Zheng , Ching-Chen Kuo , Yuting Zheng , Sravana Jyothi Narayanaraju , Xinze Guan , Xin Eric Wang

Controllable image generation has always been one of the core demands in image generation, aiming to create images that are both creative and logical while satisfying additional specified conditions. In the post-AIGC era, controllable…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Guandong Li

The Transformer architecture excels in a variety of language modeling tasks, outperforming traditional neural architectures such as RNN and LSTM. This is partially due to its elimination of recurrent connections, which allows for parallel…

Computation and Language · Computer Science 2024-09-24 Xiang Zhang , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan