English
Related papers

Related papers: From Scale to Speed: Adaptive Test-Time Scaling fo…

200 papers

The performance of text-to-image diffusion models may be improved at test-time by scaling computation to search for a generated image that maximizes a given reward function. While existing trajectory level exploration methods improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qingtao Yu , Changlin Song , Minghao Sun , Zhengyang Yu , Vinay Kumar Verma , Soumya Roy , Sumit Negi , Hongdong Li , Dylan Campbell

Combining Chain-of-Thought (CoT) with Reinforcement Learning (RL) improves text-to-image (T2I) generation, yet the underlying interaction between CoT's exploration and RL's optimization remains unclear. We present a systematic entropy-based…

Machine Learning · Computer Science 2026-04-06 Han Song , Yucheng Zhou , Jianbing Shen , Yu Cheng

Chain-of-Thought (CoT) reasoning enhances the problem-solving ability of large language models (LLMs) but leads to substantial inference overhead, limiting deployment in resource-constrained settings. This paper investigates efficient CoT…

Artificial Intelligence · Computer Science 2025-12-03 Ziqian Bi , Kaijie Chen , Tianyang Wang , Junfeng Hao , Benji Peng , Xinyuan Song

The predominant approach to advancing text-to-image generation has been training-time scaling, where larger models are trained on more data using greater computational resources. While effective, this approach is computationally expensive,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Shufan Li , Konstantinos Kallidromitis , Akash Gokul , Arsh Koneru , Yusuke Kato , Kazuki Kozuka , Aditya Grover

Significant performance gains in deep learning coupled with the exponential growth of image and video data on the Internet have resulted in the recent emergence of automated image captioning systems. Ensuring scalability of automated image…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Karan Sharma , Arun CS Kumar , Suchendra Bhandarkar

Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecified prompts, leading to suboptimal image-text alignment, aesthetics, and quality. We propose a…

Computation and Language · Computer Science 2025-10-16 Ruibo Chen , Jiacheng Pan , Heng Huang , Zhenheng Yang

Chain-of-Thought (CoT) distillation from Large Language Models (LLMs) often induces "overthinking" in Small Language Models (SLMs), leading to performance degradation and excessive token consumption. In this study, we propose Disciplined…

Computation and Language · Computer Science 2026-02-26 Shunsuke Ubukata

As the marginal cost of scaling computation (data and parameters) during model pre-training continues to increase substantially, test-time scaling (TTS) has emerged as a promising direction for improving generative model performance by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Haoran He , Jiajun Liang , Xintao Wang , Pengfei Wan , Di Zhang , Kun Gai , Ling Pan

Recent advancements in large language models have demonstrated how chain-of-thought (CoT) and reinforcement learning (RL) can improve performance. However, applying such reasoning strategies to the visual generation domain remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Dongzhi Jiang , Ziyu Guo , Renrui Zhang , Zhuofan Zong , Hao Li , Le Zhuo , Shilin Yan , Pheng-Ann Heng , Hongsheng Li

Instructing the model to generate a sequence of intermediate steps, a.k.a., a chain of thought (CoT), is a highly effective method to improve the accuracy of large language models (LLMs) on arithmetics and symbolic reasoning tasks. However,…

Machine Learning · Computer Science 2024-09-24 Zhiyuan Li , Hong Liu , Denny Zhou , Tengyu Ma

Training data is at the core of any successful text-to-image models. The quality and descriptiveness of image text are crucial to a model's performance. Given the noisiness and inconsistency in web-scraped datasets, recent works shifted…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Manuel Brack , Sudeep Katakol , Felix Friedrich , Patrick Schramowski , Hareesh Ravi , Kristian Kersting , Ajinkya Kale

Chain-of-thought (CoT) has emerged as a powerful technique to elicit reasoning in large language models and improve a variety of downstream tasks. CoT mainly demonstrates excellent performance in English, but its usage in low-resource…

Computation and Language · Computer Science 2024-01-17 Linzheng Chai , Jian Yang , Tao Sun , Hongcheng Guo , Jiaheng Liu , Bing Wang , Xiannian Liang , Jiaqi Bai , Tongliang Li , Qiyao Peng , Zhoujun Li

Chain-of-Thought (CoT) prompting is a widely used inference-time technique for improving reasoning, yet its gains are uneven across tasks. We analyze when and why CoT helps by modeling the step-wise reasoning trajectory as a Markov chain.…

Machine Learning · Computer Science 2026-03-03 Zihan Wang , Yijun Dong , Qi Lei

Embodied Chain-of-Thought (ECoT) reasoning enhances vision-language-action (VLA) models by improving performance and interpretability through intermediate reasoning steps. However, its sequential autoregressive token generation introduces…

Robotics · Computer Science 2025-09-23 Zhekai Duan , Yuan Zhang , Shikai Geng , Gaowen Liu , Joschka Boedecker , Chris Xiaoxuan Lu

Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but remains vulnerable to exposure bias and error accumulation, as early mistakes propagate irreversibly through autoregressive…

Computation and Language · Computer Science 2026-04-21 Shidong Cao , Hongzhan Lin , Yuxuan Gu , Ziyang Luo , Jing Ma

With the great success of text-conditioned diffusion models in creative text-to-image generation, various text-driven image editing approaches have attracted the attentions of many researchers. However, previous works mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhiyuan Ma , Guoli Jia , Bowen Zhou

Chain-of-Thought (CoT) reasoning improves performance on complex tasks but introduces significant inference latency due to verbosity. We propose Multiround Adaptive Chain-of-Thought Compression (MACC), a framework that leverages the token…

Computation and Language · Computer Science 2025-09-29 Jianzhi Yan , Le Liu , Youcheng Pan , Shiwei Chen , Zike Yuan , Yang Xiang , Buzhou Tang

Recent multimodal large language models (MLLMs) increasingly rely on visual chain-of-thought to perform region-grounded reasoning over images. However, existing approaches ground regions via either textified coordinates-causing modality…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Kesen Zhao , Beier Zhu , Junbao Zhou , Xingyu Zhu , Zhongqi Yue , Hanwang Zhang

Recent visual autoregressive (AR) models have shown promising capabilities in text-to-image generation, operating in a manner similar to large language models. While test-time computation scaling has brought remarkable success in enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Joonhyung Park , Hyeongwon Jang , Joowon Kim , Eunho Yang

Chain of Thought (CoT) prompting improves the reasoning performance of large language models (LLMs) by encouraging step by step thinking. However, CoT-based methods depend on intermediate reasoning steps, which limits scalability and…

Artificial Intelligence · Computer Science 2025-06-02 Guanghao Li , Wenhao Jiang , Mingfeng Chen , Yan Li , Hao Yu , Shuting Dong , Tao Ren , Ming Tang , Chun Yuan