English
Related papers

Related papers: Improving Chain-of-Thought Efficiency for Autoregr…

200 papers

Embodied Chain-of-Thought (ECoT) reasoning enhances vision-language-action (VLA) models by improving performance and interpretability through intermediate reasoning steps. However, its sequential autoregressive token generation introduces…

Robotics · Computer Science 2025-09-23 Zhekai Duan , Yuan Zhang , Shikai Geng , Gaowen Liu , Joschka Boedecker , Chris Xiaoxuan Lu

Chain-of-thought (CoT) reasoning and its variants have substantially improved the performance of language models on complex reasoning tasks, yet the precise mechanisms by which different strategies facilitate generalization remain poorly…

Computation and Language · Computer Science 2026-02-11 Archiki Prasad , Mandar Joshi , Kenton Lee , Mohit Bansal , Peter Shaw

Chain-of-Thought (CoT) reasoning enhances Large Language Models (LLMs) by prompting intermediate steps, improving accuracy and robustness in arithmetic, logic, and commonsense tasks. However, this benefit comes with high computational…

Software Engineering · Computer Science 2026-03-11 Kerui Huang , Shuhan Liu , Xing Hu , Tongtong Xu , Lingfeng Bao , Xin Xia

Text-to-image (T2I) generation aims to synthesize images from textual prompts, which jointly specify what must be shown and imply what can be inferred, which thus correspond to two core capabilities: \textbf{\textit{composition}} and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ouxiang Li , Yuan Wang , Xinting Hu , Huijuan Huang , Rui Chen , Jiarong Ou , Xin Tao , Pengfei Wan , Xiaojuan Qi , Fuli Feng

While generative retrieval (GR) demonstrates competitive performance on standard retrieval benchmarks, existing approaches directly map queries to document identifiers (docids) without intermediate deliberation, limiting their effectiveness…

Information Retrieval · Computer Science 2026-05-22 Wenhao Zhang , Ruihao Yu , Yi Bai , Zhumin Chen , Pengjie Ren

Long chains of thought (Long CoTs) are widely employed in multimodal reasoning models to tackle complex tasks by capturing detailed visual information. However, these Long CoTs are often excessively lengthy and contain redundant reasoning…

Artificial Intelligence · Computer Science 2026-02-11 Yizhi Wang , Linan Yue , Min-Ling Zhang

Long chains of thought (CoT) from current language models frequently contain logical gaps and unjustified leaps, limiting the gains from additional test-time compute. Improving reasoning quality directly would require process reward models,…

Artificial Intelligence · Computer Science 2026-05-26 Jingchu Gai , Guanning Zeng , Christina Baek , Chen Wu , J. Zico Kolter , Andrej Risteski , Aditi Raghunathan

Chain-of-Thought (CoT) technique has proven effective in improving the performance of large language models (LLMs) on complex reasoning tasks. However, the performance gains are inconsistent across different tasks, and the underlying…

Computation and Language · Computer Science 2025-06-09 Peijie Liu , Fengli Xu , Yong Li

Text-to-image generation has advanced rapidly, yet aligning complex textual prompts with generated visuals remains challenging, especially with intricate object relationships and fine-grained details. This paper introduces Fast Prompt…

Computation and Language · Computer Science 2024-12-12 Khalil Mrini , Hanlin Lu , Linjie Yang , Weilin Huang , Heng Wang

Chain-of-thought (CoT) has emerged as a powerful technique to elicit reasoning in large language models and improve a variety of downstream tasks. CoT mainly demonstrates excellent performance in English, but its usage in low-resource…

Computation and Language · Computer Science 2024-01-17 Linzheng Chai , Jian Yang , Tao Sun , Hongcheng Guo , Jiaheng Liu , Bing Wang , Xiannian Liang , Jiaqi Bai , Tongliang Li , Qiyao Peng , Zhoujun Li

Chain-of-thought (CoT) prompting with large language models has proven effective in numerous natural language processing tasks, but designing prompts that generalize well to diverse problem types can be challenging, especially in the…

Computation and Language · Computer Science 2023-06-12 Zhanming Jie , Wei Lu

Existing image editing methods struggle to perceive where to edit, especially under complex scenes and nuanced spatial instructions. To address this issue, we propose Generative Visual Chain-of-Thought (GVCoT), a unified framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zijin Yin , Tiankai Hang , Yiji Cheng , Shiyi Zhang , Runze He , Yu Xu , Chunyu Wang , Bing Li , Zheng Chang , Kongming Liang , Qinglin Lu , Zhanyu Ma

Visual generation models have made remarkable progress in creating realistic images from text prompts, yet struggle with complex prompts that specify multiple objects with precise spatial relationships and attributes. Effective handling of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chengqi Duan , Rongyao Fang , Yuqing Wang , Kun Wang , Linjiang Huang , Xingyu Zeng , Hongsheng Li , Xihui Liu

Chain-of-thought (CoT) prompting, which offers step-by-step problem-solving rationales, has impressively unlocked the reasoning potential of large language models (LLMs). Yet, the standard CoT is less effective in problems demanding…

Computation and Language · Computer Science 2024-05-09 Song Jiang , Zahra Shakeri , Aaron Chan , Maziar Sanjabi , Hamed Firooz , Yinglong Xia , Bugra Akyildiz , Yizhou Sun , Jinchao Li , Qifan Wang , Asli Celikyilmaz

Chain-of-thought (CoT) improves reasoning reliability but increases token cost, motivating post-training compression of explicit reasoning traces. However, the shortest sufficient reasoning is not universal: it depends on difficulty, model…

Artificial Intelligence · Computer Science 2026-03-10 Ye Tian , Aijun Liu

It is encouraged to see that progress has been made to bridge videos and natural language. However, mainstream video captioning methods suffer from slow inference speed due to the sequential manner of autoregressive decoding, and prefer…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Bang Yang , Yuexian Zou , Fenglin Liu , Can Zhang

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Long chain-of-thought (CoT) reasoning has shown great promise in enhancing the emotion understanding performance of large language models (LLMs). However, current fixed-length CoT methods struggle to balance reasoning depth and efficiency.…

Computation and Language · Computer Science 2025-08-07 Changhao Song , Yazhou Zhang , Hui Gao , Kaiyun Huang , Peng Zhang

Large language models (LLMs) solve problems more accurately and interpretably when instructed to work out the answer step by step using a ``chain-of-thought'' (CoT) prompt. One can also improve LLMs' performance on a specific task by…

Long chain-of-thought (CoT) prompting helps Large Language Models (LLMs) solve difficult problems, but very long traces often slow or even degrade performance on fast, intuitive "System-1" tasks. We introduce Connector-Aware Compact CoT…

Artificial Intelligence · Computer Science 2025-09-16 Sunguk Choi , Yonghoon Kwon , Heondeuk Lee