English
Related papers

Related papers: Batch-of-Thought: Cross-Instance Learning for Enha…

200 papers

Reasoning large language models (RLLMs) have recently demonstrated remarkable capabilities through structured and multi-step reasoning. While prior research has primarily focused on improving their training and inference strategies, their…

Computation and Language · Computer Science 2025-10-14 Haotian Wu , Bo Xu , Yao Shu , Menglin Yang , Chengwei Qin

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time…

Computation and Language · Computer Science 2026-03-24 Vinay Sharma , Manish Jain

Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting, which elicits step-by-step problem solving, but often at the cost of excessive verbosity in intermediate…

Computation and Language · Computer Science 2025-10-27 Simon A. Aytes , Jinheon Baek , Sung Ju Hwang

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped…

Computation and Language · Computer Science 2025-02-13 Qifan Yu , Zhenyu He , Sijie Li , Xun Zhou , Jun Zhang , Jingjing Xu , Di He

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

Machine Learning · Computer Science 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

Chain-of-Thought (CoT) prompting has proven highly effective for enhancing complex reasoning in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs). Yet, it struggles in complex spatial reasoning tasks. Nonetheless,…

Computation and Language · Computer Science 2025-01-14 Chengzu Li , Wenshan Wu , Huanyu Zhang , Yan Xia , Shaoguang Mao , Li Dong , Ivan Vulić , Furu Wei

Large Reasoning Models (LRMs) achieve strong performance through explicit chain-of-thought reasoning but suffer from \textit{overthinking}: generating excessive reasoning tokens even for trivial queries. {Beyond inflating cost, overthinking…

Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), especially when combined with reinforcement learning (RL) based post-training methods. While longer reasoning traces can improve…

Machine Learning · Computer Science 2026-02-16 Qinhang Wu , Sen Lin , Ming Zhang , Yingbin Liang , Ness B. Shroff

Chain-of-thought and more broadly test-time compute are known to augment the expressive capabilities of language models and have led to major innovations in reasoning. Motivated by this success, this paper explores latent chain-of-thought…

Machine Learning · Computer Science 2026-05-20 Carson Dudley , Samet Oymak

Abstract reasoning, the ability to reason from the abstract essence of a problem, serves as a key to generalization in human reasoning. However, eliciting language models to perform reasoning with abstraction remains unexplored. This paper…

Computation and Language · Computer Science 2024-09-27 Ruixin Hong , Hongming Zhang , Xiaoman Pan , Dong Yu , Changshui Zhang

Chain-of-Thought (CoT) reasoning is known to improve Large Language Models both empirically and in terms of theoretical approximation power. However, our understanding of the inner workings and conditions of apparition of CoT capabilities…

Machine Learning · Computer Science 2024-10-29 Vivien Cabannes , Charles Arnal , Wassim Bouaziz , Alice Yang , Francois Charton , Julia Kempe

Using Large Language Models to produce intermediate thoughts, a.k.a. Chain-of-thought (CoT), before providing an answer has been a successful recipe for solving complex language tasks. In robotics, similar embodied CoT strategies,…

Robotics · Computer Science 2026-05-20 Pietro Mazzaglia , Cansu Sancaktar , Markus Peschl , Daniel Dijkman

Research on LLM technologies is rapidly emerging, with most of them employ a 'fast thinking' approach to inference. Most LLMs generate the final result based solely on a single query and LLM's reasoning capabilities. However, with the…

Computation and Language · Computer Science 2025-11-14 Jianfeng Pan , Senyou Deng , Shaomang Huang

Chain-of-thought (CoT) prompting combined with few-shot in-context learning (ICL) has unlocked significant reasoning capabilities in large language models (LLMs). However, ICL with CoT examples is ineffective on novel tasks when the…

Computation and Language · Computer Science 2025-12-08 Vignesh Kothapalli , Ata Fatahibaarzi , Hamed Firooz , Maziar Sanjabi

In the field of chemical engineering, traditional data-processing and prediction methods face significant challenges. Machine-learning and large-language models (LLMs) also have their respective limitations. This paper explores the…

Machine Learning · Computer Science 2025-02-19 Tianhang Zhou , Yingchun Niu , Xingying Lan , Chunming Xu

The rapid expansion of web content has made on-device AI assistants indispensable for helping users manage the increasing complexity of online tasks. The emergent reasoning ability in large language models offer a promising path for…

Computation and Language · Computer Science 2025-02-10 Chenyang Shao , Xinyuan Hu , Yutang Lin , Fengli Xu

Explicit Chain-of-Thought improves the reasoning performance of large language models but often incurs high inference cost due to verbose token-level traces. While recent approaches reduce this overhead via concise prompting or step…

Computation and Language · Computer Science 2026-03-09 Yunlong Chu , Minglai Shao , Yuhang Liu , Bing Hao , Yumeng Lin , Jialu Wang , Ruijie Wang

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Large language models (LLMs), such as o1 from OpenAI, have demonstrated remarkable reasoning capabilities. o1 generates a long chain-of-thought (LongCoT) before answering a question. LongCoT allows LLMs to analyze problems, devise plans,…

Computation and Language · Computer Science 2025-02-07 Bo Pang , Hanze Dong , Jiacheng Xu , Silvio Savarese , Yingbo Zhou , Caiming Xiong