English
Related papers

Related papers: Understanding Hidden Computations in Chain-of-Thou…

200 papers

Chain-of-Thought (CoT) reasoning enables Large Language Models (LLMs) to solve complex reasoning tasks by generating intermediate reasoning steps. However, most existing approaches focus on hard token decoding, which constrains reasoning…

Computation and Language · Computer Science 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Tool learning can further broaden the usage scenarios of large language models (LLMs). However most of the existing methods either need to finetune that the model can only use tools seen in the training data, or add tool demonstrations into…

Computation and Language · Computer Science 2025-03-24 Mengsong Wu , Tong Zhu , Han Han , Xiang Zhang , Wenbiao Shao , Wenliang Chen

Large language models (LLMs) excel at complex reasoning but can still exhibit harmful behaviors. Current alignment strategies typically embed safety into model weights, making these controls implicit, static, and difficult to modify. This…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

In recent years, many interpretability methods have been proposed to help interpret the internal states of Transformer-models, at different levels of precision and complexity. Here, to analyze encoder-decoder Transformers, we propose a…

Computation and Language · Computer Science 2024-04-04 Anna Langedijk , Hosein Mohebbi , Gabriele Sarti , Willem Zuidema , Jaap Jumelet

Large language models have manifested remarkable capabilities by leveraging chain-of-thought (CoT) reasoning techniques to solve intricate questions through step-by-step reasoning chains. Despite its success, the efficacy of such reasoning…

Computation and Language · Computer Science 2024-03-29 Yexin Wu , Zhuosheng Zhang , Hai Zhao

Chain-of-Thought (CoT) reasoning enhances the problem-solving ability of large language models (LLMs) but leads to substantial inference overhead, limiting deployment in resource-constrained settings. This paper investigates efficient CoT…

Artificial Intelligence · Computer Science 2025-12-03 Ziqian Bi , Kaijie Chen , Tianyang Wang , Junfeng Hao , Benji Peng , Xinyuan Song

Recent works have shown that chain-of-thought (CoT) prompting can elicit language models to solve complex reasoning tasks, step-by-step. However, prompt-based CoT methods are dependent on very large models such as GPT-3 175B which are…

Computation and Language · Computer Science 2023-06-14 Namgyu Ho , Laura Schmid , Se-Young Yun

Chain-of-Thought (CoT) is a technique that guides Large Language Models (LLMs) to decompose complex tasks into multi-step reasoning through intermediate steps in natural language form. Briefly, CoT enables LLMs to think step by step.…

Computation and Language · Computer Science 2023-10-19 Caoyun Fan , Jidong Tian , Yitian Li , Wenqing Chen , Hao He , Yaohui Jin

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

Machine Learning · Computer Science 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs -- the Transformer -- has inherent…

Computation and Language · Computer Science 2024-10-21 Xiang Zhang , Dujian Ding

Despite their strengths, large language models (LLMs) often fail to communicate their confidence accurately, making it difficult to assess when they might be wrong and limiting their reliability. In this work, we demonstrate that reasoning…

Artificial Intelligence · Computer Science 2025-10-23 Dongkeun Yoon , Seungone Kim , Sohee Yang , Sunkyoung Kim , Soyeon Kim , Yongil Kim , Eunbi Choi , Yireun Kim , Minjoon Seo

When leveraging language models for reasoning tasks, generating explicit chain-of-thought (CoT) steps often proves essential for achieving high accuracy in final outputs. In this paper, we investigate if models can be taught to internalize…

Computation and Language · Computer Science 2024-05-24 Yuntian Deng , Yejin Choi , Stuart Shieber

Recently, with the chain of thought (CoT) prompting, large language models (LLMs), e.g., GPT-3, have shown strong reasoning ability in several natural language processing tasks such as arithmetic, commonsense, and logical reasoning.…

Artificial Intelligence · Computer Science 2023-10-20 Yixuan Weng , Minjun Zhu , Fei Xia , Bin Li , Shizhu He , Shengping Liu , Bin Sun , Kang Liu , Jun Zhao

Large Language Models (LLMs) have demonstrated remarkable performance in many applications, including challenging reasoning problems via chain-of-thoughts (CoTs) techniques that generate ``thinking tokens'' before answering the questions.…

Machine Learning · Computer Science 2025-11-04 Hanlin Zhu , Shibo Hao , Zhiting Hu , Jiantao Jiao , Stuart Russell , Yuandong Tian

Chain-of-thought and more broadly test-time compute are known to augment the expressive capabilities of language models and have led to major innovations in reasoning. Motivated by this success, this paper explores latent chain-of-thought…

Machine Learning · Computer Science 2026-05-20 Carson Dudley , Samet Oymak

To augment language models with the ability to reason, researchers usually prompt or finetune them to produce chain of thought reasoning steps before producing the final answer. However, although people use natural language to reason…

Computation and Language · Computer Science 2023-11-03 Yuntian Deng , Kiran Prasad , Roland Fernandez , Paul Smolensky , Vishrav Chaudhary , Stuart Shieber

Chain-of-Thought (CoT) reasoning enhances Large Language Models (LLMs) by encouraging step-by-step reasoning in natural language. However, leveraging a latent continuous space for reasoning may offer benefits in terms of both efficiency and…

Computation and Language · Computer Science 2025-09-24 Zhenyi Shen , Hanqi Yan , Linhai Zhang , Zhanghao Hu , Yali Du , Yulan He

Chain-of-thought (CoT) reasoning is critical for improving the interpretability and reliability of Large Vision-Language Models (LVLMs). However, existing training algorithms such as SFT, PPO, and GRPO may not generalize well across unseen…

Artificial Intelligence · Computer Science 2025-10-31 Guohao Sun , Hang Hua , Jian Wang , Jiebo Luo , Sohail Dianat , Majid Rabbani , Raghuveer Rao , Zhiqiang Tao

The Transformer architecture excels in a variety of language modeling tasks, outperforming traditional neural architectures such as RNN and LSTM. This is partially due to its elimination of recurrent connections, which allows for parallel…

Computation and Language · Computer Science 2024-09-24 Xiang Zhang , Muhammad Abdul-Mageed , Laks V. S. Lakshmanan

Recent advancements in Chain-of-Thought (CoT) reasoning utilize complex modules but are hampered by high token consumption, limited applicability, and challenges in reproducibility. This paper conducts a critical evaluation of CoT…

Computation and Language · Computer Science 2024-06-12 Mengru Ding , Hanmeng Liu , Zhizhang Fu , Jian Song , Wenbo Xie , Yue Zhang