English
Related papers

Related papers: SCOTT: Self-Consistent Chain-of-Thought Distillati…

200 papers

Enhancing small language models for real-life application deployment is a significant challenge facing the research community. Due to the difficulties and costs of using large language models, researchers are seeking ways to effectively…

Computation and Language · Computer Science 2024-09-20 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

Chain-of-Thought (CoT) is a critical technique in enhancing the reasoning ability of Large Language Models (LLMs), and latent reasoning methods have been proposed to accelerate the inefficient token-level reasoning chain. We notice that…

Computation and Language · Computer Science 2026-02-05 Fangwei Zhu , Zhifang Sui

While large language models (LLMs) have demonstrated exceptional performance in recent natural language processing (NLP) tasks, their deployment poses substantial challenges due to high computational and memory demands in real-world…

Computation and Language · Computer Science 2024-02-27 Chenglin Li , Qianglong Chen , Liangyue Li , Caiyu Wang , Yicheng Li , Zulong Chen , Yin Zhang

Large Language Models (LLMs) demonstrate strong reasoning capabilities for many tasks, often by explicitly decomposing the task via Chain-of-Thought (CoT) reasoning. Recent work on LLM-based translation designs hand-crafted prompts to…

Computation and Language · Computer Science 2025-09-24 Di Wu , Seth Aycock , Christof Monz

Reasoning with a chain-of-thought (CoT) enables Large Language Models (LLMs) to solve complex tasks but incurs significant inference costs due to the generation of long rationales. We propose Thinking States, a method that performs…

Computation and Language · Computer Science 2026-02-10 Ido Amos , Avi Caciularu , Mor Geva , Amir Globerson , Jonathan Herzig , Lior Shani , Idan Szpektor

Chain-of-thought (CoT) significantly enhances the reasoning performance of large language models (LLM). While current theoretical studies often attribute this improvement to increased expressiveness and computational capacity, we argue that…

Machine Learning · Computer Science 2025-03-06 Kaiyue Wen , Huaqing Zhang , Hongzhou Lin , Jingzhao Zhang

This paper investigates an under-explored challenge in large language models (LLMs): chain-of-thought prompting with noisy rationales, which include irrelevant or inaccurate reasoning thoughts within examples used for in-context learning.…

Computation and Language · Computer Science 2024-11-01 Zhanke Zhou , Rong Tao , Jianing Zhu , Yiwen Luo , Zengmao Wang , Bo Han

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

Machine Learning · Computer Science 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

Chain-of-thought (CoT) reasoning has emerged as a powerful technique for improving the problem-solving capabilities of large language models (LLMs), particularly for tasks requiring multi-step reasoning. However, recent studies show that…

Computation and Language · Computer Science 2025-12-30 Hadi Mohammadi , Tamas Kozak , Anastasia Giachanou

Long chains of thought (CoT) from current language models frequently contain logical gaps and unjustified leaps, limiting the gains from additional test-time compute. Improving reasoning quality directly would require process reward models,…

Artificial Intelligence · Computer Science 2026-05-26 Jingchu Gai , Guanning Zeng , Christina Baek , Chen Wu , J. Zico Kolter , Andrej Risteski , Aditi Raghunathan

In many practical applications, large language models (LLMs) need to acquire new knowledge not present in their pre-training data. Efficiently leveraging this knowledge usually relies on supervised fine-tuning or retrieval-augmented…

Computation and Language · Computer Science 2025-08-08 Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

Machine Learning · Computer Science 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

Large Language Models (LLMs) exhibit strong mathematical reasoning when trained on high-quality Chain-of-Thought (CoT) that articulates intermediate steps, yet costly CoT curation hinders further progress. While existing remedies such as…

Artificial Intelligence · Computer Science 2026-04-17 Zhuo Wang , Zhuo Zhang , Yafu Li , Yu Cheng , Lizhen Qu , Zenglin Xu

Chain-of-Thought (CoT) prompting has been widely recognized for its ability to enhance reasoning capabilities in large language models (LLMs). However, our study reveals a surprising contradiction to this prevailing perspective within the…

Computation and Language · Computer Science 2025-11-04 Tianshi Zheng , Yixiang Chen , Chengxi Li , Chunyang Li , Qing Zong , Haochen Shi , Baixuan Xu , Yangqiu Song , Ginny Y. Wong , Simon See

Chain-of-thought reasoning, while powerful, can produce unnecessarily verbose output for simpler problems. We present a framework for difficulty-aware reasoning that teaches models to dynamically adjust reasoning depth based on problem…

Computation and Language · Computer Science 2025-09-08 Abdul Waheed , Chancharik Mitra , Laurie Z. Wang , Deva Ramanan , Bhiksha Raj

Chain of Thought (CoT) reasoning enhances language models' performance but often leads to inefficient "overthinking" on simple problems. We identify that existing approaches directly penalizing reasoning length fail to account for varying…

Computation and Language · Computer Science 2025-05-22 Junjie Yang , Ke Lin , Xing Yu

Distilling reasoning paths from teacher to student models via supervised fine-tuning (SFT) provides a shortcut for improving the reasoning ability of smaller Large Language Models (LLMs). However, the reasoning paths generated by teacher…

Computation and Language · Computer Science 2026-02-03 Shicheng Xu , Liang Pang , Yunchang Zhu , Jia Gu , Zihao Wei , Jingcheng Deng , Feiyang Pan , Huawei Shen , Xueqi Cheng

Large reasoning models achieve strong performance on complex tasks through long chain-of-thought (CoT) trajectories, but directly transferring such reasoning processes to smaller models remains challenging. A key difficulty is that not all…

Computation and Language · Computer Science 2026-04-06 Chaoqun He , Yingfa Chen , Chaojun Xiao , Xu Han , Lijie Wen

Chain-of-Thought (CoT) reasoning has significantly advanced state-of-the-art AI capabilities. However, recent studies have shown that CoT reasoning is not always faithful when models face an explicit bias in their prompts, i.e., the CoT can…

Artificial Intelligence · Computer Science 2025-06-18 Iván Arcuschin , Jett Janiak , Robert Krzyzanowski , Senthooran Rajamanoharan , Neel Nanda , Arthur Conmy

Knowledge distillation has proven effective for model compression by transferring knowledge from a larger network called the teacher to a smaller network called the student. Current knowledge distillation in time series is predominantly…

Machine Learning · Computer Science 2026-01-12 Nilushika Udayangani Hewa Dehigahawattage , Kishor Nandakishor , Marimuthu Palaniswami