中文
相关论文

相关论文: C3oT: Generating Shorter Chain-of-Thought without …

200 篇论文

As Large Language Models (LLMs) are increasingly being employed in real-world applications in critical domains such as healthcare, it is important to ensure that the Chain-of-Thought (CoT) reasoning generated by these models faithfully…

计算与语言 · 计算机科学 2024-07-02 Sree Harsha Tanneru , Dan Ley , Chirag Agarwal , Himabindu Lakkaraju

Many language tasks can be modeled as classification problems where a large language model (LLM) is given a prompt and selects one among many possible answers. We show that the classification error in such problems scales as a power law in…

机器学习 · 计算机科学 2026-05-22 Amrut Nadgir , Vijay Balasubramanian , Pratik Chaudhari

Reasoning with a chain-of-thought (CoT) enables Large Language Models (LLMs) to solve complex tasks but incurs significant inference costs due to the generation of long rationales. We propose Thinking States, a method that performs…

计算与语言 · 计算机科学 2026-02-10 Ido Amos , Avi Caciularu , Mor Geva , Amir Globerson , Jonathan Herzig , Lior Shani , Idan Szpektor

Chain-of-Thought (CoT) reasoning improves performance on complex tasks but introduces significant inference latency due to verbosity. We propose Multiround Adaptive Chain-of-Thought Compression (MACC), a framework that leverages the token…

计算与语言 · 计算机科学 2025-09-29 Jianzhi Yan , Le Liu , Youcheng Pan , Shiwei Chen , Zike Yuan , Yang Xiang , Buzhou Tang

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

信息检索 · 计算机科学 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Current research found the issue of Early Answering in large language models (LLMs), where the models already have an answer before generating the Chain-of-Thought (CoT). This phenomenon suggests a potential lack of necessary dependency…

计算与语言 · 计算机科学 2025-03-18 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Yufei Wang , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Chain-of-Thought (CoT), a step-wise and coherent reasoning chain, shows its impressive strength when used as a prompting strategy for large language models (LLM). Recent years, the prominent effect of CoT prompting has attracted emerging…

计算与语言 · 计算机科学 2023-10-10 Zihan Yu , Liang He , Zhen Wu , Xinyu Dai , Jiajun Chen

Mathematical reasoning remains a significant challenge for large language models (LLMs), despite progress in prompting techniques such as Chain-of-Thought (CoT). We present **Chain of Mathematically Annotated Thought (CoMAT)**, which…

人工智能 · 计算机科学 2026-01-16 Joshua Ong Jun Leang , Aryo Pradipta Gema , Shay B. Cohen

Chain-of-Thought (CoT) reasoning has been demonstrated as an effective technique for improving the problem-solving capabilities of large language models (LLMs) in the context of code generation. However, existing CoT methods often exhibit a…

软件工程 · 计算机科学 2025-03-20 Yuqi Zhu , Ge Li , Xue Jiang , Jia Li , Hong Mei , Zhi Jin , Yihong Dong

Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs -- the Transformer -- has inherent…

计算与语言 · 计算机科学 2024-10-21 Xiang Zhang , Dujian Ding

Chain-of-thought (CoT) prompting has been widely adopted to enhance the reasoning capabilities of large language models (LLMs). However, the effectiveness of CoT reasoning is inconsistent across tasks with different reasoning types. This…

机器学习 · 计算机科学 2025-06-17 Yue Wan , Xiaowei Jia , Xiang Lorraine Li

Chain-of-thought (CoT) reasoning enables large language models (LLMs) to break down complex problems into interpretable intermediate steps, significantly enhancing model transparency and performance in reasoning tasks. However, conventional…

机器学习 · 计算机科学 2026-01-30 Junda Wu , Yuxin Xiong , Xintong Li , Sheldon Yu , Zhengmian Hu , Tong Yu , Rui Wang , Xiang Chen , Jingbo Shang , Julian McAuley

Chain-of-Thought (CoT) is an efficient prompting method that enables the reasoning ability of large language models by augmenting the query using multiple examples with multiple intermediate steps. Despite the empirical success, the…

机器学习 · 计算机科学 2025-05-27 Hongkang Li , Songtao Lu , Pin-Yu Chen , Xiaodong Cui , Meng Wang

Chain-of-Thought (CoT) has been a widely adopted prompting method, eliciting impressive reasoning abilities of Large Language Models (LLMs). Inspired by the sequential thought structure of CoT, a number of Chain-of-X (CoX) methods have been…

计算与语言 · 计算机科学 2025-02-07 Yu Xia , Rui Wang , Xu Liu , Mingyan Li , Tong Yu , Xiang Chen , Julian McAuley , Shuai Li

Recent advances in large language models (LLMs) have opened new possibilities for automated reasoning and decision-making in wireless networks. However, applying LLMs to wireless communications presents challenges such as limited capability…

网络与互联网体系结构 · 计算机科学 2025-05-29 Xudong Wang , Jian Zhu , Ruichen Zhang , Lei Feng , Dusit Niyato , Jiacheng Wang , Hongyang Du , Shiwen Mao , Zhu Han

Recent years have witnessed significant progress in large language models' (LLMs) reasoning, which is largely due to the chain-of-thought (CoT) approaches, allowing models to generate intermediate reasoning steps before reaching the final…

计算与语言 · 计算机科学 2025-04-15 Zuoli Tang , Junjie Ou , Kaiqin Hu , Chunwei Wu , Zhaoxin Huan , Chilin Fu , Xiaolu Zhang , Jun Zhou , Chenliang Li

Reasoning Large Language Models (RLLMs) have demonstrated impressive performance on complex tasks, largely due to the adoption of Long Chain-of-Thought (Long CoT) reasoning. However, they often exhibit overthinking -- performing unnecessary…

计算与语言 · 计算机科学 2025-05-30 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Dacheng Tao

Objective: To improve the efficiency of medical question answering (MedQA) with large language models (LLMs) by avoiding unnecessary reasoning while maintaining accuracy. Methods: We propose Selective Chain-of-Thought (Selective CoT), an…

计算与语言 · 计算机科学 2026-02-24 Zaifu Zhan , Min Zeng , Shuang Zhou , Yiran Song , Xiaoyi Chen , Yu Hou , Yifan Wu , Yang Ruan , Rui Zhang

Reasoning models have demonstrated remarkable progress in solving complex and logic-intensive tasks by generating extended Chain-of-Thoughts (CoTs) prior to arriving at a final answer. Yet, the emergence of this "slow-thinking" paradigm,…

计算与语言 · 计算机科学 2025-09-30 Sicheng Feng , Gongfan Fang , Xinyin Ma , Xinchao Wang

Compressing long chains of thought (CoT) into compact latent tokens is crucial for efficient reasoning with large language models (LLMs). Recent studies employ autoencoders to achieve this by reconstructing textual CoT from latent tokens,…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Xiaoshu Chen , Sihang Zhou , Ke Liang , Taichun Zhou , Xinwang Liu