中文
相关论文

相关论文: GreenMind: A Next-Generation Vietnamese Large Lang…

200 篇论文

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped…

计算与语言 · 计算机科学 2025-02-13 Qifan Yu , Zhenyu He , Sijie Li , Xun Zhou , Jun Zhang , Jingjing Xu , Di He

Answering questions with Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), yet its impact on Large Multimodal Models (LMMs) still lacks a systematic assessment and in-depth…

计算机视觉与模式识别 · 计算机科学 2025-02-14 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanwei Li , Yu Qi , Xinyan Chen , Liuhui Wang , Jianhan Jin , Claire Guo , Shen Yan , Bo Zhang , Chaoyou Fu , Peng Gao , Hongsheng Li

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

计算与语言 · 计算机科学 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

Chain-of-Thought (CoT) distillation from Large Language Models (LLMs) often induces "overthinking" in Small Language Models (SLMs), leading to performance degradation and excessive token consumption. In this study, we propose Disciplined…

计算与语言 · 计算机科学 2026-02-26 Shunsuke Ubukata

Large reasoning language models such as OpenAI-o1 and Deepseek-R1 have recently attracted widespread attention due to their impressive task-solving abilities. However, the enormous model size and the generation of lengthy thought chains…

计算与语言 · 计算机科学 2025-05-27 Jikai Wang , Juntao Li , Jianye Hou , Bowen Yan , Lijun Wu , Min Zhang

Chain-of-thought (CoT) prompting is a de-facto standard technique to elicit reasoning-like responses from large language models (LLMs), allowing them to spell out individual steps before giving a final answer. While the resemblance to…

人工智能 · 计算机科学 2026-02-26 Gregor Bachmann , Yichen Jiang , Seyed Mohsen Moosavi Dezfooli , Moin Nabi

Language models are increasingly being deployed for general problem solving across a wide range of tasks, but are still confined to token-level, left-to-right decision-making processes during inference. This means they can fall short in…

计算与语言 · 计算机科学 2023-12-05 Shunyu Yao , Dian Yu , Jeffrey Zhao , Izhak Shafran , Thomas L. Griffiths , Yuan Cao , Karthik Narasimhan

While the recent Chain-of-Thought (CoT) technique enhances the reasoning ability of large language models (LLMs) with the theory of mind, it might still struggle in handling logical reasoning that relies much on symbolic expressions and…

计算与语言 · 计算机科学 2024-06-12 Jundong Xu , Hao Fei , Liangming Pan , Qian Liu , Mong-Li Lee , Wynne Hsu

Large language models (LLMs) have shown strong performance across natural language reasoning tasks, yet their reasoning processes remain brittle and difficult to interpret. Prompting techniques like Chain-of-Thought (CoT) enhance…

计算与语言 · 计算机科学 2025-08-01 Samir Abdaljalil , Hasan Kurban , Khalid Qaraqe , Erchin Serpedin

Recent advances in large language models have demonstrated that Supervised Fine-Tuning (SFT) with Chain-of-Thought (CoT) reasoning data distilled from large reasoning models (e.g., DeepSeek R1) can effectively transfer reasoning…

计算与语言 · 计算机科学 2025-05-22 Bin Yu , Hang Yuan , Haotian Li , Xueyin Xu , Yuliang Wei , Bailing Wang , Weizhen Qi , Kai Chen

Large language models (LLMs) exhibit strong generative capabilities and have shown great potential in code generation. Existing chain-of-thought (CoT) prompting methods enhance model reasoning by eliciting intermediate steps, but suffer…

人工智能 · 计算机科学 2025-12-17 Shen Li , Li Huang , Shaoxiong Zhan , Weifeng Sun , Tao Yin , Zhongxin Liu , Meng Yan

Large language models (LLMs) have demonstrated remarkable reasoning capabilities when prompted with strategies such as Chain-of-Thought (CoT). However, these approaches focus on token-level output without considering internal weight…

计算与语言 · 计算机科学 2025-04-16 Saif Punjwani , Larry Heck

Large Language Models have demonstrated remarkable abilities across various tasks, with Chain-of-Thought (CoT) prompting emerging as a key technique to enhance reasoning capabilities. However, existing research primarily focuses on…

人工智能 · 计算机科学 2024-10-07 Lijie Hu , Liang Liu , Shu Yang , Xin Chen , Zhen Tan , Muhammad Asif Ali , Mengdi Li , Di Wang

Chain-of-thought (CoT) distillation allows a large language model (LLM) to guide a small language model (SLM) in reasoning tasks. Existing methods train the SLM to learn the long rationale in one iteration, resulting in two issues: 1) Long…

计算与语言 · 计算机科学 2025-05-27 Xiao Chen , Sihang Zhou , Ke Liang , Xiaoyu Sun , Xinwang Liu

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in models such as DeepSeek-R1, significantly enhances this reasoning…

计算与语言 · 计算机科学 2025-07-15 Zihao Li , Xu Wang , Yuzhe Yang , Ziyu Yao , Haoyi Xiong , Mengnan Du

To improve the ability of the large language model (LLMs) to tackle complex reasoning problems, chain-of-thoughts (CoT) methods were proposed to guide LLMs to reason step-by-step, enabling problem solving from simple to complex.…

机器学习 · 计算机科学 2024-06-27 Zhen-Yu Zhang , Siwei Han , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Numerous applications of large language models (LLMs) rely on their ability to perform step-by-step reasoning. However, the reasoning behavior of LLMs remains poorly understood, posing challenges to research, development, and safety. To…

机器学习 · 计算机科学 2026-03-04 Zhanke Zhou , Zhaocheng Zhu , Xuan Li , Mikhail Galkin , Xiao Feng , Sanmi Koyejo , Jian Tang , Bo Han

Current Large Language Model reasoning systems process queries independently, discarding valuable cross-instance signals such as shared reasoning patterns and consistency constraints. We introduce Batch-of-Thought (BoT), a training-free…

人工智能 · 计算机科学 2026-05-12 Xuan Yang , Furong Jia , Roy Xie , Xiong Xi , Hengwei Bian , Jian Li , Monica Agrawal

Recent advances in large language models elicit reasoning in a chain-of-thought that allows models to decompose problems in a human-like fashion. Though this paradigm improves multi-step reasoning ability in language models, it is limited…

Long chain-of-thought~(CoT) has become a dominant paradigm for enhancing the reasoning capability of large reasoning models~(LRMs); however, the performance gains often come with a substantial increase in reasoning budget. Recent studies…

人工智能 · 计算机科学 2026-03-03 Jie Cao , Tianwei Lin , Zhenxuan Fan , Bo Yuan , Ziyuan Zhao , Rolan Yan , Wenqiao Zhang , Siliang Tang