中文
相关论文

相关论文: MSCoT: Structured Chain-of-Thought Generation for …

200 篇论文

Chain-of-thought (CoT) decoding enables language models to improve reasoning performance at the cost of high generation latency in decoding. Recent proposals have explored variants of contemplation tokens, a term we introduce that refers to…

计算与语言 · 计算机科学 2024-12-18 Jeffrey Cheng , Benjamin Van Durme

Chain-of-Thought (CoT) technique has proven effective in improving the performance of large language models (LLMs) on complex reasoning tasks. However, the performance gains are inconsistent across different tasks, and the underlying…

计算与语言 · 计算机科学 2025-06-09 Peijie Liu , Fengli Xu , Yong Li

Training large language models (LLMs) with chain-of-thought (CoT) supervision has proven effective for enhancing their reasoning abilities. However, obtaining reliable and accurate reasoning supervision remains a significant challenge. We…

计算与语言 · 计算机科学 2025-10-21 Dongwon Jung , Wenxuan Zhou , Muhao Chen

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

计算与语言 · 计算机科学 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Program-of-Thought (PoT), which aims to use programming language instead of natural language as an intermediate step in reasoning, is an important way for LLMs to solve mathematical problems. Since different programming languages excel in…

计算与语言 · 计算机科学 2024-12-18 Nianqi Li , Zujie Liang , Siyu Yuan , Jiaqing Liang , Feng Wei , Yanghua Xiao

Getting language models to reason correctly about code requires training on data where each reasoning step can be checked. Current synthetic Chain-of-Thought (CoT) training data often consists of plausible-sounding explanations generated by…

Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but remains vulnerable to exposure bias and error accumulation, as early mistakes propagate irreversibly through autoregressive…

计算与语言 · 计算机科学 2026-04-21 Shidong Cao , Hongzhan Lin , Yuxuan Gu , Ziyang Luo , Jing Ma

Chain-of-Thought (CoT) is widely applied to enhance the LLM capability in math, coding and reasoning tasks. However, its performance is limited for open-domain tasks, when there are no clearly defined reasoning steps or logical transitions.…

计算与语言 · 计算机科学 2025-11-18 Qingqing Gu , Dan Wang , Yue Zhao , Xiaoyu Wang , Zhonglin Jiang , Yong Chen , Hongyan Li , Luo Ji

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

计算与语言 · 计算机科学 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Chain-of-Thought (CoT) has widely enhanced mathematical reasoning in Large Language Models (LLMs), but it still remains challenging for extending it to multimodal domains. Existing works either adopt a similar textual reasoning for image…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Xinyan Chen , Renrui Zhang , Dongzhi Jiang , Aojun Zhou , Shilin Yan , Weifeng Lin , Hongsheng Li

In the field of chemical engineering, traditional data-processing and prediction methods face significant challenges. Machine-learning and large-language models (LLMs) also have their respective limitations. This paper explores the…

机器学习 · 计算机科学 2025-02-19 Tianhang Zhou , Yingchun Niu , Xingying Lan , Chunming Xu

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

计算与语言 · 计算机科学 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

计算与语言 · 计算机科学 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Large language models (LLMs) can achieve highly effective performance on various reasoning tasks by incorporating step-by-step chain-of-thought (CoT) prompting as demonstrations. However, the reasoning chains of demonstrations generated by…

计算与语言 · 计算机科学 2024-03-18 Jiashuo Sun , Yi Luo , Yeyun Gong , Chen Lin , Yelong Shen , Jian Guo , Nan Duan

Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Hengyu Shi , Junhao Su , Tianyang Han , Junfeng Luo , Jialin Gao

While diffusion models have shown exceptional capabilities in aesthetic image synthesis, they often struggle with complex spatial understanding and reasoning. Existing approaches resort to Multimodal Large Language Models (MLLMs) to enhance…

计算机视觉与模式识别 · 计算机科学 2026-02-13 Wei Chen , Yancheng Long , Mingqiao Liu , Haojie Ding , Yankai Yang , Hongyang Wei , Yi-Fan Zhang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Long Chen

Large language models have been extended to the speech domain, leading to the development of speech large language models (SLLMs). While existing SLLMs demonstrate strong performance in speech instruction-following for core languages (e.g.,…

声音 · 计算机科学 2025-04-30 Hongfei Xue , Yufeng Tang , Hexin Liu , Jun Zhang , Xuelong Geng , Lei Xie

While large reasoning models have shown remarkable ability to generate long chains-of-thought (CoTs) in English, we still lack understanding of how these long-form reasoning abilities transfer to the vast majority of the world's languages.…

计算与语言 · 计算机科学 2026-03-24 Josh Barua , Seun Eisape , Kayo Yin , Alane Suhr

Chain-of-Thought reasoning can enhance large language models, but it requires manually designed prompts to guide the model. Recently proposed CoT-decoding enables the model to generate CoT-style reasoning paths without prompts, but it is…

计算与语言 · 计算机科学 2026-04-09 Guanran Luo , Wentao Qiu , Zhongquan Jian , Meihong Wang , Qingqiang Wu

While Chain-of-Thought (CoT) prompting advances LLM reasoning, challenges persist in consistency, accuracy, and self-correction, especially for complex or ethically sensitive tasks. Existing single-dimensional reflection methods offer…

计算与语言 · 计算机科学 2026-01-13 Mariana Costa , Alberlucia Rafael Soarez , Daniel Kim , Camila Ferreira