English
Related papers

Related papers: Can Atomic Step Decomposition Enhance the Self-str…

200 papers

Large language models (LLMs) have shown exceptional performance as general-purpose assistants, excelling across a variety of reasoning tasks. This achievement represents a significant step toward achieving artificial general intelligence…

Artificial Intelligence · Computer Science 2024-08-13 Xiaoyu Tan , Yongxin Deng , Xihe Qiu , Weidi Xu , Chao Qu , Wei Chu , Yinghui Xu , Yuan Qi

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

The reasoning capabilities of large language models (LLMs) have improved substantially through increased test-time computation, typically in the form of intermediate tokens known as chain-of-thought (CoT). However, CoT often becomes…

Computation and Language · Computer Science 2026-01-07 Nathanaël Carraz Rakotonirina , Ren Pang , Neha Anna John , Michael Bohlke-Schneider , Momchil Hardalov

Recent progress in multimodal reasoning has been significantly advanced by textual Chain-of-Thought (CoT), a paradigm where models conduct reasoning within language. This text-centric approach, however, treats vision as a static, initial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zhaochen Su , Peng Xia , Hangyu Guo , Zhenhua Liu , Yan Ma , Xiaoye Qu , Jiaqi Liu , Yanshu Li , Kaide Zeng , Zhengyuan Yang , Linjie Li , Yu Cheng , Heng Ji , Junxian He , Yi R. Fung

Large language models (LLMs) hold promise for automating integrated circuit (IC) engineering using register transfer level (RTL) hardware description languages (HDLs) like Verilog. However, challenges remain in ensuring the quality of…

Hardware Architecture · Computer Science 2025-11-18 Zhiteng Chao , Yonghao Wang , Xinyu Zhang , Jiaxin Zhou , Tenghui Hua , Husheng Han , Tianmeng Yang , Jianan Mu , Bei Yu , Rui Zhang , Jing Ye , Huawei Li

We introduce a structured chain-of-thought (SCoT) prompting approach to generating content-grounded multi-turn question-answer conversations using a pre-trained large language model (LLM). At the core of our proposal is a structured…

Computation and Language · Computer Science 2024-02-21 Md Arafat Sultan , Jatin Ganhotra , Ramón Fernandez Astudillo

Stance detection aims to identify the attitude expressed in a document towards a given target. Techniques such as Chain-of-Thought (CoT) prompting have advanced this task, enhancing a model's reasoning capabilities through the derivation of…

Computation and Language · Computer Science 2023-09-08 Kairui Hu , Ming Yan , Joey Tianyi Zhou , Ivor W. Tsang , Wen Haw Chong , Yong Keong Yap

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu

Recent studies have discovered that Chain-of-Thought prompting (CoT) can dramatically improve the performance of Large Language Models (LLMs), particularly when dealing with complex tasks involving mathematics or reasoning. Despite the…

Machine Learning · Computer Science 2023-12-27 Guhao Feng , Bohang Zhang , Yuntian Gu , Haotian Ye , Di He , Liwei Wang

Chain of thought finetuning (cot-finetuning) aims to endow small language models (SLM) with reasoning ability to improve their performance towards specific tasks by allowing them to imitate the reasoning procedure of large language models…

Computation and Language · Computer Science 2025-08-08 Xiaoshu Chen , Sihang Zhou , Ke Liang , Xinwang Liu

Recent advancements in multimodal large language models (MLLMs) have demonstrated exceptional performance in multimodal perception and understanding. However, leading open-source MLLMs exhibit significant limitations in complex and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Jingjing Jiang , Chao Ma , Xurui Song , Hanwang Zhang , Jun Luo

Small Language Models (SLMs) are becoming increasingly popular in specialized fields, such as industrial applications, due to their efficiency, lower computational requirements, and ability to be fine-tuned for domain-specific tasks,…

Computation and Language · Computer Science 2025-10-22 Shuxin Lin , Dhaval Patel , Christodoulos Constantinides

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

Machine Learning · Computer Science 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

Large Language Models (LLMs) have demonstrated impressive performance in natural language processing tasks by leveraging chain of thought (CoT) that enables step-by-step thinking. Extending LLMs with multimodal capabilities is the recent…

Computation and Language · Computer Science 2024-01-24 Debjyoti Mondal , Suraj Modi , Subhadarshi Panda , Rituraj Singh , Godawari Sudhakar Rao

Large language models (LLMs) solve problems more accurately and interpretably when instructed to work out the answer step by step using a ``chain-of-thought'' (CoT) prompt. One can also improve LLMs' performance on a specific task by…

Prompting schemes such as Chain of Thought, Tree of Thoughts, and Graph of Thoughts can significantly enhance the reasoning capabilities of large language models. However, most existing schemes require users to define static,…

Artificial Intelligence · Computer Science 2026-02-19 Felix Fricke , Simon Malberg , Georg Groh

Chain-of-Thought (CoT) reasoning is a critical capability for large language models (LLMs), enabling them to tackle com- plex multi-step tasks. While base LLMs, pre-trained on general text corpora, often struggle with reasoning due to a…

Computation and Language · Computer Science 2025-11-25 Zijian Wang , Yanxiang Ma , Chang Xu

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

In enhancing the reasoning capabilities of large language models (LLMs), prior research primarily focuses on specific prompting techniques such as few-shot or zero-shot chain-of-thought (CoT) prompting. These methods, while effective, often…

Computation and Language · Computer Science 2024-05-27 Xuezhi Wang , Denny Zhou

The combination of strong visual backbones and Large Language Model (LLM) reasoning has led to Large Multimodal Models (LMMs) becoming the current standard for a wide range of vision and language (VL) tasks. However, recent research has…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chancharik Mitra , Brandon Huang , Trevor Darrell , Roei Herzig