English
Related papers

Related papers: GCoT: Chain-of-Thought Prompt Learning for Graphs

200 papers

Recent advances in large language models elicit reasoning in a chain-of-thought that allows models to decompose problems in a human-like fashion. Though this paradigm improves multi-step reasoning ability in language models, it is limited…

Computation and Language · Computer Science 2024-01-24 Daniel Rose , Vaishnavi Himakunthala , Andy Ouyang , Ryan He , Alex Mei , Yujie Lu , Michael Saxon , Chinmay Sonar , Diba Mirza , William Yang Wang

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

Computation and Language · Computer Science 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

The field of natural language processing (NLP) has witnessed significant progress in recent years, with a notable focus on improving large language models' (LLM) performance through innovative prompting techniques. Among these, prompt…

Chain-of-thought (CoT) prompting with large language models has proven effective in numerous natural language processing tasks, but designing prompts that generalize well to diverse problem types can be challenging, especially in the…

Computation and Language · Computer Science 2023-06-12 Zhanming Jie , Wei Lu

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in interpreting images using natural language. However, without using large-scale datasets for retraining, these models are difficult to adapt to specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jiaer Xia , Bingkui Tong , Yuhang Zang , Rui Shao , Kaiyang Zhou

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Large language models (LLMs) possess vast semantic knowledge but often struggle with complex reasoning tasks, particularly in relational reasoning problems such as kinship or spatial reasoning. In this paper, we present Path-of-Thoughts…

Computation and Language · Computer Science 2026-03-25 Ge Zhang , Mohammad Ali Alomrani , Hongjian Gu , Jiaming Zhou , Yaochen Hu , Bin Wang , Qun Liu , Mark Coates , Yingxue Zhang , Jianye Hao

Chain-of-thought (CoT) supervision can substantially improve transformer performance, yet the mechanisms by which models learn to follow and benefit from CoT remain poorly understood. We investigate these learning dynamics through the lens…

Machine Learning · Computer Science 2025-10-31 Zihan Pengmei , Costas Mavromatis , Zhengyuan Shen , Yunyi Zhang , Vassilis N. Ioannidis , Huzefa Rangwala

Chain-of-thought (CoT) has emerged as a powerful technique to elicit reasoning in large language models and improve a variety of downstream tasks. CoT mainly demonstrates excellent performance in English, but its usage in low-resource…

Computation and Language · Computer Science 2024-01-17 Linzheng Chai , Jian Yang , Tao Sun , Hongcheng Guo , Jiaheng Liu , Bing Wang , Xiannian Liang , Jiaqi Bai , Tongliang Li , Qiyao Peng , Zhoujun Li

Large Language Models (LLMs) excel at multi-step reasoning, yet increasing the structural complexity of inference does not consistently improve system-level returns. Methods such as Tree of Thoughts (ToT), Graph of Thoughts (GoT), and…

Computation and Language · Computer Science 2026-03-09 Yuhang Liu , Ruijie Wang , Yunlong Chu , Bing Hao , Yumeng Lin , Shengzhong Liu , Minglai Shao

This report examines the effectiveness of Chain-of-Thought (CoT) prompting in improving the multi-step reasoning abilities of large language models (LLMs). Inspired by previous studies \cite{Min2022RethinkingWork}, we analyze the impact of…

Computation and Language · Computer Science 2023-09-29 Aayush Mishra , Karan Thakkar

Chain-of-Thought (CoT) prompting has proven to be effective in enhancing the reasoning capabilities of Large Language Models (LLMs) with at least 100 billion parameters. However, it is ineffective or even detrimental when applied to…

Computation and Language · Computer Science 2023-10-24 Chengcheng Han , Xiaowei Du , Che Zhang , Yixin Lian , Xiang Li , Ming Gao , Baoyuan Wang

Chain-of-Thought (CoT) holds a significant place in augmenting the reasoning performance for large language models (LLMs). While some studies focus on improving CoT accuracy through methods like retrieval enhancement, yet a rigorous…

Computation and Language · Computer Science 2024-06-19 Lijie Hu , Liang Liu , Shu Yang , Xin Chen , Hongru Xiao , Mengdi Li , Pan Zhou , Muhammad Asif Ali , Di Wang

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Chain-of-thought (CoT) decoding enables language models to improve reasoning performance at the cost of high generation latency in decoding. Recent proposals have explored variants of contemplation tokens, a term we introduce that refers to…

Computation and Language · Computer Science 2024-12-18 Jeffrey Cheng , Benjamin Van Durme

Due to the proliferation of short-form content and the rapid adoption of AI, opportunities for deep, reflective thinking have significantly diminished, undermining users' critical thinking and reducing engagement with the reasoning behind…

Computation and Language · Computer Science 2025-04-28 Seunghyun Yoo

Reasoning ability is one of the most crucial capabilities of a foundation model, signifying its capacity to address complex reasoning tasks. Chain-of-Thought (CoT) technique is widely regarded as one of the effective methods for enhancing…

Computation and Language · Computer Science 2023-08-14 Fanglong Yao , Changyuan Tian , Jintao Liu , Zequn Zhang , Qing Liu , Li Jin , Shuchao Li , Xiaoyu Li , Xian Sun

Chain-of-Thought (CoT) prompting substantially improves the sample efficiency of transformers, reducing the complexity of tasks like parity learning from exponential to polynomial in the input length. However, generating explicit reasoning…

Machine Learning · Computer Science 2026-05-28 Yixiao Huang , Hanlin Zhu , Zixuan Wang , Jiantao Jiao , Stuart Russell , Somayeh Sojoudi , Song Mei

Human conversation is organized by an implicit chain of thoughts that manifests as timed speech acts. Capturing this causal pathway is key to building natural full-duplex interactive systems. We introduce a framework that enables reasoning…

Chain-of-Thought (CoT) prompting has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing implementations, such as in-context learning and fine-tuning, remain costly and…

Computation and Language · Computer Science 2025-10-02 Li Li , Ziyi Wang , Yongliang Wu , Jianfei Cai , Xu Yang