English
Related papers

Related papers: Graph Elicitation for Guiding Multi-Step Reasoning…

200 papers

While Chain-of-Thought (CoT) prompting advances LLM reasoning, challenges persist in consistency, accuracy, and self-correction, especially for complex or ethically sensitive tasks. Existing single-dimensional reflection methods offer…

Computation and Language · Computer Science 2026-01-13 Mariana Costa , Alberlucia Rafael Soarez , Daniel Kim , Camila Ferreira

Chain-of-Thought (CoT) prompting has emerged as a powerful approach to enhancing the reasoning capabilities of Large Language Models (LLMs). However, existing implementations, such as in-context learning and fine-tuning, remain costly and…

Computation and Language · Computer Science 2025-10-02 Li Li , Ziyi Wang , Yongliang Wu , Jianfei Cai , Xu Yang

Chain-of-thought (CoT) traces have been shown to improve performance of large language models on a plethora of reasoning tasks, yet there is no consensus on the mechanism by which this boost is achieved. To shed more light on this, we…

Computation and Language · Computer Science 2026-01-21 Soumadeep Saha , Akshay Chaturvedi , Saptarshi Saha , Utpal Garain , Nicholas Asher

Graph combinatorial optimization (GCO) problems are central to domains like logistics and bioinformatics. While traditional solvers dominate, large language models (LLMs) offer new possibilities for structured reasoning, yet struggle with…

Machine Learning · Computer Science 2025-06-13 Zixiao Huang , Lifeng Guo , Wenhao Li , Junjie Sheng , Chuyun Shen , Haosheng Chen , Bo Jin , Changhong Lu , Xiangfeng Wang

Large Language Models (LLMs) have shown remarkable performance in various emotion recognition tasks, thereby piquing the research community's curiosity for exploring their potential in emotional intelligence. However, several issues in the…

Computation and Language · Computer Science 2024-08-08 Zaijing Li , Gongwei Chen , Rui Shao , Yuquan Xie , Dongmei Jiang , Liqiang Nie

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Large Language Models (LLMs) excel at intuitive, implicit reasoning. Guiding LLMs to construct thought chains can enhance their deliberate reasoning abilities, but also faces challenges such as hallucination. Knowledge Graphs (KGs) can…

Computation and Language · Computer Science 2025-03-07 Guangyi Liu , Yongqi Zhang , Yong Li , Quanming Yao

Chain-of-Thought (CoT) has been a widely adopted prompting method, eliciting impressive reasoning abilities of Large Language Models (LLMs). Inspired by the sequential thought structure of CoT, a number of Chain-of-X (CoX) methods have been…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Rui Wang , Xu Liu , Mingyan Li , Tong Yu , Xiang Chen , Julian McAuley , Shuai Li

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

To improve the ability of the large language model (LLMs) to tackle complex reasoning problems, chain-of-thoughts (CoT) methods were proposed to guide LLMs to reason step-by-step, enabling problem solving from simple to complex.…

Machine Learning · Computer Science 2024-06-27 Zhen-Yu Zhang , Siwei Han , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Large Language Models (LLMs) have achieved significant success in open-domain question answering. However, they continue to face challenges such as hallucinations and knowledge cutoffs. These issues can be mitigated through in-context…

Computation and Language · Computer Science 2025-02-19 Zukang Yang , Zixuan Zhu , Xuan Zhu

Reasoning over structured graphs remains a fundamental challenge for Large Language Models (LLMs), particularly when scaling to large graphs. Existing approaches typically follow the retrieval-augmented generation (RAG) paradigm: first…

Information Retrieval · Computer Science 2026-03-03 Haoyu Han , Kai Guo , Harry Shomer , Yu Wang , Yucheng Chu , Hang Li , Li Ma , Jiliang Tang

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Large language models (LLMs) have achieved impressive performance on various reasoning tasks. To further improve the performance, we propose MultiTool-CoT, a novel framework that leverages chain-of-thought (CoT) prompting to incorporate…

Computation and Language · Computer Science 2023-05-29 Tatsuro Inaba , Hirokazu Kiyomaru , Fei Cheng , Sadao Kurohashi

Large Language Models (LLMs) demonstrate strong reasoning abilities but face limitations such as hallucinations and outdated knowledge. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) addresses these issues by grounding LLM…

Computation and Language · Computer Science 2025-03-04 Mufei Li , Siqi Miao , Pan Li

Chain-of-Thought (CoT) prompting and its variants have gained popularity as effective methods for solving multi-step reasoning problems using pretrained large language models (LLMs). In this work, we analyze CoT prompting from a statistical…

Artificial Intelligence · Computer Science 2024-08-29 Xinyang Hu , Fengzhuo Zhang , Siyu Chen , Zhuoran Yang

Large Language Models (LLMs) demonstrate strong performance on mathematical problems when prompted with Chain-of-Thought (CoT), yet it remains unclear whether this success stems from search, rote procedures, or rule-consistent reasoning. To…

Artificial Intelligence · Computer Science 2026-03-03 Yuanhe Zhang , Ilja Kuzborskij , Jason D. Lee , Chenlei Leng , Fanghui Liu

Recently, Large Language Models (LLMs) have been used for knowledge-based Visual Question Answering (VQA). Despite the encouraging results of previous studies, prior methods prompt LLMs to predict answers directly, neglecting intermediate…

Computation and Language · Computer Science 2025-08-08 Zhongjian Hu , Peng Yang , Bing Li , Fengyuan Liu

Hallucination, where large language models (LLMs) generate confident but incorrect or irrelevant information, remains a key limitation in their application to complex, open-ended tasks. Chain-of-thought (CoT) prompting has emerged as a…

Artificial Intelligence · Computer Science 2025-05-15 Adarsh Kumar , Hwiyoon Kim , Jawahar Sai Nathani , Neil Roy

In the rapidly evolving field of Natural Language Processing, Large Language Models (LLMs) are tasked with increasingly complex reasoning challenges. Traditional methods like chain-of-thought prompting have shown promise but often fall…

Computation and Language · Computer Science 2025-02-14 Daniel Fleischer , Moshe Berchansky , Gad Markovits , Moshe Wasserblat