English
Related papers

Related papers: Explore the Reasoning Capability of LLMs in the Ch…

200 papers

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

The latest large language models (LLMs) such as ChatGPT, exhibit strong capabilities in automated mental health analysis. However, existing relevant studies bear several limitations, including inadequate evaluations, lack of prompting…

Computation and Language · Computer Science 2024-10-03 Kailai Yang , Shaoxiong Ji , Tianlin Zhang , Qianqian Xie , Ziyan Kuang , Sophia Ananiadou

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

Computation and Language · Computer Science 2025-06-26 Yubo Dong , Hehe Fan

Large language models (LLMs) have demonstrated considerable reasoning abilities in various tasks such as mathematics and coding. However, recent studies indicate that even the best models lack true comprehension of their reasoning…

Artificial Intelligence · Computer Science 2025-07-08 Pinzheng Wang , Juntao Li , Zecheng Tang , Haijia Gui , Min zhang

We explore how generating a chain of thought -- a series of intermediate reasoning steps -- significantly improves the ability of large language models to perform complex reasoning. In particular, we show how such reasoning abilities emerge…

Computation and Language · Computer Science 2023-01-12 Jason Wei , Xuezhi Wang , Dale Schuurmans , Maarten Bosma , Brian Ichter , Fei Xia , Ed Chi , Quoc Le , Denny Zhou

Large language models (LLMs) have dramatically enhanced the field of language intelligence, as demonstrably evidenced by their formidable empirical performance across a spectrum of complex reasoning tasks. Additionally, theoretical proofs…

Computation and Language · Computer Science 2023-11-21 Zhuosheng Zhang , Yao Yao , Aston Zhang , Xiangru Tang , Xinbei Ma , Zhiwei He , Yiming Wang , Mark Gerstein , Rui Wang , Gongshen Liu , Hai Zhao

Large Language Models (LLMs) have exhibited impressive capabilities across numerous domains, yet they often struggle with complex reasoning and decision-making tasks. Decision-making games, which inherently require multifaceted reasoning…

Machine Learning · Computer Science 2025-03-19 Haolin Wang , Xueyan Li , Yazhe Niu , Shuai Hu , Hongsheng Li

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to solve problems. On the…

Large Language Models (LLMs) have demonstrated strong generalization across a wide range of tasks. Reasoning with LLMs is central to solving multi-step problems and complex decision-making. To support efficient reasoning, recent studies…

Computation and Language · Computer Science 2025-09-03 Jindong Li , Yali Fu , Li Fan , Jiahong Liu , Yao Shu , Chengwei Qin , Menglin Yang , Irwin King , Rex Ying

Large language models are being rapidly deployed across many fields such as healthcare, finance, transportation, and energy, where time-series data are fundamental components. The current works are still limited in their ability to perform…

Artificial Intelligence · Computer Science 2026-01-23 Paul Quinlan , Qingguo Li , Xiaodan Zhu

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Recent advancements in the reasoning skills of Large Language Models (LLMs) demonstrate an increase in the ability of LLMs to solve simple planning tasks. However, as long as the driving force behind improved reasoning capability is the…

Artificial Intelligence · Computer Science 2025-02-03 Andrey Borro , Patricia J Riddle , Michael W Barley , Michael J Witbrock

Recent literature has shown that large language models (LLMs) are generally excellent few-shot reasoners to solve text reasoning tasks. However, the capability of LLMs on table reasoning tasks is yet to be explored. In this paper, we aim at…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen

This paper investigates the rationality of large language models (LLMs) in strategic decision-making contexts, specifically within the framework of game theory. We evaluate several state-of-the-art LLMs across a spectrum of…

Artificial Intelligence · Computer Science 2024-11-13 Wenyue Hua , Ollie Liu , Lingyao Li , Alfonso Amayuelas , Julie Chen , Lucas Jiang , Mingyu Jin , Lizhou Fan , Fei Sun , William Wang , Xintong Wang , Yongfeng Zhang

Recent advances in large language models (LLMs) have demonstrated impressive reasoning capacities that mirror human-like thinking. However, whether LLMs possess genuine fluid intelligence (i.e., the ability to reason abstractly and…

Artificial Intelligence · Computer Science 2025-09-30 Yue Yang , MingKang Chen , Qihua Liu , Mengkang Hu , Qiguang Chen , Gengrui Zhang , Shuyue Hu , Guangtao Zhai , Yu Qiao , Yu Wang , Wenqi Shao , Ping Luo

Deep learning-based expert models have reached superhuman performance in decision-making domains such as chess and Go. However, it is under-explored to explain or comment on given decisions although it is important for model explainability…

Machine Learning · Computer Science 2025-02-11 Jaechang Kim , Jinmin Goh , Inseok Hwang , Jaewoong Cho , Jungseul Ok

Despite their strengths, large language models (LLMs) often fail to communicate their confidence accurately, making it difficult to assess when they might be wrong and limiting their reliability. In this work, we demonstrate that reasoning…

Artificial Intelligence · Computer Science 2025-10-23 Dongkeun Yoon , Seungone Kim , Sohee Yang , Sunkyoung Kim , Soyeon Kim , Yongil Kim , Eunbi Choi , Yireun Kim , Minjoon Seo

Large language models (LLMs) achieve good performance on challenging reasoning benchmarks, yet could also make basic reasoning mistakes. This contrasting behavior is puzzling when it comes to understanding the mechanisms behind LLMs'…

Computation and Language · Computer Science 2025-03-05 Chulin Xie , Yangsibo Huang , Chiyuan Zhang , Da Yu , Xinyun Chen , Bill Yuchen Lin , Bo Li , Badih Ghazi , Ravi Kumar

Large language models (LLMs) are known to perform well on language tasks, but struggle with reasoning tasks. This paper explores the ability of LLMs to play the 2D puzzle game Baba is You, in which players manipulate rules by rearranging…

Artificial Intelligence · Computer Science 2025-06-25 Fien van Wetten , Aske Plaat , Max van Duijn