English
Related papers

Related papers: PSSD: Making Large Language Models Self-denial via…

200 papers

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

Reasoning is a fundamental capability of large language models (LLMs), enabling them to comprehend, analyze, and solve complex problems. In this paper, we introduce TextGames, an innovative benchmark specifically crafted to assess LLMs…

Computation and Language · Computer Science 2025-02-26 Frederikus Hudi , Genta Indra Winata , Ruochen Zhang , Alham Fikri Aji

Large language models (LLMs) have demonstrated remarkable performance across a wide array of NLP tasks. However, their efficacy is undermined by undesired and inconsistent behaviors, including hallucination, unfaithful reasoning, and toxic…

Computation and Language · Computer Science 2023-08-31 Liangming Pan , Michael Saxon , Wenda Xu , Deepak Nathani , Xinyi Wang , William Yang Wang

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

Computation and Language · Computer Science 2024-08-07 Philipp Mondorf , Barbara Plank

Role-playing has emerged as an effective technique for enhancing the reasoning capabilities of large language models (LLMs). However, existing methods primarily rely on prompt engineering, which often lacks stability and interpretability.…

Computation and Language · Computer Science 2025-09-30 Anyi Wang , Dong Shu , Yifan Wang , Yunpu Ma , Mengnan Du

Inference-time scaling has attracted much attention which significantly enhance the performance of Large Language Models (LLMs) in complex reasoning tasks by increasing the length of Chain-of-Thought. These longer intermediate reasoning…

Computation and Language · Computer Science 2025-05-21 Hongru Wang , Deng Cai , Wanjun Zhong , Shijue Huang , Jeff Z. Pan , Zeming Liu , Kam-Fai Wong

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in natural language understanding and generation. While these models excel in general complex reasoning tasks, they still face challenges in…

Artificial Intelligence · Computer Science 2024-10-25 Graziano A. Manduzio , Federico A. Galatolo , Mario G. C. A. Cimino , Enzo Pasquale Scilingo , Lorenzo Cominelli

Language Models (LMs) have demonstrated impressive capabilities in solving complex reasoning tasks, particularly when prompted to generate intermediate explanations. However, it remains an open question whether these intermediate reasoning…

Computation and Language · Computer Science 2025-02-25 Moritz Miller , Kumar Shridhar

Human reasoning involves different strategies, each suited to specific problems. Prior work shows that large language model (LLMs) tend to favor a single reasoning strategy, potentially limiting their effectiveness in diverse reasoning…

Computation and Language · Computer Science 2025-07-17 Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Thierry Charnois

Pre-trained large language models (LMs) struggle to perform logical reasoning reliably despite advances in scale and compositionality. In this work, we tackle this challenge through the lens of symbolic programming. We propose DSR-LM, a…

Artificial Intelligence · Computer Science 2023-05-09 Hanlin Zhang , Jiani Huang , Ziyang Li , Mayur Naik , Eric Xing

Self-detection for Large Language Models (LLMs) seeks to evaluate the trustworthiness of the LLM's output by leveraging its own capabilities, thereby alleviating the issue of output hallucination. However, existing self-detection approaches…

Computation and Language · Computer Science 2024-09-30 Moxin Li , Wenjie Wang , Fuli Feng , Fengbin Zhu , Qifan Wang , Tat-Seng Chua

Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for…

Artificial Intelligence · Computer Science 2024-05-24 Xudong Guo , Kaixuan Huang , Jiale Liu , Wenhui Fan , Natalia Vélez , Qingyun Wu , Huazheng Wang , Thomas L. Griffiths , Mengdi Wang

Recent advances in Large Language Models (LLMs) have incorporated planning and reasoning capabilities, enabling models to outline steps before execution and provide transparent reasoning paths. This enhancement has reduced errors in…

Computation and Language · Computer Science 2025-01-31 Sudarshan Kamath Barkur , Sigurd Schacht , Johannes Scholl

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

The reasoning abilities are one of the most enigmatic and captivating aspects of large language models (LLMs). Numerous studies are dedicated to exploring and expanding the boundaries of this reasoning capability. However, tasks that embody…

Artificial Intelligence · Computer Science 2025-02-27 Yuze Zhao , Tianyun Ji , Wenjun Feng , Zhenya Huang , Qi Liu , Zhiding Liu , Yixiao Ma , Kai Zhang , Enhong Chen

The ability to derive underlying principles from a handful of observations and then generalize to novel situations -- known as inductive reasoning -- is central to human intelligence. Prior work suggests that language models (LMs) often…

Computation and Language · Computer Science 2024-05-24 Linlu Qiu , Liwei Jiang , Ximing Lu , Melanie Sclar , Valentina Pyatkin , Chandra Bhagavatula , Bailin Wang , Yoon Kim , Yejin Choi , Nouha Dziri , Xiang Ren

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

Although Large Language Models (LLMs) excel at addressing straightforward reasoning tasks, they frequently struggle with difficulties when confronted by more complex multi-step reasoning due to a range of factors. Firstly, natural language…

Computation and Language · Computer Science 2024-02-22 Kewei Cheng , Nesreen K. Ahmed , Theodore Willke , Yizhou Sun

Previous work has showcased the intriguing capabilities of Large Language Models (LLMs) in instruction-following and rhetorical fluency. However, systematic exploration of their dual capabilities to autonomously persuade and resist…

Computation and Language · Computer Science 2025-06-10 Tianjie Ju , Yujia Chen , Hao Fei , Mong-Li Lee , Wynne Hsu , Pengzhou Cheng , Zongru Wu , Zhuosheng Zhang , Gongshen Liu

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu