English
Related papers

Related papers: Is Large Language Model Performance on Reasoning T…

200 papers

Large language models have recently demonstrated remarkable abilities to self-correct their responses through iterative refinement, often referred to as self-consistency or self-reflection. However, the dynamics of this self-correction…

Computation and Language · Computer Science 2025-11-13 Hossein A. Rahmani , Satyapriya Krishna , Xi Wang , Mohammadmehdi Naghiaei , Emine Yilmaz

Large language models (LLMs) are capable of writing grammatical text that follows instructions, answers questions, and solves problems. As they have advanced, it has become difficult to distinguish their output from human-written text.…

Computation and Language · Computer Science 2025-08-25 Alex Reinhart , Ben Markey , Michael Laudenbach , Kachatad Pantusen , Ronald Yurko , Gordon Weinberg , David West Brown

Large language models (LLMs) have revolutionized many areas (e.g. natural language processing, software engineering, etc.) by achieving state-of-the-art performance on extensive downstream tasks. Aiming to achieve robust and general…

Artificial Intelligence · Computer Science 2024-01-18 Zhiming Li , Yushi Cao , Xiufeng Xu , Junzhe Jiang , Xu Liu , Yon Shin Teo , Shang-wei Lin , Yang Liu

Large language models (LLMs) often achieve strong performance on reasoning benchmarks, but final-answer accuracy alone does not show whether they faithfully execute the procedure specified in a prompt. We introduce a controlled diagnostic…

Computation and Language · Computer Science 2026-05-26 Sailesh Panda , Pritam Kadasi , Abhishek Upperwal , Mayank Singh

Large language models (LLMs) are widely used in decision-making, but their reliability, especially in critical tasks like healthcare, is not well-established. Therefore, understanding how LLMs reason and make decisions is crucial for their…

Machine Learning · Computer Science 2025-02-25 Ze Yu Zhang , Arun Verma , Finale Doshi-Velez , Bryan Kian Hsiang Low

Using Large Language Models (LLMs) for Process Mining (PM) tasks is becoming increasingly essential, and initial approaches yield promising results. However, little attention has been given to developing strategies for evaluating and…

Databases · Computer Science 2024-07-01 Alessandro Berti , Humam Kourani , Hannes Hafke , Chiao-Yun Li , Daniel Schuster

Large language models (LLMs) have been found to produce hallucinations when the question exceeds their internal knowledge boundaries. A reliable model should have a clear perception of its knowledge boundaries, providing correct answers…

Computation and Language · Computer Science 2024-08-20 Shiyu Ni , Keping Bi , Lulu Yu , Jiafeng Guo

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

Large Language Models (LLMs) still struggle with complex logical reasoning. While previous works achieve remarkable improvements, their performance is highly dependent on the correctness of translating natural language (NL) problems into a…

Artificial Intelligence · Computer Science 2025-10-14 Xiangyu Wang , Haocheng Yang , Fengxiang Cheng , Fenrong Liu

Reasoning is a key ability for an intelligent system. Large language models (LMs) achieve above-chance performance on abstract reasoning tasks, but exhibit many imperfections. However, human abstract reasoning is also imperfect. For…

Large Language Models (LLMs) encapsulate a surprising amount of factual world knowledge. However, their performance on temporal questions and historical knowledge is limited because they often cannot understand temporal scope and…

Computation and Language · Computer Science 2025-03-24 Jonas Wallat , Abdelrahman Abdallah , Adam Jatowt , Avishek Anand

Large language models (LLMs) have made rapid improvement on medical benchmarks, but their unreliability remains a persistent challenge for safe real-world uses. To design for the use LLMs as a category, rather than for specific models,…

Computation and Language · Computer Science 2024-10-14 Andrew M. Bean , Karolina Korgul , Felix Krones , Robert McCraith , Adam Mahdi

There have been widespread claims about Large Language Models (LLMs) being able to successfully verify or self-critique their candidate solutions in reasoning problems in an iterative mode. Intrigued by those claims, in this paper we set…

Artificial Intelligence · Computer Science 2023-10-13 Karthik Valmeekam , Matthew Marquez , Subbarao Kambhampati

Large language models (LLMs) have been widely used for problem-solving tasks. Most recent work improves their performance through supervised fine-tuning (SFT) with labeled data or reinforcement learning (RL) from task feedback. In this…

Computation and Language · Computer Science 2025-09-29 Hang Li , Kaiqi Yang , Yucheng Chu , Hui Liu , Jiliang Tang

This paper investigates the logical reasoning capabilities of large language models (LLMs). For a precisely defined yet tractable formulation, we choose the conceptually simple but technically complex task of constructing proofs in Boolean…

Machine Learning · Computer Science 2025-04-30 Yuan Xia , Akanksha Atrey , Fadoua Khmaissia , Kedar S. Namjoshi

Theory of Mind (ToM) assesses whether models can infer hidden mental states such as beliefs, desires, and intentions, which is essential for natural social interaction. Although recent progress in Large Reasoning Models (LRMs) has boosted…

Artificial Intelligence · Computer Science 2026-03-05 Nanxu Gong , Haotian Li , Sixun Dong , Jianxun Lian , Yanjie Fu , Xing Xie

Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems. A faithful representation of probabilistic reasoning in these models may…

Artificial Intelligence · Computer Science 2025-04-21 Gabriel Freedman , Francesca Toni

This is the first work to look at the application of large language models (LLMs) for the purpose of model space edits in automated planning tasks. To set the stage for this union, we explore two different flavors of model space problems…

Artificial Intelligence · Computer Science 2024-03-06 Turgay Caglar , Sirine Belhaj , Tathagata Chakraborti , Michael Katz , Sarath Sreedharan