English
Related papers

Related papers: Evaluating the Deductive Competence of Large Langu…

200 papers

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

Artificial Intelligence · Computer Science 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang

Large language models (LLMs) are increasingly used in domains where causal reasoning matters, yet it remains unclear whether their judgments reflect normative causal computation, human-like shortcuts, or brittle pattern matching. We…

Artificial Intelligence · Computer Science 2026-03-16 Hanna M. Dettki , Charley M. Wu , Bob Rehder

Case-based reasoning is a cornerstone of U.S. legal practice, requiring professionals to argue about a current case by drawing analogies to and distinguishing from past precedents. While Large Language Models (LLMs) have shown remarkable…

Computation and Language · Computer Science 2026-01-21 Li Zhang , Matthias Grabmair , Morgan Gray , Kevin Ashley

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler

Recent advancements in Large Language Models (LLMs) have brought them closer to matching human cognition across a variety of tasks. How well do these models align with human performance in detecting and mapping analogies? Prior research has…

Computation and Language · Computer Science 2025-07-16 Kalit Inani , Keshav Kabra , Vijay Marupudi , Sashank Varma

Large Language Models (LLMs) can generate content that is as persuasive as human-written text and appear capable of selectively producing deceptive outputs. These capabilities raise concerns about potential misuse and unintended…

Computation and Language · Computer Science 2024-12-24 Cameron R. Jones , Benjamin K. Bergen

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

Large Language Models (LLMs) with reasoning capabilities have achieved state-of-the-art performance on a wide range of tasks. Despite its empirical success, the tasks and model scales at which reasoning becomes effective, as well as its…

Computation and Language · Computer Science 2025-09-29 Nicolas Boizard , Hippolyte Gisserot-Boukhlef , Kevin El-Haddad , Céline Hudelot , Pierre Colombo

Recently, computer scientists have developed large language models (LLMs) by training prediction models with large-scale language corpora and human reinforcements. The LLMs have become one promising way to implement artificial intelligence…

Computers and Society · Computer Science 2023-08-22 Hyemin Han

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

Computation and Language · Computer Science 2025-09-23 Sungwon Kim , Daniel Khashabi

Logical reasoning is fundamental for humans yet presents a substantial challenge in the domain of Artificial Intelligence. Initially, researchers used Knowledge Representation and Reasoning (KR) systems that did not scale and required…

Computation and Language · Computer Science 2024-04-02 Man Luo , Shrinidhi Kumbhar , Ming shen , Mihir Parmar , Neeraj Varshney , Pratyay Banerjee , Somak Aditya , Chitta Baral

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

This study introduces a hypothesis-testing framework to assess whether large language models (LLMs) possess genuine reasoning abilities or primarily depend on token bias. We go beyond evaluating LLMs on accuracy; rather, we aim to…

Computation and Language · Computer Science 2024-10-07 Bowen Jiang , Yangxinyu Xie , Zhuoqun Hao , Xiaomeng Wang , Tanwi Mallick , Weijie J. Su , Camillo J. Taylor , Dan Roth

Large Language Models (LLMs) have recently developed new advanced functionalities. Their effectiveness relies on statistical learning and generalization capabilities. However, they face limitations in internalizing the data they process and…

Machine Learning · Computer Science 2026-01-14 Farah Ben Slama , Frédéric Armetta

Given the intractably large size of the space of proofs, any model that is capable of general deductive reasoning must generalize to proofs of greater complexity. Recent studies have shown that large language models (LLMs) possess some…

Computation and Language · Computer Science 2023-11-07 Abulhair Saparov , Richard Yuanzhe Pang , Vishakh Padmakumar , Nitish Joshi , Seyed Mehran Kazemi , Najoung Kim , He He

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

In this paper, we explore the potential of Large Language Models (LLMs) with assertions to mitigate imbalances in educational datasets. Traditional models often fall short in such contexts, particularly due to the complexity and nuanced…

Computers and Society · Computer Science 2024-07-03 Jeanne McClure , Machi Shimmei , Noboru Matsuda , Shiyan Jiang

Reasoning has long been viewed as an emergent property of large language models (LLMs). However, recent studies challenge this assumption, showing that small language models (SLMs) can also achieve competitive reasoning performance. This…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Shuxiang Cao , Xuan Wang

Large Language Models (LLMs) have demonstrated good performance in many reasoning tasks, but they still struggle with some complicated reasoning tasks including logical reasoning. One non-negligible reason for LLMs' suboptimal performance…

Computation and Language · Computer Science 2024-04-09 Yanda Li , Dixuan Wang , Jiaqing Liang , Guochao Jiang , Qianyu He , Yanghua Xiao , Deqing Yang