English
Related papers

Related papers: Can Language Representation Models Think in Bets?

200 papers

Large language models (LLMs) achieve astonishing results on a wide range of tasks. However, their formal reasoning ability still lags behind. A promising approach is Neurosymbolic LLM reasoning. It works by using LLMs as translators from…

Artificial Intelligence · Computer Science 2025-05-22 Alexander Beiser , David Penz , Nysret Musliu

Large Language Models (LLMs) are increasingly expected to handle complex decision-making tasks, yet their ability to perform structured resource allocation remains underexplored. Evaluating their reasoning is also difficult due to data…

Artificial Intelligence · Computer Science 2025-08-11 Sankarshan Damle , Boi Faltings

The evaluation of open-ended responses in serious games presents a unique challenge, as correctness is often subjective. Large Language Models (LLMs) are increasingly being explored as evaluators in such contexts, yet their accuracy and…

Computation and Language · Computer Science 2025-04-18 Andrés Isaza-Giraldo , Paulo Bala , Lucas Pereira

Agents powered by Large Language Models (LLMs) have recently demonstrated impressive capabilities in various tasks. Still, they face limitations in tasks requiring specific, structured knowledge, flexibility, or accountable decision-making.…

Artificial Intelligence · Computer Science 2025-04-14 Kostas Hatalis , Despina Christou , Vyshnavi Kondapalli

Reasoning is an essential component of human intelligence as it plays a fundamental role in our ability to think critically, support responsible decisions, and solve challenging problems. Traditionally, AI has addressed reasoning in the…

Artificial Intelligence · Computer Science 2024-10-16 Ken Satoh , Ha-Thanh Nguyen , Francesca Toni , Randy Goebel , Kostas Stathis

Logical reasoning is a fundamental aspect of human intelligence and a key component of tasks like problem-solving and decision-making. Recent advancements have enabled Large Language Models (LLMs) to potentially exhibit reasoning…

Computation and Language · Computer Science 2023-11-13 Jiazhan Feng , Ruochen Xu , Junheng Hao , Hiteshi Sharma , Yelong Shen , Dongyan Zhao , Weizhu Chen

Large Language Models (LLMs) have achieved remarkable success across diverse natural language tasks, yet the reward models employed for aligning LLMs often encounter challenges of reward hacking, where the approaches predominantly rely on…

Computation and Language · Computer Science 2026-03-06 Biao Liu , Ning Xu , Junming Yang , Hao Xu , Xin Geng

This paper examines the reasoning capabilities of Large Language Models (LLMs) from a novel perspective, focusing on their ability to operate within formally specified, rule-governed environments. We evaluate four LLMs (Gemini 2.5 Pro and…

Artificial Intelligence · Computer Science 2026-02-24 Maciej Świechowski , Adam Żychowski , Jacek Mańdziuk

Large Language Models (LLMs) encapsulate an extensive amount of world knowledge, and this has enabled their application in various domains to improve the performance of a variety of Natural Language Processing (NLP) tasks. This has also…

Artificial Intelligence · Computer Science 2024-04-30 Sina Gholamian , Domingo Huh

Recent work reports that Large Reasoning Models (LRMs) undergo a collapse in performance on solving puzzles beyond certain perplexity thresholds. In subsequent discourse, questions have arisen as to whether the nature of the task muddles an…

Artificial Intelligence · Computer Science 2025-10-21 Chris Su , Harrison Li , Matheus Marques , George Flint , Kevin Zhu , Sunishchal Dev

Large pre-trained language models (LMs) are known to encode substantial amounts of linguistic information. However, high-level reasoning skills, such as numerical reasoning, are difficult to learn from a language-modeling objective only.…

Computation and Language · Computer Science 2020-04-10 Mor Geva , Ankit Gupta , Jonathan Berant

Advances in deep learning systems have allowed large models to match or surpass human accuracy on a number of skills such as image classification, basic programming, and standardized test taking. As the performance of the most capable…

Machine Learning · Computer Science 2024-06-10 Sarah Pratt , Seth Blumberg , Pietro Kreitlon Carolino , Meredith Ringel Morris

Large Reasoning Models (LRMs) achieve strong performance on mathematical, scientific, and other question-answering tasks, but their multilingual reasoning abilities remain underexplored. When presented with non-English questions, LRMs often…

Computation and Language · Computer Science 2026-02-10 Alan Saji , Raj Dabre , Anoop Kunchukuttan , Ratish Puduppully

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

With the rapid advancement of Large Language Models (LLMs), recent studies have drawn attention to their potential for handling not only simple question-answer tasks but also more complex conversational abilities and performing human-like…

Artificial Intelligence · Computer Science 2025-11-25 Mingyu Jeon , Jaeyoung Suh , Suwan Cho , Dohyeon Kim

The relationship between communicated language and intended meaning is often probabilistic and sensitive to context. Numerous strategies attempt to estimate such a mapping, often leveraging recursive Bayesian models of communication. In…

Computation and Language · Computer Science 2023-05-03 Benjamin Lipkin , Lionel Wong , Gabriel Grand , Joshua B Tenenbaum

The use of large language models either as decision support systems, or in agentic workflows, is rapidly transforming the digital ecosystem. However, the understanding of LLM decision-making under uncertainty remains limited. We study LLM…

Artificial Intelligence · Computer Science 2026-04-22 Luise Ge , Yongyan Zhang , Yevgeniy Vorobeychik

Large language models (LLMs), a recent advance in deep learning and machine intelligence, have manifested astonishing capacities, now considered among the most promising for artificial general intelligence. With human-like capabilities,…

Artificial Intelligence · Computer Science 2025-09-19 Zhilun Zhou , Jing Yi Wang , Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li , James Evans

There is considerable confusion about the role of Large Language Models (LLMs) in planning and reasoning tasks. On one side are over-optimistic claims that LLMs can indeed do these tasks with just the right prompting or self-verification…

Artificial Intelligence · Computer Science 2024-06-13 Subbarao Kambhampati , Karthik Valmeekam , Lin Guan , Mudit Verma , Kaya Stechly , Siddhant Bhambri , Lucas Saldyt , Anil Murthy

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

Computation and Language · Computer Science 2025-04-16 Thilo Hagendorff , Sarah Fabi