English
Related papers

Related papers: Conceptual and Unbiased Reasoning in Language Mode…

200 papers

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

Language models learn and represent language differently than humans; they learn the form and not the meaning. Thus, to assess the success of language model explainability, we need to consider the impact of its divergence from a user's…

Computation and Language · Computer Science 2022-07-15 Rita Sevastjanova , Mennatallah El-Assady

Large Language Models show promise in emotion understanding, social reasoning, and empathy, yet they struggle with psychologically grounded tasks that require inferring implicit mental states in context-rich, ambiguous settings. These…

Databases · Computer Science 2025-11-13 Yichao Feng , Haoran Luo , Lang Feng , Shuai Zhao , Anh Tuan Luu

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

Artificial Intelligence · Computer Science 2025-10-29 Benjamin Grando Moreira

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Large language models (LLMs) have proven to be highly effective for solving complex reasoning tasks. Surprisingly, their capabilities can often be improved by iterating on previously generated solutions. In this context, a reasoning plan…

Artificial Intelligence · Computer Science 2025-12-05 MohammadHossein Bateni , Vincent Cohen-Addad , Yuzhou Gu , Silvio Lattanzi , Simon Meierhans , Christopher Mohri

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Studies have underscored how, regardless of the recent breakthrough and swift advances in AI research, even state-of-the-art Large Language models (LLMs) continue to struggle when performing logical and mathematical reasoning. The results…

Artificial Intelligence · Computer Science 2024-12-20 Federico Castagna , Isabel Sassoon , Simon Parsons

Large natural language models (such as GPT-3 or T5) demonstrate impressive abilities across a range of general NLP tasks. Here, we show that the knowledge embedded in such models provides a useful inductive bias, not just on traditional NLP…

Computation and Language · Computer Science 2021-10-07 Christopher Michael Rytting , David Wingate

Large language models have been shown to suffer from reasoning inconsistency issues. That is, they fail more in situations unfamiliar to the training data, even though exact or very similar reasoning paths exist in more common cases that…

Computation and Language · Computer Science 2025-02-04 Ben Zhou , Sarthak Jain , Yi Zhang , Qiang Ning , Shuai Wang , Yassine Benajiba , Dan Roth

The recent trend towards utilisation of reasoning models has improved the performance of Large Language Models (LLMs) across many tasks which involve logical steps. One linguistic task that could benefit from this framing is idiomaticity…

Computation and Language · Computer Science 2025-08-20 Dylan Phelps , Rodrigo Wilkens , Edward Gow-Smith , Thomas Pickard , Maggie Mi , Aline Villavicencio

Creating written products is essential to modern life, including writings about one's identity and personal experiences. However, writing is often a difficult activity that requires extensive effort to frame the central ideas, the pursued…

Computation and Language · Computer Science 2023-12-29 Alex Doboli

Achieving human-level intelligence requires refining the transition from the fast, intuitive System 1 to the slower, more deliberate System 2 reasoning. While System 1 excels in quick, heuristic decisions, System 2 relies on logical…

Opinion modeling aims to capture individual or group political preferences, enabling applications such as digital democracies, where models could help shape fairer and more popular policies. Given their versatility, strong generalization…

Computation and Language · Computer Science 2026-03-13 Frédéric Berdoz , Yann Billeter , Yann Vonlanthen , Roger Wattenhofer

Background & Objectives: In the last decade, Machine learning research has grown rapidly, but large models are reaching their soft limits demonstrating diminishing returns and still lack solid reasoning abilities. These limits could be…

Artificial Intelligence · Computer Science 2026-04-30 Ioannis Konstantoulas , Dimosthenis Tsimas , Pavlos Peppas , Kyriakos Sgarbas

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

Artificial Intelligence · Computer Science 2025-08-21 Hong Su

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

This paper investigates the logical reasoning capabilities of large language models (LLMs). For a precisely defined yet tractable formulation, we choose the conceptually simple but technically complex task of constructing proofs in Boolean…

Machine Learning · Computer Science 2025-04-30 Yuan Xia , Akanksha Atrey , Fadoua Khmaissia , Kedar S. Namjoshi

Large language models (LLMs) have revolutionized many areas (e.g. natural language processing, software engineering, etc.) by achieving state-of-the-art performance on extensive downstream tasks. Aiming to achieve robust and general…

Artificial Intelligence · Computer Science 2024-01-18 Zhiming Li , Yushi Cao , Xiufeng Xu , Junzhe Jiang , Xu Liu , Yon Shin Teo , Shang-wei Lin , Yang Liu

The underperformance of existing multimodal large language models for time series reasoning lies in the absence of rationale priors that connect temporal observations to their downstream outcomes, which leads models to rely on superficial…

Artificial Intelligence · Computer Science 2026-01-07 Qingxiang Liu , Zhiqing Cui , Xiaoliang Luo , Yuqian Wu , Zhuoyang Jiang , Huaiyu Wan , Sheng Sun , Lvchun Wang , Wei Yu , Yuxuan Liang