English
Related papers

Related papers: PLDR-LLMs Reason At Self-Organized Criticality

200 papers

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

Clinical decision-making requires reasoning over incomplete, imprecise, and linguistically expressed patient narratives. While large language models (LLMs) excel at extracting latent information from natural language, they lack the…

Artificial Intelligence · Computer Science 2026-05-26 Xiaoyang Fan , Yufan Cai , Zhe Hou , Jin Song Dong

Current large language models can perform reasonably well on complex tasks that require step-by-step reasoning with few-shot learning. Are these models applying reasoning skills they have learnt during pre-training and reason outside of…

Computation and Language · Computer Science 2023-10-02 Ping Yu , Tianlu Wang , Olga Golovneva , Badr AlKhamissi , Siddharth Verma , Zhijing Jin , Gargi Ghosh , Mona Diab , Asli Celikyilmaz

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

Computation and Language · Computer Science 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

Large Language Models (LLMs) often exhibit limited logical coherence, mapping premises to conclusions without adherence to explicit inference rules. We propose Proof-Carrying Reasoning with LLMs (PCRLLM), a framework that constrains…

Computation and Language · Computer Science 2025-11-12 Tangrui Li , Pei Wang , Hongzheng Wang Christian Hahm , Matteo Spatola , Justin Shi

Despite great performance on Olympiad-level reasoning problems, frontier large language models can still struggle on high school math when presented with novel problems outside standard benchmarks. Going beyond final accuracy, we propose a…

Computation and Language · Computer Science 2025-04-10 Atharva Pandey , Kshitij Dubey , Rahul Sharma , Amit Sharma

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

Computation and Language · Computer Science 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

The recent trend towards utilisation of reasoning models has improved the performance of Large Language Models (LLMs) across many tasks which involve logical steps. One linguistic task that could benefit from this framing is idiomaticity…

Computation and Language · Computer Science 2025-08-20 Dylan Phelps , Rodrigo Wilkens , Edward Gow-Smith , Thomas Pickard , Maggie Mi , Aline Villavicencio

Large Language Models (LLMs) have achieved significant performance gains through test-time scaling methods. However, existing approaches often incur redundant computations due to the accumulation of historical dependency information during…

Computation and Language · Computer Science 2025-12-30 Fengwei Teng , Quan Shi , Zhaoyang Yu , Jiayi Zhang , Yuyu Luo , Chenglin Wu , Zhijiang Guo

We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge encoded in the form of natural language. We investigate their systematic generalization abilities on a…

Machine Learning · Computer Science 2020-10-22 Nicolas Gontier , Koustuv Sinha , Siva Reddy , Christopher Pal

Modern language models (LMs) exhibit strong deductive reasoning capabilities, yet standard evaluations emphasize correctness while overlooking a key aspect of reasoning: efficiency. In real-world reasoning scenarios, much of the available…

Recent advances in large language models (LLMs) have led to the development of thinking language models that generate extensive internal reasoning chains before producing responses. While these models achieve improved performance,…

Machine Learning · Computer Science 2025-10-23 Constantin Venhoff , Iván Arcuschin , Philip Torr , Arthur Conmy , Neel Nanda

Large reasoning models (LRMs) already possess a latent capacity for long chain-of-thought reasoning. Prior work has shown that outcome-based reinforcement learning (RL) can incidentally elicit advanced reasoning behaviors such as…

Computation and Language · Computer Science 2025-05-28 Zhiyuan Hu , Yibo Wang , Hanze Dong , Yuhui Xu , Amrita Saha , Caiming Xiong , Bryan Hooi , Junnan Li

Self-training approach for large language models (LLMs) improves reasoning abilities by training the models on their self-generated rationales. Previous approaches have labeled rationales that produce correct answers for a given question as…

Machine Learning · Computer Science 2025-02-07 Jaehyeok Lee , Keisuke Sakaguchi , JinYeong Bak

Reasoning LLMs are trained to verbalize their reasoning process, yielding strong gains on complex tasks. This transparency also opens a promising direction: multiple reasoners can directly collaborate on each other's thinking within a…

Artificial Intelligence · Computer Science 2026-03-04 Aochong Oliver Li , Tanya Goyal

Large Language Models (LLMs) are becoming very popular and are used for many different purposes, including creative tasks in the arts. However, these models sometimes have trouble with specific reasoning tasks, especially those that involve…

Computation and Language · Computer Science 2024-09-10 Anna Kruspe

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Empirical methods to examine the capability of Large Language Models (LLMs) to use Automated Theorem Prover (ATP) reasoning strategies are studied. We evaluate the performance of State of the Art models from December 2023 and August 2024 on…

Artificial Intelligence · Computer Science 2025-09-18 Lachlan McGinness , Peter Baumgartner

Large Language Models (LLMs) have shown impressive performance in mathematical reasoning tasks when guided by Chain-of-Thought (CoT) prompting. However, they tend to produce highly confident yet incorrect outputs, which poses significant…

Machine Learning · Computer Science 2025-06-11 Zhenjiang Mao , Artem Bisliouk , Rohith Reddy Nama , Ivan Ruchkin

Large language models are often assumed to acquire increasingly structured, generalizable internal representations simply by scaling data and parameters. We interrogate this assumption by introducing a Clinical Trial Natural Language…

Artificial Intelligence · Computer Science 2025-08-15 Maël Jullien , Marco Valentino , André Freitas