English
Related papers

Related papers: Directional Reasoning Trajectory Change (DRTC): Id…

200 papers

Transferring reasoning capabilities from larger language models to smaller ones through supervised fine-tuning often fails counterintuitively, with performance degrading despite access to high-quality teacher demonstrations. We identify…

Computation and Language · Computer Science 2025-09-29 Jaehoon Kim , Kwangwook Seo , Dongha Lee

Most work interpreting reasoning models studies only a single chain-of-thought (CoT), yet these models define distributions over many possible CoTs. We argue that studying a single sample is inadequate for understanding causal influence and…

Machine Learning · Computer Science 2026-04-14 Uzay Macar , Paul C. Bogdan , Senthooran Rajamanoharan , Neel Nanda

Inference-time scaling techniques have significantly bolstered the reasoning capabilities of large language models (LLMs) by harnessing additional computational effort at inference without retraining. Similarly, Chain-of-Thought (CoT)…

Machine Learning · Computer Science 2025-06-19 Baohao Liao , Hanze Dong , Yuhui Xu , Doyen Sahoo , Christof Monz , Junnan Li , Caiming Xiong

Recent advances in vision language models (VLMs) offer reasoning capabilities, yet how these unfold and integrate visual and textual information remains unclear. We analyze reasoning dynamics in 18 VLMs covering instruction-tuned and…

Computation and Language · Computer Science 2026-04-28 Danae Sánchez Villegas , Samuel Lewis-Lim , Nikolaos Aletras , Desmond Elliott

Deep learning models achieve state-of-the-art performance across domains but face scalability challenges in real-time or resource-constrained scenarios. To address this, we propose Loss Trajectory Correlation (LTC), a novel metric for…

Machine Learning · Computer Science 2025-03-14 Manish Nagaraj , Deepak Ravikumar , Efstathia Soufleri , Kaushik Roy

Reasoning capabilities are crucial for reliable medical visual question answering (VQA); however, existing datasets rarely include reasoning explanations. We address this by generating reasoning trajectories for six medical VQA benchmarks…

Machine Learning · Computer Science 2026-05-07 Halil Ibrahim Gulluk , Olivier Gevaert

Assessing the reasoning ability of Large Language Models (LLMs) over data remains an open and pressing research question. Compared with LLMs, human reasoning can derive corresponding modifications to the output based on certain kinds of…

Machine Learning · Computer Science 2025-11-21 Yifan Li , Qin Li , Min Zhang , Min Zhang

Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models. While existing analyses identify that RLVR-induced changes are sparse, they primarily focus on the…

Electronic control units (ECUs) embedded within modern vehicles generate a large number of asynchronous events known as diagnostic trouble codes (DTCs). These discrete events form complex temporal sequences that reflect the evolving health…

Artificial Intelligence · Computer Science 2026-03-20 Hugo Math

Large reasoning models (LRMs) achieve strong mathematical reasoning performance in English, but remain much less reliable in many low- and medium-resource languages. This gap is often explained as a failure to understand non-English problem…

Computation and Language · Computer Science 2026-05-28 Jiaqiao Zhang , Zhoujun Li , Raoyuan Zhao , Jian Lan , Thomas Seidl , Michael A. Hedderich , Hinrich Schütze , Yihong Liu

Discrete time crystals (DTCs) are nonequilibrium phases of matter with exotic observable dynamics. Among their remarkable features is their response to a periodic drive at a fraction of its frequency. Current successful experiments are…

Quantum Physics · Physics 2021-11-30 Raditya Weda Bomantara

Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), especially when combined with reinforcement learning (RL) based post-training methods. While longer reasoning traces can improve…

Machine Learning · Computer Science 2026-02-16 Qinhang Wu , Sen Lin , Ming Zhang , Yingbin Liang , Ness B. Shroff

Compared to traditional visual question answering, video-grounded dialogues require additional reasoning over dialogue context to answer questions in a multi-turn setting. Previous approaches to video-grounded dialogues mostly use dialogue…

Artificial Intelligence · Computer Science 2022-12-08 Hung Le , Nancy F. Chen , Steven C. H. Hoi

Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning capability, we…

Machine Learning · Computer Science 2024-06-24 Xinyi Wang , Alfonso Amayuelas , Kexun Zhang , Liangming Pan , Wenhu Chen , William Yang Wang

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

Machine Learning · Computer Science 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

While explicit Chain-of-Thought (CoT) equips Large Language Models (LLMs) with strong reasoning capabilities, it requires models to verbalize every intermediate step in text tokens, constraining the model thoughts to the discrete vocabulary…

Computation and Language · Computer Science 2026-02-12 Weihao Liu , Dehai Min , Lu Cheng

Chain-of-thought traces from large reasoning models can span tens of thousands of tokens, yet we lack a vocabulary for describing their internal structure. Previous methods developed to analyze chain-of-thought traces are either too rigid…

Artificial Intelligence · Computer Science 2026-05-29 Daniel Lee , Owen Queen , James Zou

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

Artificial Intelligence · Computer Science 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang

Clinical decision support requires not only correct answers but also clinically valid reasoning. We propose Differential Reasoning Learning (DRL), a framework that improves clinical agents by learning from reasoning discrepancies. From…

Artificial Intelligence · Computer Science 2026-02-11 Jinsong Liu , Yuhang Jiang , Ramayya Krishnan , Rema Padman , Yiye Zhang , Jiang Bian

The reasoning capabilities of large language models (LLMs) have significantly advanced their performance by enabling in-depth understanding of diverse tasks. With growing interest in applying LLMs to the time series domain, this has proven…

Artificial Intelligence · Computer Science 2025-06-03 Jiahui Zhou , Dan Li , Lin Li , Zhuomin Chen , Shunyu Wu , Haozheng Ye , Jian Lou , Costas J. Spanos