English
Related papers

Related papers: interwhen: A Generalizable Framework for Steering …

200 papers

Large language models (LLMs) increasingly rely on reinforcement learning (RL) to enhance their reasoning capabilities through feedback. A critical challenge is verifying the consistency of model-generated responses and reference answers,…

Artificial Intelligence · Computer Science 2025-07-29 Xuzhao Li , Xuchen Li , Shiyu Hu , Yongzhen Guo , Wentao Zhang

Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit…

Artificial Intelligence · Computer Science 2026-04-21 Jiakun Li , Xingwei He , Kefan Li , Hongzheng Chai , Hongyue Yu , Yuan Yuan

User modeling aims to use language models (LMs) to mimic an individual's behavior from a corpus of past context-action pairs (e.g., conversation turns), enabling the simulation of users in settings like behavioral science, human-AI…

Computation and Language · Computer Science 2026-05-27 Alan Zhu , Mihran Miroyan , Carolyn Wang , Andrew Zhou , Lisa Dunlap , Narges Norouzi , Joseph E. Gonzalez

Chain-of-Thought (CoT) reasoning has driven recent gains of large language models (LLMs) on reasoning-intensive tasks by externalizing intermediate steps. However, excessive or redundant reasoning -- so-called overthinking -- can increase…

Computation and Language · Computer Science 2025-10-14 Renliang Sun , Wei Cheng , Dawei Li , Haifeng Chen , Wei Wang

Vision-language models achieve strong performance across a wide range of multimodal understanding and reasoning tasks, yet their multi-step reasoning remains unstable. Repeated sampling over the same input often produces divergent reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Chaoyu Li , Deeparghya Dutta Barua , Fei Tao , Pooyan Fazli

Recent advances in Large Language Models (LLMs) have shown that their reasoning capabilities can be significantly improved through Reinforcement Learning with Verifiable Reward (RLVR), particularly in domains like mathematics and…

Large Language Models (LLMs) are increasingly entering specialized, safety-critical engineering workflows governed by strict quantitative standards and immutable physical laws, making rigorous evaluation of their reasoning capabilities…

Computation and Language · Computer Science 2026-01-08 Ayesha Gull , Muhammad Usman Safder , Rania Elbadry , Fan Zhang , Veselin Stoyanov , Preslav Nakov , Zhuohan Xie

Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation through deep understanding of complex user preference. Existing approaches follow a {reason-then-recommend} paradigm, where…

Information Retrieval · Computer Science 2026-03-10 Xinyu Lin , Hanqing Zeng , Hanchao Yu , Yinglong Xia , Jiang Zhang , Aashu Singh , Fei Liu , Wenjie Wang , Fuli Feng , Tat-Seng Chua , Qifan Wang

Large language models (LLMs) are now used in multi-turn workflows, but we still lack a clear way to measure when iteration helps and when it hurts. We present an evaluation framework for iterative refinement that spans ideation, code, and…

Artificial Intelligence · Computer Science 2025-09-16 Shashidhar Reddy Javaji , Bhavul Gauri , Zining Zhu

Large language models (LLMs) now give reasoning before answering, excelling in tasks like multiple-choice question answering (MCQA). Yet, a concern is that LLMs do not solve MCQs as intended, as work finds LLMs sans reasoning succeed in…

Computation and Language · Computer Science 2026-04-21 Nishant Balepur , Atrey Desai , Rachel Rudinger

Recent advances in large language models (LLMs) have led to the development of thinking language models that generate extensive internal reasoning chains before producing responses. While these models achieve improved performance,…

Machine Learning · Computer Science 2025-10-23 Constantin Venhoff , Iván Arcuschin , Philip Torr , Arthur Conmy , Neel Nanda

Large Language Models (LLMs) often rely on long chain-of-thought (CoT) reasoning to solve complex tasks. While effective, these trajectories are frequently inefficient, leading to high latency from excessive token generation, or unstable…

Recent Large Reasoning Models (LRMs) have achieved remarkable progress on task-specific benchmarks, yet their evaluation methods remain constrained by isolated problem-solving paradigms. Existing benchmarks predominantly assess…

Computation and Language · Computer Science 2025-07-16 Zhuoshi Pan , Qizhi Pei , Yu Li , Qiyao Sun , Zinan Tang , H. Vicky Zhao , Conghui He , Lijun Wu

Large language models have achieved remarkable progress on complex reasoning tasks. However, they often implicitly fabricate information when inputs are incomplete, producing confident but unreliable conclusions -- a failure mode we term…

Computation and Language · Computer Science 2026-04-22 Yiwen Qiu , Linjuan Wu , Yizhou Liu , Yuchen Yan , Jin Ma , Xu Tan , Yao Hu , Daoxin Zhang , Wenqi Zhang , Weiming Lu , Jun Xiao , Yongliang Shen

Harness engineering has emerged as an important inference-time technique for large language model (LLM) agents, aiming to improve long-term performance through task decomposition and guided execution. However, more elaborate harnesses are…

Machine Learning · Computer Science 2026-05-22 Boyuan Wang , Bochao Li , Minghan Wang , Yuxin Tao , Fang Kong

Despite rapid progress in claim verification, we lack a systematic understanding of what reasoning these benchmarks actually exercise. We generate structured reasoning traces for 24K claim-verification examples across 9 datasets using…

Computation and Language · Computer Science 2026-04-03 Delip Rao , Chris Callison-Burch

Reasoning has emerged as the next major frontier for language models (LMs), with rapid advances from both academic and industrial labs. However, this progress often outpaces methodological rigor, with many evaluations relying on…

Machine Learning · Computer Science 2025-10-08 Andreas Hochlehnert , Hardik Bhatnagar , Vishaal Udandarao , Samuel Albanie , Ameya Prabhu , Matthias Bethge

Large language models (LLMs) are increasingly deployed in settings where reasoning, such as multi-step problem solving and chain-of-thought, is essential. Yet, current evaluation practices overwhelmingly report single-run accuracy while…

Artificial Intelligence · Computer Science 2025-12-09 Nearchos Potamitis , Lars Klein , Akhil Arora

Informal mathematics has been central to modern large language model (LLM) reasoning, offering flexibility and enabling efficient construction of arguments. However, purely informal reasoning is prone to logical gaps and subtle errors that…

Artificial Intelligence · Computer Science 2025-11-25 Azim Ospanov , Zijin Feng , Jiacheng Sun , Haoli Bai , Xin Shen , Farzan Farnia

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin