English
Related papers

Related papers: Residual Drift Dominates Contradiction in Multi-Tu…

200 papers

Reasoning models are evaluated on single-turn benchmarks but deployed in multi-turn dialogue, where users push back on correct answers. Under sustained adversarial pressure we find a previously undocumented failure mode: the…

Artificial Intelligence · Computer Science 2026-05-29 Yubo Li , Ramayya Krishnan , Rema Padman

Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under…

Artificial Intelligence · Computer Science 2026-03-13 Yubo Li , Ramayya Krishnan , Rema Padman

Learning systems are typically optimized by minimizing loss or maximizing reward, assuming that improvements in these signals reflect progress toward the true objective. However, when feedback reliability is unobservable, this assumption…

Machine Learning · Computer Science 2026-03-24 Zhipeng Zhang , Zhenjie Yao , Kai Li , Lei Yang

Retrieval-augmented LLMs are deployed for tasks where evidence quality determines action safety, yet evaluation protocols assume that single-turn robustness predicts robustness when evidence accumulates across turns. We show this assumption…

Artificial Intelligence · Computer Science 2026-05-27 Zhe Yu , Wenpeng Xing , Chen Ye , Xuyang Teng , Bo Yang , Changting Lin , Meng Han

Robust perception and reasoning require consistency across sensory modalities. Yet current multimodal models often violate this principle, yielding contradictory predictions for visual and textual representations of the same concept. Rather…

Artificial Intelligence · Computer Science 2026-03-27 Zirui Zhang , Haoyu Dong , Kexin Pei , Chengzhi Mao

Reading comprehension (RC) is a challenging task that requires synthesis of information across sentences and multiple turns of reasoning. Using a state-of-the-art RC model, we empirically investigate the performance of single-turn and…

Computation and Language · Computer Science 2017-11-10 Yelong Shen , Xiaodong Liu , Kevin Duh , Jianfeng Gao

Large reasoning models (LRMs) with multi-step reasoning capabilities have shown remarkable problem-solving abilities, yet they exhibit concerning safety vulnerabilities that remain poorly understood. In this work, we investigate why safety…

Artificial Intelligence · Computer Science 2025-10-08 Qingyu Yin , Chak Tou Leong , Linyi Yang , Wenxuan Huang , Wenjie Li , Xiting Wang , Jaehong Yoon , YunXing , XingYu , Jinjin Gu

Large language models have demonstrated remarkable proficiency in long and complex reasoning tasks. However, they frequently exhibit a problematic reliance on familiar reasoning patterns, a phenomenon we term \textit{reasoning rigidity}.…

Artificial Intelligence · Computer Science 2025-05-26 Doohyuk Jang , Yoonjeon Kim , Chanjae Park , Hyun Ryu , Eunho Yang

Despite the success of test-time scaling, Large Reasoning Models (LRMs) frequently encounter repetitive loops that lead to computational waste and inference failure. In this paper, we identify a distinct failure mode termed Circular…

Artificial Intelligence · Computer Science 2026-01-12 Zenghao Duan , Liang Pang , Zihao Wei , Wenbin Duan , Yuxin Tian , Shicheng Xu , Jingcheng Deng , Zhiyi Yin , Xueqi Cheng

Multimodal large language models (MLLMs) promise enhanced reasoning by integrating diverse inputs such as text, vision, and audio. Yet cross-modal reasoning remains underexplored, with conflicting reports on whether added modalities help or…

Computation and Language · Computer Science 2026-05-01 Yucheng Wang , Yifan Hou , Aydin Javadov , Mubashara Akhtar , Mrinmaya Sachan

Explicit reasoning models are trained to produce intermediate reasoning traces before final answers, but downstream fine-tuning is often performed on ordinary instruction-response data that contains no such traces. We show that this…

Machine Learning · Computer Science 2026-05-21 Lukas Twist , Helen Yannakoudakis , Jie M. Zhang

The theory of state tracking in recurrent architectures has predominantly focused on expressive capacity: whether a fixed architecture can theoretically realize a set of symbolic transition rules. We argue that equally important is error…

Machine Learning · Computer Science 2026-05-11 Jiwan Chung , Heechan Choi , Seon Joo Kim

Large language models confidently produce outdated answers, and no existing method can detect them. We show this is not an engineering failure but a structural one: temporal drift, whether a stored fact has changed since training, is…

Artificial Intelligence · Computer Science 2026-05-12 Rania Elbadry , Ahmed Heakl , Fan Zhang , Dani Bouch , Yuxia Wang , Preslav Nakov , Zhuohan Xie

When researchers iteratively refine ideas with large language models, do the models preserve fidelity to the original objective? We introduce DriftBench, a benchmark for evaluating constraint adherence in multi-turn LLM-assisted scientific…

Computation and Language · Computer Science 2026-05-05 Garvin Kruthof

Transformer LMs show emergent reasoning that resists mechanistic understanding. We offer a statistical physics framework for continuous-time chain-of-thought reasoning dynamics. We model sentence-level hidden state trajectories as a…

Artificial Intelligence · Computer Science 2025-06-06 Jack David Carson , Amir Reisizadeh

In this paper, we are concerned with the reliability assessment of redundant multi-channel systems having multiple controllers with overlapping functionality -- where all controllers are required to respond optimally to the non-faulty…

Dynamical Systems · Mathematics 2015-03-27 Getachew K. Befekadu , Panos J. Antsaklis

Reasoning-capable large language models solve hard problems by emitting long chains of thought, paying heavily in latency, GPU time, and energy. Casual inspection of their traces reveals extensive reformulation, verification, and circular…

Artificial Intelligence · Computer Science 2026-05-26 Zhiyuan Zhai , Xinkai You , Wenjing Yan , Xin Wang

Non-task oriented dialogue systems have achieved great success in recent years due to largely accessible conversation data and the development of deep learning techniques. Given a context, current systems are able to yield a relevant and…

Computation and Language · Computer Science 2020-04-10 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang , Ming Zhou

Reasoning models have attracted increasing attention for their ability to tackle complex tasks, embodying the System II (slow thinking) paradigm in contrast to System I (fast, intuitive responses). Yet a key question remains: Does slower…

Artificial Intelligence · Computer Science 2026-04-17 Sitong Fang , Wenjing Cao , Jiahao Li , Xuyao Wang , Juntao Dai , Chi-Min Chan , Sirui Han , Yike Guo , Yaodong Yang , Jiaming Ji

Multi-turn problem solving is critical yet challenging for Large Reasoning Models (LRMs) to reflect on their reasoning and revise from feedback. Existing Reinforcement Learning (RL) methods train large reasoning models on a single-turn…

Machine Learning · Computer Science 2025-08-25 Licheng Liu , Zihan Wang , Linjie Li , Chenwei Xu , Yiping Lu , Han Liu , Avirup Sil , Manling Li
‹ Prev 1 2 3 10 Next ›