English
Related papers

Related papers: TACT: Mitigating Overthinking and Overacting in Co…

200 papers

Reinforcement learning (RL) has emerged as a dominant paradigm for eliciting long-horizon reasoning in Large Language Models (LLMs). However, scaling Tool-Integrated Reasoning (TIR) via RL remains challenging due to interaction collapse: a…

Computation and Language · Computer Science 2026-02-03 Xuqin Zhang , Quan He , Zhenrui Zheng , Zongzhang Zhang , Xu He , Dong Li

Multiagent AI systems require consistent communication, but we lack methods to verify that agents share the same understanding of the terms used. Natural language is interpretable but vulnerable to semantic drift, while learned protocols…

Artificial Intelligence · Computer Science 2026-03-20 Philipp Schoenegger , Matt Carlson , Chris Schneider , Chris Daly

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfaces instead of relying on brittle, application-specific integrations. Despite recent…

Artificial Intelligence · Computer Science 2026-05-01 Jinbiao Wei , Kangqi Ni , Yilun Zhao , Guo Gan , Arman Cohan

In this paper, a steering action-aware Adaptive Cruise Control (ACC) approach for teleoperated road vehicles is proposed. In order to keep the vehicle in a safe state, the ACC approach can override the human operator's velocity control…

Robotics · Computer Science 2022-08-19 Andreas Schimpe , Domagoj Majstorovic , Frank Diermeyer

Reflection, the ability of large language models (LLMs) to evaluate and revise their own reasoning, has been widely used to improve performance on complex reasoning tasks. Yet, most prior works emphasizes designing reflective prompting…

Machine Learning · Computer Science 2025-12-12 Fu-Chieh Chang , Yu-Ting Lee , Pei-Yuan Wu

Large language model (LLM) agents on multi-step tasks suffer reasoning degradation, looping, drift, stuck states, at rates up to 30% on hard tasks. Current solutions include hard step limits (abrupt) or LLM-as-judge monitoring (10-15%…

Artificial Intelligence · Computer Science 2026-04-16 Rafflesia Khan , Nafiul Islam Khan

Multi-agent Retrieval-Augmented Generation (RAG), wherein each agent takes on a specific role, supports hard queries that require multiple steps and sources, or complex reasoning. Existing approaches, however, rely on static agent behaviors…

Artificial Intelligence · Computer Science 2026-04-06 Sha Li , Naren Ramakrishnan

Language Model (LM) agents have demonstrated remarkable capabilities in solving tasks that require multiple interactions with the environment. However, they remain vulnerable in environments where a single error often leads to irrecoverable…

Artificial Intelligence · Computer Science 2026-02-24 Jongwon Jeong , Jungtaek Kim , Kangwook Lee

Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this…

Artificial Intelligence · Computer Science 2025-10-08 Zhuofeng Li , Haoxiang Zhang , Seungju Han , Sheng Liu , Jianwen Xie , Yu Zhang , Yejin Choi , James Zou , Pan Lu

Large language models (LLMs) are increasingly deployed in teams, yet existing coordination approaches often occupy two extremes. Highly structured methods rely on fixed roles, pipelines, or task decompositions assigned a priori. In…

Multi-agent systems extend large language models (LLMs) by decomposing tasks among specialized agents, but their distributed decision process creates new attack surfaces. We identify semantic hijacking, an attack in which harmful requests…

Artificial Intelligence · Computer Science 2026-05-20 Qiqi Liu , Thorsten Holz , Shilin Ye , Runhan Song

Despite significant progress in alignment, large language models (LLMs) remain vulnerable to adversarial attacks that elicit harmful behaviors. Activation steering techniques offer a promising inference-time intervention approach, but…

Machine Learning · Computer Science 2026-01-28 Quy-Anh Dang , Chris Ngo

Recent advancements in slow thinking reasoning models have shown exceptional performance in complex reasoning tasks. However, these models often exhibit overthinking (generating redundant reasoning steps for simple problems), leading to…

Machine Learning · Computer Science 2026-01-13 Yi Shen , Jian Zhang , Jieyun Huang , Shuming Shi , Wenjing Zhang , Jiangze Yan , Ning Wang , Kai Wang , Zhaoxiang Liu , Shiguo Lian

Autonomous driving (AD) systems relying solely on onboard sensors may fail to detect distant or obstacle hazards, potentially causing preventable collisions; however, existing transformer-based Vehicle-to-Everything (V2X) approaches, which…

Artificial Intelligence · Computer Science 2025-08-13 Fengze Yang , Bo Yu , Yang Zhou , Xuewen Luo , Zhengzhong Tu , Chenxi Liu

Agentic systems for business process automation often require compliance with policies governing conditional updates to the system state. Evaluation of policy adherence in LLM-based agentic workflows is typically performed by comparing the…

Computation and Language · Computer Science 2026-05-15 Ella Rabinovich , David Boaz , Naama Zwerdling , Ateret Anaby-Tavor

Agentic systems often fail not by being entirely wrong, but by being too precise: a response may be generally useful while particular claims exceed what the evidence supports. We study this failure mode as overcommitment control and…

Computation and Language · Computer Science 2026-05-19 Tianyi Huang , Samuel Xu , Jason Tansong Dang , Samuel Yan , Kimberley Yin

Reward hacking, where a reasoning model exploits loopholes in a reward function to achieve high rewards without solving the intended task, poses a significant threat. This behavior may be explicit, i.e. verbalized in the model's…

Artificial Intelligence · Computer Science 2026-03-03 Xinpeng Wang , Nitish Joshi , Barbara Plank , Rico Angell , He He

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

While Large Reasoning Models (LRMs) have achieved remarkable performance by scaling test-time compute, they frequently suffer from Cognitive Inertia, a failure pattern manifesting as either overthinking (inertia of motion) or reasoning…

Machine Learning · Computer Science 2026-02-02 Seojin Lee , ByeongJeong Kim , Hwanhee Lee