English
Related papers

Related papers: TACT: Mitigating Overthinking and Overacting in Co…

200 papers

Code agents must both reason over long-horizon repository state and obey strict tool-use protocols. In paired Instruct/Thinking checkpoints, these capabilities are complementary but misaligned. The Instruct model is concise and…

Software Engineering · Computer Science 2026-05-15 Mingzhi Zhu , Michele Merler , Raju Pavuluri , Stacy Patterson

Large language models increasingly rely on either reinforcement learning or multi-agent prompting to improve reasoning, yet these two paradigms remain difficult to combine. Directly applying single-agent reinforcement learning to multi-turn…

Artificial Intelligence · Computer Science 2026-05-28 Chusen Li , Zhou Liu , Shuigeng Zhou , Wentao Zhang

Information retrieval (IR) systems have traditionally been designed and trained for human users, with learning-to-rank methods relying heavily on large-scale human interaction logs such as clicks and dwell time. With the rapid emergence of…

Information Retrieval · Computer Science 2026-04-08 Yuqi Zhou , Sunhao Dai , Changle Qu , Liang Pang , Jun Xu , Ji-Rong Wen

Information Retrieval is shifting from passive document ranking toward autonomous agentic workflows that operate in multi-step Reason-Act-Observe loops. In such long-horizon trajectories, minor early errors can cascade, leading to…

Artificial Intelligence · Computer Science 2026-04-14 Anushree Sinha , Srivaths Ranganathan , Debanshu Das , Abhishek Dharmaratnakar

Large Language Models (LLMs), despite advances in instruction tuning, often fail to follow complex user instructions. Activation steering techniques aim to mitigate this by manipulating model internals, but have a potential risk of…

Machine Learning · Computer Science 2026-03-10 Minjae Kang , Jaehyung Kim

Large Language Models (LLMs) agents are increasingly pivotal for addressing complex tasks in interactive environments. Existing work mainly focuses on enhancing performance through behavior cloning from stronger experts, yet such approaches…

Artificial Intelligence · Computer Science 2025-03-25 Siyu Yuan , Zehui Chen , Zhiheng Xi , Junjie Ye , Zhengyin Du , Jiecao Chen

Prior representative ReAct-style approaches in autonomous Software Engineering (SWE) typically lack the explicit System-2 reasoning required for deep analysis and handling complex edge cases. While recent reasoning models demonstrate the…

Artificial Intelligence · Computer Science 2026-04-14 Shuquan Lian , Juncheng Liu , Yazhe Chen , Yuhong Chen , Hui Li

How should multi-agent systems be designed, and can that design knowledge be captured in a form that is inspectable, revisable, and transferable? We introduce ABSTRAL, a framework that treats MAS architecture as an evolving natural-language…

Artificial Intelligence · Computer Science 2026-03-25 Weijia Song , Jiashu Yue , Zhe Pang

In real-world applications, the process generating the data might suffer from nonstationary effects (e.g., due to seasonality, faults affecting sensors or actuators, and changes in the users' behaviour). These changes, often called concept…

Machine Learning · Computer Science 2025-08-25 Kleanthis Malialis , Manuel Roveri , Cesare Alippi , Christos G. Panayiotou , Marios M. Polycarpou

Linear activation steering is a powerful approach for eliciting the capabilities of large language models and specializing their behavior using limited labeled data. While effective, existing methods often apply a fixed steering strength to…

Computation and Language · Computer Science 2026-04-28 Brandon Hsu , Daniel Beaglehole , Adityanarayanan Radhakrishnan , Mikhail Belkin

Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics:…

Machine Learning · Computer Science 2026-03-03 Jinluan Yang , Yuxin Liu , Zhengyu Chen , Chengcheng Han , Yueqing Sun , Qi Gu , Hui Su , Xunliang Cai , Fei Wu , Kun Kuang

This paper introduces lateral thinking to implement System-2 reasoning capabilities in AI systems, focusing on anticipatory and causal reasoning under uncertainty. We present a framework for systematic generation and modeling of lateral…

Artificial Intelligence · Computer Science 2024-12-12 Stefan Dernbach , Alejandro Michel , Khushbu Agarwal , Christopher Brissette , Geetika Gupta , Sutanay Choudhury

Activation steering has emerged as a promising approach for efficiently adapting large language models (LLMs) to downstream behaviors. However, most existing steering methods rely on a single static direction per task or concept, making…

Emergent multi-agent communication protocols are very different from natural language and not easily interpretable by humans. We find that agents that were initially pretrained to produce natural language can also experience detrimental…

Computation and Language · Computer Science 2019-09-11 Jason Lee , Kyunghyun Cho , Douwe Kiela

Highly capable AI systems could secretly pursue misaligned goals -- what we call "scheming". Because a scheming AI would deliberately try to hide its misaligned goals and actions, measuring and mitigating scheming requires different…

Agent applications are increasingly adopted to automate workflows across diverse tasks. However, due to the heterogeneous domains they operate in, it is challenging to create a scalable evaluation framework. Prior works each employ their…

Artificial Intelligence · Computer Science 2026-03-17 Penny Chong , Harshavardhan Abichandani , Jiyuan Shen , Atin Ghosh , Min Pyae Moe , Yifan Mai , Daniel Dahlmeier

The current paradigm of test-time scaling relies on generating long reasoning traces ("thinking" more) before producing a response. In agent problems that require interaction, this can be done by generating thinking traces before acting in…

Large language models exhibit strong multilingual capabilities, yet significant performance gaps persist between dominant and non-dominant languages. Prior work attributes this gap to imbalances between shared and language-specific neurons…

Computation and Language · Computer Science 2026-01-26 Rhitabrat Pokharel , Ameeta Agrawal , Tanay Nagar

Visual Language Models (VLMs), with powerful multimodal reasoning capabilities, are gradually integrated into autonomous driving by several automobile manufacturers to enhance planning capability in challenging environments. However, the…

Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT…

Computation and Language · Computer Science 2026-04-13 Yi Sui , Chaozhuo Li , Dawei Song