English
Related papers

Related papers: Milestone-Guided Policy Learning for Long-Horizon …

200 papers

Agentic reinforcement learning trains large language models using multi-turn trajectories that interleave long reasoning traces with short environment-facing actions. Common policy-gradient methods, such as PPO and GRPO, treat each token in…

Machine Learning · Computer Science 2026-05-15 Langzhou He , Junyou Zhu , Yue Zhou , Zhengyao Gu , Junhua Liu , Wei-Chieh Huang , Henry Peng Zou , David Wipf , Philip S. Yu , Qitian Wu

Long-range navigation is commonly addressed through hierarchical pipelines in which a global planner generates a path, decomposed into waypoints, and followed sequentially by a local planner. These systems are sensitive to global path…

Robotics · Computer Science 2026-03-17 Mateo Haro , Julia Richter , Fan Yang , Cesar Cadena , Marco Hutter

Long-term temporal credit assignment is an important challenge in deep reinforcement learning (RL). It refers to the ability of the agent to attribute actions to consequences that may occur after a long time interval. Existing…

Machine Learning · Computer Science 2020-10-27 Tanmay Gangwani , Yuan Zhou , Jian Peng

Large language models can perform well on many isolated tasks, yet they continue to struggle on multi-turn, long-horizon agentic problems that require skills such as planning, state tracking, and long context processing. In this work, we…

Artificial Intelligence · Computer Science 2026-01-26 Amin Rakhsha , Thomas Hehn , Pietro Mazzaglia , Fabio Valerio Massoli , Arash Behboodi , Tribhuvanesh Orekondy

Large language model (LLM) agents learn by interacting with environments, but long-horizon training remains fundamentally bottlenecked by sparse and delayed rewards. Existing methods typically address this challenge through post-hoc credit…

Large language model (LLM)-based agents exhibit strong step-by-step reasoning capabilities over short horizons, yet often fail to sustain coherent behavior over long planning horizons. We argue that this failure reflects a fundamental…

Artificial Intelligence · Computer Science 2026-02-02 Zehong Wang , Fang Wu , Hongru Wang , Xiangru Tang , Bolian Li , Zhenfei Yin , Yijun Ma , Yiyang Li , Weixiang Sun , Xiusi Chen , Yanfang Ye

Recent work, spanning from autonomous vehicle coordination to in-space assembly, has shown the importance of learning collaborative behavior for enabling robots to achieve shared goals. A common approach for learning this cooperative…

Multiagent Systems · Computer Science 2025-02-25 Kartik Nagpal , Dayi Dong , Jean-Baptiste Bouvier , Negar Mehr

Multi-agent systems of large language models (LLMs) show promise for complex reasoning, but their effectiveness is often limited by fixed collaboration protocols. These frameworks typically focus on macro-level orchestration while…

Artificial Intelligence · Computer Science 2025-12-10 Wei Yang , Jesse Thomason

Addressing decision-making problems using sequence modeling to predict future trajectories shows promising results in recent years. In this paper, we take a step further to leverage the sequence predictive method in wider areas such as…

Robotics · Computer Science 2023-12-07 Mineui Hong , Minjae Kang , Songhwai Oh

Some real-world domains are best characterized as a single task, but for others this perspective is limiting. Instead, some tasks continually grow in complexity, in tandem with the agent's competence. In continual learning, also referred to…

Large Language Model (LLM)-based agents have achieved notable success on short-horizon and highly structured tasks. However, their ability to maintain coherent decision-making over long horizons in realistic and dynamic environments remains…

Artificial Intelligence · Computer Science 2026-03-18 Linghua Zhang , Jun Wang , Jingtong Wu , Zhisong Zhang

Large Language Models and multi-agent systems have shown promise in decomposing complex tasks, yet they struggle with long-horizon reasoning tasks and escalating computation cost. This work introduces a hierarchical multi-agent architecture…

Computation and Language · Computer Science 2026-04-02 Indrajit Kar , Kalathur Chenchu Kishore Kumar

Large language model (LLM)-based agents are increasingly trained with reinforcement learning (RL) to enhance their ability to interact with external environments through tool use, particularly in search-based settings that require…

Computation and Language · Computer Science 2026-03-25 Guoqing Wang , Sunhao Dai , Guangze Ye , Zeyu Gan , Wei Yao , Yong Deng , Xiaofeng Wu , Zhenzhe Ying

Although large language models (LLMs) have advanced rapidly, robust automation of complex software workflows remains an open problem. In long-horizon settings, agents frequently suffer from cascading errors and environmental stochasticity;…

Artificial Intelligence · Computer Science 2026-03-30 Yenchia Feng , Chirag Sharma , Karime Maamari

Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfaces instead of relying on brittle, application-specific integrations. Despite recent…

Artificial Intelligence · Computer Science 2026-05-01 Jinbiao Wei , Kangqi Ni , Yilun Zhao , Guo Gan , Arman Cohan

This paper introduces BeaCon, a novel tool for the automated generation of adjustable container security policies. Unlike prior approaches, BeaCon leverages dynamic analysis to simulate realistic environments, uncovering container execution…

Cryptography and Security · Computer Science 2025-12-02 Haney Kang , Eduard Marin , Myoungsung You , Diego Perino , Seungwon Shin , Jinwoo Kim

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

Machine Learning · Computer Science 2025-04-03 Llewyn Salt , Marcus Gallagher

To achieve successful assistance with long-horizon web-based tasks, AI agents must be able to sequentially follow real-world user instructions over a long period. Unlike existing web-based agent benchmarks, sequential instruction following…

Artificial Intelligence · Computer Science 2025-12-02 Suyu Ye , Haojun Shi , Darren Shih , Hyokun Yun , Tanya Roosta , Tianmin Shu

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Sparse reward environments in reinforcement learning (RL) pose significant challenges for exploration, often leading to inefficient or incomplete learning processes. To tackle this issue, this work proposes a teacher-student RL framework…

Artificial Intelligence · Computer Science 2024-10-14 Unai Ruiz-Gonzalez , Alain Andres , Pedro G. Bascoy , Javier Del Ser