English
Related papers

Related papers: HiMAC: Hierarchical Macro-Micro Learning for Long-…

200 papers

LLM-based agents increasingly rely on long-term memory to support multi-session reasoning and interaction, yet current systems provide little control over what information is retained. In practice, agents either accumulate large volumes of…

Artificial Intelligence · Computer Science 2026-03-06 Guilin Zhang , Wei Jiang , Xiejiashan Wang , Aisha Behr , Kai Zhao , Jeffrey Friedman , Xu Chu , Amine Anoun

Language-guided autonomous driving requires bridging a large abstraction gap between high-level natural-language instructions and low-level vehicle control. End-to-end approaches that use a single multimodal large language model (MLLM) to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zaibin Zhang , Talas Fu , Shiyu Tang , Yuanhang Zhang , Yifan Wang , Lijun Wang , Huchuan Lu

Strategic reasoning is a complex yet essential capability for intelligent agents. It requires Large Language Model (LLM) agents to adapt their strategies dynamically in multi-agent environments. Unlike static reasoning tasks, success in…

Computation and Language · Computer Science 2024-10-18 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Yan Xia , Man Lan , Furu Wei

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

Recent advances in agent development have focused on scaling model size and raw interaction data, mirroring successes in large language models. However, for complex, long-horizon multi-agent tasks such as robotic soccer, this end-to-end…

Artificial Intelligence · Computer Science 2025-11-05 Brennen Hill

Multi-agent systems perform well on general reasoning tasks. However, the lack of training in specialized areas hinders their accuracy. Current training methods train a unified large language model (LLM) for all agents in the system. This…

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Many sequential decision-making problems exhibit hierarchical structure, where high-level semantic choices constrain downstream actions and feedback is delayed and ambiguous. Learning in such settings is challenging due to credit…

Artificial Intelligence · Computer Science 2026-05-05 Polydoros Giannouris , Yuechen Jiang , Lingfei Qian , Yuyan Wang , Xueqing Peng , Jimin Huang , Guojun Xiong , Sophia Ananiadou

Large language models (LLMs) are increasingly deployed as intelligent agents that reason, plan, and interact with their environments. To effectively scale to long-horizon scenarios, a key capability for such agents is a memory mechanism…

Artificial Intelligence · Computer Science 2026-01-09 Yuyang Hu , Jiongnan Liu , Jiejun Tan , Yutao Zhu , Zhicheng Dou

Recently, large language models (LLMs) have demonstrated remarkable problem-solving capabilities by autonomously integrating with external tools for collaborative reasoning. However, due to the inherently complex and diverse nature of…

Artificial Intelligence · Computer Science 2025-11-03 Mengjie Deng , Guanting Dong , Zhicheng Dou

Reinforcement learning (RL) has been applied to improve large language model (LLM) reasoning, yet the systematic study of how training scales with task difficulty has been hampered by the lack of controlled, scalable environments. Observed…

Artificial Intelligence · Computer Science 2026-05-19 Tianle Wang , Zhaoyang Wang , Guangchen Lan , Xinpeng Wei , Sipeng Zhang , Guanwen Qiu , Abulhair Saparov

Although LLMs demonstrate proficiency in several text-based reasoning and planning tasks, their implementation in robotics control is constrained by significant deficiencies: (1) LLM agents are designed to work mainly with textual inputs…

Artificial Intelligence · Computer Science 2025-10-17 Shuang Ao , Flora D. Salim , Simon Khan

Recent advances in large language models (LLMs) have enabled agentic systems for sequential decision-making. Such agents must perceive their environment, reason across multiple time steps, and take actions that optimize long-term…

Artificial Intelligence · Computer Science 2026-03-10 ELita Lobo , Xu Chen , Jingjing Meng , Nan Xi , Yang Jiao , Chirag Agarwal , Yair Zick , Yan Gao

As large language model (LLM)-based agents become increasingly integrated into daily digital interactions, their ability to reason across long interaction histories becomes crucial for providing personalized and contextually aware…

Machine Learning · Computer Science 2025-12-05 Andy Chung , Yichi Zhang , Kaixiang Lin , Aditya Rawal , Qiaozi Gao , Joyce Chai

Large language models (LLMs) excel at solving complex tasks by executing agentic workflows composed of detailed instructions and structured operations. Yet, building general-purpose agents by manually embedding foundation models into…

Artificial Intelligence · Computer Science 2025-08-08 Chia-Tung Ho , Jing Gong , Xufeng Yao , Yunsheng Bai , Abhishek B Akkur , Haoxing Ren

Large Language Models (LLMs) have shown remarkable promise in reasoning and decision-making, yet their integration with Reinforcement Learning (RL) for complex robotic tasks remains underexplored. In this paper, we propose an LLM-guided…

Machine Learning · Computer Science 2025-03-26 Chak Lam Shek , Pratap Tokekar

Large language model (LLM) agents have demonstrated strong capabilities in complex interactive decision-making tasks. However, existing LLM agents typically rely on increasingly long interaction histories, resulting in high computational…

Artificial Intelligence · Computer Science 2026-04-16 Shuai Zhen , Yanhua Yu , Ruopei Guo , Nan Cheng , Yang Deng

Recent advancements in Large Language Models(LLMs) have led to the development of LLM-based AI agents. A key challenge is the creation of agents that can effectively ground themselves in complex, adversarial long-horizon environments.…

Computation and Language · Computer Science 2025-09-17 Sijia Cui , Shuai Xu , Aiyao He , Yanna Wang , Bo Xu

Large Language Models (LLMs) deliver state-of-the-art performance across many tasks but impose high computational and memory costs, limiting their deployment in resource-constrained or real-time settings. To address this, we propose…

Computation and Language · Computer Science 2025-11-14 Nikunj Gupta , Bill Guo , Rajgopal Kannan , Viktor K. Prasanna

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao