English
Related papers

Related papers: Efficiently Enhancing General Agents With Hierarch…

200 papers

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of NLP tasks, but they remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. Recent efforts to…

Long-term conversational large language model (LLM) agents require memory systems that can recover relevant evidence from historical interactions without overwhelming the answer stage with irrelevant context. However, existing memory…

Computation and Language · Computer Science 2026-04-23 Shuqi Cao , Jingyi He , Fei Tan

Building a general-purpose agent is a long-standing vision in the field of artificial intelligence. Existing agents have made remarkable progress in many domains, yet they still struggle to complete long-horizon tasks in an open world. We…

Artificial Intelligence · Computer Science 2024-10-22 Zaijing Li , Yuquan Xie , Rui Shao , Gongwei Chen , Dongmei Jiang , Liqiang Nie

Embodied agents are expected to operate persistently in dynamic physical environments, continuously acquiring new capabilities over time. Existing approaches to improving agent performance often rely on modifying the agent itself -- through…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Modern language agents must operate over long-horizon, multi-turn interactions, where they retrieve external information, adapt to observations, and answer interdependent queries. Yet, most LLM systems rely on full-context prompting,…

Computation and Language · Computer Science 2025-07-18 Zijian Zhou , Ao Qu , Zhaoxuan Wu , Sunghwan Kim , Alok Prakash , Daniela Rus , Jinhua Zhao , Bryan Kian Hsiang Low , Paul Pu Liang

Open-ended AI agents need to be able to learn efficiently goals of increasing complexity, abstraction and heterogeneity over their lifetime. Beyond sampling efficiently their own goals, autotelic agents specifically need to be able to keep…

Machine Learning · Computer Science 2025-08-21 Thomas Carta , Clément Romac , Loris Gaven , Pierre-Yves Oudeyer , Olivier Sigaud , Sylvain Lamprier

Large language models (LLMs) have achieved impressive linguistic capabilities. However, a key limitation persists in their lack of human-like memory faculties. LLMs exhibit constrained memory retention across sequential interactions,…

Computation and Language · Computer Science 2024-05-29 Jing Guo , Nan Li , Jianchuan Qi , Hang Yang , Ruiqiao Li , Yuzhen Feng , Si Zhang , Ming Xu

Multi-agent systems built on Large Language Models (LLMs) show exceptional promise for complex collaborative problem-solving, yet they face fundamental challenges stemming from context window limitations that impair memory consistency, role…

Artificial Intelligence · Computer Science 2026-01-13 Sizhe Yuen , Francisco Gomez Medina , Ting Su , Yali Du , Adam J. Sobey

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

The continuous changes in the world have resulted in the performance regression of neural networks. Therefore, continual learning (CL) area gradually attracts the attention of more researchers. For edge intelligence, the CL model not only…

Machine Learning · Computer Science 2023-03-22 Xiangwei Wang , Rui Han , Chi Harold Liu

We introduce \emph{Memento-Skills}, a generalist, continually-learnable LLM agent system that functions as an \emph{agent-designing agent}: it autonomously constructs, adapts, and improves task-specific agents through experience. The system…

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for…

Artificial Intelligence · Computer Science 2024-04-23 Zeyu Zhang , Xiaohe Bo , Chen Ma , Rui Li , Xu Chen , Quanyu Dai , Jieming Zhu , Zhenhua Dong , Ji-Rong Wen

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Large Language Model (LLM) agents are increasingly used in real-world products, where personalized and context-aware user interactions are essential. A central enabler of such capabilities is the agent's long-term semantic memory system,…

Information Retrieval · Computer Science 2026-05-27 Zhentao Xu , Shangjin Zhang , Emir Poyraz , Yvonne Li , Ye Jin , Xie Lu , Xiaoyang Gu , Karthik Ramgopal , Praveen Kumar Bodigutla , Xiaofeng Wang

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

As intents unfold and environments change, multi-turn agents face continuously shifting decision contexts. Although reusing past experience is intuitively appealing, existing approaches remain limited: full trajectories are often too…

Machine Learning · Computer Science 2026-02-02 Sijia Li , Yuchen Huang , Zifan Liu , Zijian Li , Jingjing fu , Lei Song , Jiang Bian , Jun Zhang , Rui Wang

Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to store, update, and retrieve information over time. This ability…

Computation and Language · Computer Science 2026-05-19 Yuyao Wang , Zhongjian Zhang , Mo Chi , Kaichi Yu , Yuhan Li , Miao Peng , Bing Tong , Chen Zhang , Yan Zhou , Jia Li

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based…

Robotics · Computer Science 2026-04-21 Xiaoyu Ma , Lianyu Hu , Wenbing Tang , Zixuan Hu , Zeqin Liao , Zhizhen Wu , Yang Liu

Large language model (LLM) agents have demonstrated strong capabilities in complex interactive decision-making tasks. However, existing LLM agents typically rely on increasingly long interaction histories, resulting in high computational…

Artificial Intelligence · Computer Science 2026-04-16 Shuai Zhen , Yanhua Yu , Ruopei Guo , Nan Cheng , Yang Deng

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These…

Artificial Intelligence · Computer Science 2025-05-07 Schaun Wheeler , Olivier Jeunen