English
Related papers

Related papers: Mem$^2$Evolve: Towards Self-Evolving Agents via Co…

200 papers

Exploration remains the key bottleneck for large language model agents trained with reinforcement learning. While prior methods exploit pretrained knowledge, they fail in environments requiring the discovery of novel states. We propose…

Machine Learning · Computer Science 2026-03-09 Zeyuan Liu , Jeonghye Kim , Xufang Luo , Dongsheng Li , Yuqing Yang

Agent memory shapes how Large Language Model (LLM)-powered agents, akin to the human brain, progressively refine themselves through environment interactions. Existing paradigms remain constrained: parametric memory forcibly adjusts model…

Computation and Language · Computer Science 2025-10-14 Guibin Zhang , Muxin Fu , Shuicheng Yan

Due to the dynamically evolving nature of real-world query streams, relevance models struggle to generalize to practical search scenarios. A sophisticated solution is self-evolution techniques. However, in large-scale industrial settings…

Computation and Language · Computer Science 2026-04-21 Chenglong Wang , Canjia Li , Xingzhao Zhu , Yifu Huo , Huiyu Wang , Weixiong Lin , Yun Yang , Qiaozhi He , Tianhua Zhou , Xiaojia Chang , Jingbo Zhu , Tong Xiao

Traditional self-adaptive systems automatically reconfigure existing components in response to changing requirements, but provide limited support for the generation of novel functionalities. The software generation capabilities of large…

Software Engineering · Computer Science 2026-04-21 Md Asif Iqbal Fahim , Oluwadamilola Adebayo , Alessio Ferrari

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

Artificial Intelligence (AI) significantly influences many fields, largely thanks to the vast amounts of high-quality data for machine learning models. The emphasis is now on a data-centric AI strategy, prioritizing data development over…

Artificial Intelligence · Computer Science 2024-07-29 Xu Yang , Haotian Chen , Wenjun Feng , Haoxue Wang , Zeqi Ye , Xinjie Shen , Xiao Yang , Shizhao Sun , Weiqing Liu , Jiang Bian

As large language models (LLMs) advance their mathematical capabilities toward the IMO level, the scarcity of challenging, high-quality problems for training and evaluation has become a significant bottleneck. Simultaneously, recent code…

Computation and Language · Computer Science 2026-03-05 Dadi Guo , Yuejin Xie , Qingyu Liu , Jiayu Liu , Zhiyuan Fan , Qihan Ren , Shuai Shao , Tianyi Zhou , Dongrui Liu , Yi R. Fung

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and evolution remain largely underexplored. Existing evaluations…

Self-Refinement refers to a model's ability to revise its own responses to produce improved outputs. This capability can also serve as a fundamental mechanism for Self-Improvement, for example, by reconstructing datasets with refined…

Computation and Language · Computer Science 2025-10-28 Yongcheng Zeng , Xinyu Cui , Xuanfa Jin , Qirui Mi , Guoqing Liu , Zexu Sun , Mengyue Yang , Dong Li , Weiyu Ma , Ning Yang , Jian Zhao , Jianye Hao , Haifeng Zhang , Jun Wang

Embodied agents are expected to operate persistently in dynamic physical environments, continuously acquiring new capabilities over time. Existing approaches to improving agent performance often rely on modifying the agent itself -- through…

Robotics · Computer Science 2026-05-22 Xue Qin , Simin Luan , John See , Cong Yang , Zhijun Li

Building generalist agents that can handle diverse tasks and evolve themselves across different environments is a long-term goal in the AI community. Large language models (LLMs) are considered a promising foundation to build such agents…

LLM-based multi-agent systems (MAS) have emerged as an effective paradigm for complex and long-horizon tasks. However, in real-world tasks, MAS often exhibit various failures during execution and such failures are difficult to eliminate…

Multiagent Systems · Computer Science 2026-05-29 Zhezheng Hao , Tianfu Wang , Huanshuo Dong , Ziyan Liu , Hong Wang , Xiankun Lin , Qiang Lin , Can Wang , Hande Dong , Jiawei Chen

Agent harness evolution improves frozen language-model agents by modifying the executable structures around them. We study this paradigm as a form of sample-efficient fast adaptation: instead of updating model weights, an agent can acquire…

Artificial Intelligence · Computer Science 2026-05-26 Lirong Che , Yuzhe yang , Peiwen lin , Chuang wang , Xueqian wang , Jian su

Autonomous agents driven by Large Language Models (LLMs) have revolutionized reasoning and problem-solving but remain static after training, unable to grow with experience as intelligent beings do during deployment. We introduce Forward…

Machine Learning · Computer Science 2025-12-09 Zhicheng Cai , Xinyuan Guo , Yu Pei , Jiangtao Feng , Jinsong Su , Jiangjie Chen , Ya-Qin Zhang , Wei-Ying Ma , Mingxuan Wang , Hao Zhou

Self-evolving agents improve by accumulating and reusing experience from past interactions. Existing work has largely focused on how experience is constructed, represented, and updated, while paying less attention to how experience should…

Computation and Language · Computer Science 2026-05-11 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yanyan Zhao , Yu Zhang , Yang Wu , Dandan Tu , Bing Qin , Ting Liu

Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a novel approach that enables LLMs to self-improve through…

Computation and Language · Computer Science 2024-02-02 Jianqiao Lu , Wanjun Zhong , Wenyong Huang , Yufei Wang , Qi Zhu , Fei Mi , Baojun Wang , Weichao Wang , Xingshan Zeng , Lifeng Shang , Xin Jiang , Qun Liu

While knowledge distillation has become a mature field for compressing large language models (LLMs) into smaller ones by aligning their outputs or internal representations, the distillation of LLM-based agents, which involve planning,…

Artificial Intelligence · Computer Science 2025-06-18 Jiahao Qiu , Xinzhe Juan , Yimin Wang , Ling Yang , Xuan Qi , Tongcheng Zhang , Jiacheng Guo , Yifu Lu , Zixin Yao , Hongru Wang , Shilong Liu , Xun Jiang , Liu Leqi , Mengdi Wang

Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions, yet most deployed agents remain behaviorally static, with knowledge acquired during…

Artificial Intelligence · Computer Science 2026-05-19 Yuxin Jin , Siyuan Zhang , Hanchen Wang , Lu Qin , Ying Zhang , Wenjie Zhang

Long-term multi-agent systems inevitably generate vast amounts of trajectories and historical interactions, which makes efficient memory management essential for both performance and scalability. Existing methods typically depend on vector…

Artificial Intelligence · Computer Science 2025-09-29 Haoran Xu , Jiacong Hu , Ke Zhang , Lei Yu , Yuxin Tang , Xinyuan Song , Yiqun Duan , Lynn Ai , Bill Shi