English
Related papers

Related papers: EvolveR: Self-Evolving LLM Agents through an Exper…

200 papers

Multi-agents has exhibited significant intelligence in real-word simulations with Large language models (LLMs) due to the capabilities of social cognition and knowledge retrieval. However, existing research on agents equipped with effective…

Artificial Intelligence · Computer Science 2025-04-23 Yajie Yu , Yue Feng

Large language model (LLM) agents rely on reusable skills to solve complex tasks. However, existing skill creation approaches treat skills as isolated and static artifacts, limiting their reusability, reliability, and long-term improvement.…

Artificial Intelligence · Computer Science 2026-05-27 Huawei Lin , Peng Li , Jie Song , Fuxin Jiang , Tieying Zhang

Large language models (LLMs) have been widely integrated into information retrieval to advance traditional techniques. However, effectively enabling LLMs to seek accurate knowledge in complex tasks remains a challenge due to the complexity…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Lingyong Yan , Dawei Yin , Suzan Verberne , Maarten de Rijke , Zhaochun Ren

The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and…

Artificial Intelligence · Computer Science 2026-01-01 Chunhui Wan , Xunan Dai , Zhuo Wang , Minglei Li , Yanpeng Wang , Yinan Mao , Yu Lan , Zhiwen Xiao

Long-term memory is essential for LLM agents that operate across multiple sessions, yet existing memory systems treat retrieval infrastructure as fixed: stored content evolves while scoring functions, fusion strategies, and…

Machine Learning · Computer Science 2026-05-15 Jiaqi Liu , Xinyu Ye , Peng Xia , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

As AI advances toward general intelligence, the focus is shifting from systems optimized for static tasks to creating open-ended agents that learn continuously. In this paper, we introduce Experience-driven Lifelong Learning (ELL), a…

Artificial Intelligence · Computer Science 2026-01-27 Yuxuan Cai , Yipeng Hao , Jie Zhou , Hang Yan , Zhikai Lei , Rui Zhen , Zhenhua Han , Yutao Yang , Junsong Li , Qianjun Pan , Tianyu Huai , Qin Chen , Xin Li , Kai Chen , Bo Zhang , Xipeng Qiu , Liang He

Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions, yet most deployed agents remain behaviorally static, with knowledge acquired during…

Artificial Intelligence · Computer Science 2026-05-19 Yuxin Jin , Siyuan Zhang , Hanchen Wang , Lu Qin , Ying Zhang , Wenjie Zhang

Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate…

Computation and Language · Computer Science 2024-06-06 Chen Qian , Yufan Dang , Jiahao Li , Wei Liu , Zihao Xie , Yifei Wang , Weize Chen , Cheng Yang , Xin Cong , Xiaoyin Che , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have been increasingly applied to tasks in language understanding and interactive decision-making, with their impressive performance largely attributed to the extensive domain knowledge embedded within them.…

Artificial Intelligence · Computer Science 2024-10-16 Zhiyuan Sun , Haochen Shi , Marc-Alexandre Côté , Glen Berseth , Xingdi Yuan , Bang Liu

Clinical text improvement is vital for healthcare efficiency but remains difficult due to limited high-quality data and the complex constraints of medical documentation. While Large Language Models (LLMs) show promise, current approaches…

Computation and Language · Computer Science 2026-02-03 Ziyan Xiao , Yinghao Zhu , Liang Peng , Lequan Yu

Large language model (LLM)-based agents frequently generate seemingly coherent plans that fail upon execution due to infeasible actions, constraint violations, and compounding errors over extended horizons. PIVOT (Plan-Inspect-eVOlve…

Artificial Intelligence · Computer Science 2026-05-13 Tuo Zhang , Alin-Ionut Popa , Yan Xu , Rui Song , Dimitrios Dimitriadis

Open-ended image generation is no longer a simple prompt-to-image problem. High-quality generation often requires an agent to combine a model's internal generative ability with external resources. As requests become more diverse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Sixiang Chen , Zhaohu Xing , Tian Ye , Xinyu Geng , Yunlong Lin , Jianyu Lai , Xuanhua He , Fuxiang Zhai , Jialin Gao , Lei Zhu

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

Large Language Models (LLMs) have demonstrated remarkable versatility across various domains. To further advance LLMs, we propose 'SELF' (Self-Evolution with Language Feedback), a novel approach that enables LLMs to self-improve through…

Computation and Language · Computer Science 2024-02-02 Jianqiao Lu , Wanjun Zhong , Wenyong Huang , Yufei Wang , Qi Zhu , Fei Mi , Baojun Wang , Weichao Wang , Xingshan Zeng , Lifeng Shang , Xin Jiang , Qun Liu

Although the effectiveness of Large Language Models (LLMs) as judges (LLM-as-a-judge) has been validated, their performance remains limited in open-ended tasks, particularly in story evaluation. Accurate story evaluation is crucial not only…

Computation and Language · Computer Science 2026-03-17 Xinda Wang , Zhengxu Hou , Yangshijie Zhang , Bingren Yan , Jialin Liu , Chenzhuo Zhao , Zhibo Yang , Bin-Bin Yang , Feng Xiao

Large Language Models (LLMs) have enabled the emergence of LLM agents, systems capable of pursuing under-specified goals and adapting after deployment. Evaluating such agents is challenging because their behavior is open ended,…

Software Engineering · Computer Science 2025-11-18 Boming Xia , Qinghua Lu , Liming Zhu , Zhenchang Xing , Dehai Zhao , Hao Zhang

Reinforcement learning for LLM agents is typically conducted on a static data distribution, which fails to adapt to the agent's evolving behavior and leads to poor coverage of complex environment interactions. To address these challenges,…

Computation and Language · Computer Science 2026-04-20 Shidong Yang , Ziyu Ma , Tongwen Huang , Yiming Hu , Yong Wang , Xiangxiang Chu

Due to the dynamically evolving nature of real-world query streams, relevance models struggle to generalize to practical search scenarios. A sophisticated solution is self-evolution techniques. However, in large-scale industrial settings…

Computation and Language · Computer Science 2026-04-21 Chenglong Wang , Canjia Li , Xingzhao Zhu , Yifu Huo , Huiyu Wang , Weixiong Lin , Yun Yang , Qiaozhi He , Tianhua Zhou , Xiaojia Chang , Jingbo Zhu , Tong Xiao

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation,…

Artificial Intelligence · Computer Science 2026-04-21 Jiahao Huang , Peilan Xu , Xiaoya Nan , Wenjian Luo

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang