English
Related papers

Related papers: EXG: Self-Evolving Agents with Experience Graphs

200 papers

Autonomous agents driven by Large Language Models (LLMs) have revolutionized reasoning and problem-solving but remain static after training, unable to grow with experience as intelligent beings do during deployment. We introduce Forward…

Machine Learning · Computer Science 2025-12-09 Zhicheng Cai , Xinyuan Guo , Yu Pei , Jiangtao Feng , Jinsong Su , Jiangjie Chen , Ya-Qin Zhang , Wei-Ying Ma , Mingxuan Wang , Hao Zhou

Large Language Models (LLMs) based agents excel at diverse tasks, yet they suffer from brittle procedural memory that is manually engineered or entangled in static parameters. In this work, we investigate strategies to endow agents with a…

Computation and Language · Computer Science 2026-04-16 Runnan Fang , Yuan Liang , Xiaobin Wang , Jialong Wu , Shuofei Qiao , Pengjun Xie , Fei Huang , Huajun Chen , Ningyu Zhang

Effective mental health counseling is a complex, theory-driven process requiring the simultaneous integration of psychological frameworks, real-time distress signals, and strategic intervention planning. This level of clinical reasoning is…

Computation and Language · Computer Science 2026-04-30 Eliya Naomi Aharon , Meytal Grimland , Avi Segal , Loona Ben Dayan , Inbar Shenfeld , Yossi Levi Belz , Kobi Gal

Generative AI, particularly Large Language Models, increasingly integrates graph-based representations to enhance reasoning, retrieval, and structured decision-making. Despite rapid advances, there remains limited clarity regarding when,…

Artificial Intelligence · Computer Science 2026-04-21 Hamed Jelodar , Samita Bai , Mohammad Meymani , Parisa Hamedi , Roozbeh Razavi-Far , Ali Ghorbani

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

As AI advances toward general intelligence, the focus is shifting from systems optimized for static tasks to creating open-ended agents that learn continuously. In this paper, we introduce Experience-driven Lifelong Learning (ELL), a…

Artificial Intelligence · Computer Science 2026-01-27 Yuxuan Cai , Yipeng Hao , Jie Zhou , Hang Yan , Zhikai Lei , Rui Zhen , Zhenhua Han , Yutao Yang , Junsong Li , Qianjun Pan , Tianyu Huai , Qin Chen , Xin Li , Kai Chen , Bo Zhang , Xipeng Qiu , Liang He

Replicating AI research is a crucial yet challenging task for large language model (LLM) agents. Existing approaches often struggle to generate executable code, primarily due to insufficient background knowledge and the limitations of…

Computation and Language · Computer Science 2026-04-21 Yujie Luo , Zhuoyun Yu , Xuehai Wang , Yuqi Zhu , Ningyu Zhang , Lanning Wei , Lun Du , Da Zheng , Huajun Chen

Large Language Model (LLM) agents increasingly rely on long-term memory and Retrieval-Augmented Generation (RAG) to persist experiences and refine future performance. While this experience learning capability enhances agentic autonomy, it…

Cryptography and Security · Computer Science 2025-12-22 Saksham Sahai Srivastava , Haoyu He

Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate…

Computation and Language · Computer Science 2024-06-06 Chen Qian , Yufan Dang , Jiahao Li , Wei Liu , Zihao Xie , Yifei Wang , Weize Chen , Cheng Yang , Xin Cong , Xiaoyin Che , Zhiyuan Liu , Maosong Sun

Open-ended self-improving agents can autonomously modify their own structural designs to advance their capabilities and overcome the limits of pre-defined architectures, thus reducing reliance on human intervention. We introduce…

Artificial Intelligence · Computer Science 2026-02-05 Zhaotian Weng , Antonis Antoniades , Deepak Nathani , Zhen Zhang , Xiao Pu , Xin Eric Wang

Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a…

Artificial Intelligence · Computer Science 2026-03-26 Bingqing Wei , Zhongyu Xia , Dingai Liu , Xiaoyu Zhou , Zhiwei Lin , Yongtao Wang

The dominant paradigm for building LLM based agents is the Agent Loop, an iterative cycle where a single language model decides what to do next by reading an ever growing context window. This paradigm has three structural weaknesses:…

Artificial Intelligence · Computer Science 2026-04-14 Hu Wei

Large Language Model (LLM)-based agents exhibit systemic failures in compositional generalization, limiting their robustness in interactive environments. This work introduces AGEL-Comp, a neuro-symbolic AI agent architecture designed to…

Artificial Intelligence · Computer Science 2026-04-30 Mahnoor Shahid , Hannes Rothe

LLM-based autonomous agents lack persistent procedural memory: they re-derive solutions from scratch even when structurally identical tasks have been solved before. We present APEX-EM, a non-parametric online learning framework that…

Computation and Language · Computer Science 2026-04-06 Pratyay Banerjee , Masud Moshtaghi , Ankit Chadha

LLM-based (Large Language Model) GUI (Graphical User Interface) agents can potentially reshape our daily lives significantly. However, current LLM-based GUI agents suffer from the scarcity of high-quality training data owing to the…

Artificial Intelligence · Computer Science 2025-05-26 Danyang Zhang , Situo Zhang , Ziyue Yang , Zichen Zhu , Zihan Zhao , Ruisheng Cao , Lu Chen , Kai Yu

Despite recent progress, Graphic User Interface (GUI) agents powered by Large Language Models (LLMs) struggle with complex mobile tasks due to limited app-specific knowledge. While UI Transition Graphs (UTGs) offer structured navigation…

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Online Reinforcement Learning (RL) offers a promising paradigm for enhancing GUI agents through direct environment interaction. However, its effectiveness is severely hindered by inefficient credit assignment in long-horizon tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

Large language model (LLM) based recommendation agents personalize what they know through evolving per-user semantic memory, yet how they reason remains a universal, static system prompt shared identically across all users. This asymmetry…

Information Retrieval · Computer Science 2026-04-22 Zhen Tao , Riwei Lai , Chenyun Yu , Weixin Chen , Li Chen , Beibei Kong , Lei Cheng , Chengxiang Zhuo , Zang Li , Qingqiang Sun

Skill libraries enable large language model agents to reuse experience from past interactions, but most existing libraries store skills as isolated entries and retrieve them only by semantic similarity. This leads to two key challenges for…

Computation and Language · Computer Science 2026-05-13 Xiaoyuan Li , Moxin Li , Keqin Bao , Yubo Ma , Wenjie Wang , Dayiheng Liu , Fuli Feng