English
Related papers

Related papers: CyberEvolver: Structured Self-Evolution for Cybers…

200 papers

Long-term memory is essential for LLM agents that operate across multiple sessions, yet existing memory systems treat retrieval infrastructure as fixed: stored content evolves while scoring functions, fusion strategies, and…

Machine Learning · Computer Science 2026-05-15 Jiaqi Liu , Xinyu Ye , Peng Xia , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Traditional self-adaptive systems automatically reconfigure existing components in response to changing requirements, but provide limited support for the generation of novel functionalities. The software generation capabilities of large…

Software Engineering · Computer Science 2026-04-21 Md Asif Iqbal Fahim , Oluwadamilola Adebayo , Alessio Ferrari

Reinforcement learning for LLM agents is typically conducted on a static data distribution, which fails to adapt to the agent's evolving behavior and leads to poor coverage of complex environment interactions. To address these challenges,…

Computation and Language · Computer Science 2026-04-20 Shidong Yang , Ziyu Ma , Tongwen Huang , Yiming Hu , Yong Wang , Xiangxiang Chu

Artificial Intelligence (AI) agents have evolved from passive predictive tools into active entities capable of autonomous decision-making and environmental interaction, driven by the reasoning capabilities of Large Language Models (LLMs).…

Cryptography and Security · Computer Science 2026-03-24 Xiaolei Zhang , Lu Zhou , Xiaogang Xu , Jiafei Wu , Tianyu Du , Heqing Huang , Hao Peng , Zhe Liu

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time…

Artificial Intelligence · Computer Science 2026-03-17 Minhua Lin , Hanqing Lu , Zhan Shi , Bing He , Rui Mao , Zhiwei Zhang , Zongyu Wu , Xianfeng Tang , Hui Liu , Zhenwei Dai , Xiang Zhang , Suhang Wang , Benoit Dumoulin , Jian Pei

This paper presents a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models (LLMs), aiming for a more accurate assessment of their capabilities and limitations. We utilize a multi-agent system to…

Computation and Language · Computer Science 2024-02-20 Siyuan Wang , Zhuohan Long , Zhihao Fan , Zhongyu Wei , Xuanjing Huang

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Context: Large Language Models (LLMs) rely on static, pre-deployment safety mechanisms that cannot adapt to adversarial threats discovered after release. Objective: To design a software architecture enabling LLM-based systems to…

Software Engineering · Computer Science 2026-04-03 Tyler Slater

Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions, thus enabling adaptation to novel tasks at deployment time. This process places…

Artificial Intelligence · Computer Science 2026-05-12 Zhiyuan Fan , Wenwei Jin , Feng Zhang , Bin Li , Yihong Dong , Yao Hu , Jiawei Li

In recent years, the landscape of software threats has become significantly more dynamic and distributed. Security vulnerabilities are no longer discovered and shared only through formal channels such as public vulnerability databases or…

Software Engineering · Computer Science 2025-10-07 Chengwei Liu , Wenbo Guo , Yuxin Zhang , Limin Wang , Sen Chen , Lei Bu , Yang Liu

Personal AI agents like OpenClaw run with elevated privileges on users' local machines, where a single successful prompt injection can leak credentials, redirect financial transactions, or destroy files. This threat goes well beyond…

Artificial Intelligence · Computer Science 2026-04-07 Bowen Wei , Yunbei Zhang , Jinhao Pan , Kai Mei , Xiao Wang , Jihun Hamm , Ziwei Zhu , Yingqiang Ge

From formal and practical analysis, we identify new challenges that self-adaptive systems pose to the process of quality assurance. When tackling these, the effort spent on various tasks in the process of software engineering is naturally…

Software Engineering · Computer Science 2019-02-14 Thomas Gabor , Marie Kiermeier , Andreas Sedlmeier , Bernhard Kempter , Cornel Klein , Horst Sauer , Reiner Schmid , Jan Wieghardt

The past two years have witnessed the evolution of large language model (LLM)-based multi-agent systems from labor-intensive manual design to partial automation (\textit{e.g.}, prompt engineering, communication topology) and eventually to…

Machine Learning · Computer Science 2025-02-12 Guibin Zhang , Kaijie Chen , Guancheng Wan , Heng Chang , Hong Cheng , Kun Wang , Shuyue Hu , Lei Bai

Automated intrusion-style workflows require LLM agents to reason over partial observations, tool outputs, and executable artifacts under bounded budgets. A single LLM instance often compresses evidence extraction, planning, execution, and…

Cryptography and Security · Computer Science 2026-05-12 Minfeng Qi , Tianqing Zhu , Zijie Xu , Congcong Zhu , Qin Wang , Wanlei Zhou

LLM-powered tool-calling agents fulfill user requests by interacting with environments, querying data, and invoking tools in a multi-turn process. Yet, most existing benchmarks evaluate these systems under static environment interfaces,…

Claw-style environments support multi-step workflows over local files, tools, and persistent workspace states. However, scalable development around these environments remains constrained by the absence of a systematic framework, especially…

Computation and Language · Computer Science 2026-05-19 Fei Bai , Huatong Song , Shuang Sun , Daixuan Cheng , Yike Yang , Chuan Hao , Renyuan Li , Feng Chang , Yuan Wei , Ran Tao , Bryan Dai , Jian Yang , Wayne Xin Zhao , Ji-Rong Wen

Anthropic proposes the concept of skills for LLM agents to tackle multi-step professional tasks that simple tool invocations cannot address. A tool is a single, self-contained function, whereas a skill is a structured bundle of…

Enterprise routers assign queries to expert agents, yet deployed profiles stay static while agents evolve (prompts, tools, models), and developers rarely keep descriptions or exemplars current. We present FlyRoute, a self-evolving profiling…

Computation and Language · Computer Science 2026-05-22 Rongjun Li , Ziyu Zhou , Yihang Wu

Self-evolving LLM agents update their internal state across sessions, often by writing and reusing long-term memory. This design improves performance on long-horizon tasks but creates a security risk: untrusted external content observed…

Cryptography and Security · Computer Science 2026-03-06 Xianglin Yang , Yufei He , Shuo Ji , Bryan Hooi , Jin Song Dong

While LLM-based agents have shown promise for deep research, most existing approaches rely on fixed workflows that struggle to adapt to real-world, open-ended queries. Recent work therefore explores self-evolution by allowing agents to…

Artificial Intelligence · Computer Science 2026-02-05 Shuo Zhang , Chaofa Yuan , Ryan Guo , Xiaomin Yu , Rui Xu , Zhangquan Chen , Zinuo Li , Zhi Yang , Shuhao Guan , Zhenheng Tang , Sen Hu , Liwen Zhang , Ronghao Chen , Huacan Wang