English
Related papers

Related papers: DemoEvolve: Overcoming Sparse Feedback in Agentic …

200 papers

Deploying language-model agents in production often requires substantial compute and human effort to tune prompts, parsers, validators, and other components of the agent pipeline. Self-evolution offers a promising alternative, but most…

Machine Learning · Computer Science 2026-05-25 Chen Ling , Pei Chen , Albert Guan , Jiaming Qu , Shayan Ali Akbar , Madhu Gopinathan , Erwin Cornejo

Large Language Models (LLMs) have emerged as powerful operators for evolutionary search, yet the design of efficient search scaffolds remains ad hoc. While promising, current LLM-in-the-loop systems lack a systematic approach to managing…

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Jinghan He , Junfeng Fang , Feng Xiong , Zijun Yao , Fei Shen , Haiyun Guo , Jinqiao Wang , Tat-Seng Chua

We introduce Learning to Self-Evolve (LSE), a reinforcement learning framework that trains large language models (LLMs) to improve their own contexts at test time. We situate LSE in the setting of test-time self-evolution, where a model…

Computation and Language · Computer Science 2026-03-20 Xiaoyin Chen , Canwen Xu , Yite Wang , Boyi Liu , Zhewei Yao , Yuxiong He

Large language models are transforming systems research by automating the discovery of performance-critical algorithms for computer systems. Despite plausible codes generated by LLMs, producing solutions that meet the stringent correctness…

Machine Learning · Computer Science 2026-02-04 Hongyuan Su , Yu Zheng , Yong Li

Fine-tuning large pre-trained language models with Evol-Instruct has achieved encouraging results across a wide range of tasks. However, designing effective evolving methods for instruction evolution requires substantial human expertise.…

Computation and Language · Computer Science 2024-06-04 Weihao Zeng , Can Xu , Yingxiu Zhao , Jian-Guang Lou , Weizhu Chen

We introduce Evolutionary Ensemble (EvE), a decentralized framework that organizes existing, highly capable coding agents into a live, co-evolving system for algorithmic discovery. Rather than reinventing the wheel within the "LLMs as…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Zongmin Yu , Liu Yang

Agent self-improvement, where the backbone Large Language Model (LLM) of the agent are trained on trajectories sampled autonomously based on their own policies, has emerged as a promising approach for enhancing performance. Recent…

Computation and Language · Computer Science 2025-08-22 Tianqing Fang , Hongming Zhang , Zhisong Zhang , Kaixin Ma , Wenhao Yu , Haitao Mi , Dong Yu

Long-term memory is essential for LLM agents that operate across multiple sessions, yet existing memory systems treat retrieval infrastructure as fixed: stored content evolves while scoring functions, fusion strategies, and…

Machine Learning · Computer Science 2026-05-15 Jiaqi Liu , Xinyu Ye , Peng Xia , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

Robotics · Computer Science 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

LLM-powered tool-calling agents fulfill user requests by interacting with environments, querying data, and invoking tools in a multi-turn process. Yet, most existing benchmarks evaluate these systems under static environment interfaces,…

Despite the significant advances in Deep Reinforcement Learning (RL) observed in the last decade, the amount of training experience necessary to learn effective policies remains one of the primary concerns in both simulated and real…

Robotics · Computer Science 2026-04-02 Manuel Serra Nunes , Atabak Dehban , Yiannis Demiris , José Santos-Victor

Deep reinforcement learning primarily focuses on learning behavior, usually overlooking the fact that an agent's function is largely determined by form. So, how should one go about finding a morphology fit for solving tasks in a given…

Machine Learning · Computer Science 2021-02-26 Donald J. Hejna , Pieter Abbeel , Lerrel Pinto

The rapid advancement of large language models (LLMs) has transformed the landscape of agentic information seeking capabilities through the integration of tools such as search engines and web browsers. However, current mainstream approaches…

Computation and Language · Computer Science 2025-05-29 Dingchu Zhang , Yida Zhao , Jialong Wu , Baixuan Li , Wenbiao Yin , Liwen Zhang , Yong Jiang , Yufeng Li , Kewei Tu , Pengjun Xie , Fei Huang

Recent advances in agentic systems increasingly treat code as an executable operational substrate rather than as a disposable output artifact. Prior work such as \emph{Code as Agent Harness} frames validated agent-generated artifacts as…

Software Engineering · Computer Science 2026-05-27 Mariano Garralda-Barrio

Conventional agent systems often struggle in open-ended environments where task distributions continuously drift and external supervision is scarce. Their reliance on static toolsets or offline training lags behind these dynamics, leaving…

Artificial Intelligence · Computer Science 2026-02-09 Haotian Li , Shijun Yang , Weizhen Qi , Silei Zhao , Rui Hua , Mingzhu Song , Xiaojian Yang , Chao Peng

Self-evolution is a central research topic in enabling large language model (LLM)-based agents to continually improve their capabilities after pretraining. Recent research has witnessed a transition from reinforcement learning (RL)-free to…

Computation and Language · Computer Science 2026-02-10 Xiangyuan Xue , Yifan Zhou , Guibin Zhang , Zaibin Zhang , Yijiang Li , Chen Zhang , Zhenfei Yin , Philip Torr , Wanli Ouyang , Lei Bai

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

Machine Learning · Computer Science 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

Simulation of population dynamics is a central research theme in computational biology, which contributes to understanding the interactions between predators and preys. Conventional mathematical tools of this theme, however, are incapable…

Multiagent Systems · Computer Science 2020-02-11 Jun Yamada , John Shawe-Taylor , Zafeirios Fountas