English
Related papers

Related papers: Dr. Zero: Self-Evolving Search Agents without Trai…

200 papers

Artificial Intelligence (AI) significantly influences many fields, largely thanks to the vast amounts of high-quality data for machine learning models. The emphasis is now on a data-centric AI strategy, prioritizing data development over…

Artificial Intelligence · Computer Science 2024-07-29 Xu Yang , Haotian Chen , Wenjun Feng , Haoxue Wang , Zeqi Ye , Xinjie Shen , Xiao Yang , Shizhao Sun , Weiqing Liu , Jiang Bian

Large language models (LLMs) are increasingly being used to generate synthetic datasets for the evaluation and training of downstream models. However, prior work has noted that such generated data lacks diversity. In this paper, we propose…

Computation and Language · Computer Science 2026-04-29 Avinash Amballa , Yashas Malur Saidutta , Chi-Heng Lin , Vivek Kulkarni , Srinivas Chappidi

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Voice assistants, such as Siri and Google Assistant, typically model audio and text separately, resulting in lost speech information and increased complexity. Recent efforts to address this with end-to-end Speech Large Language Models…

Computation and Language · Computer Science 2024-10-04 William Held , Ella Li , Michael Ryan , Weiyan Shi , Yanzhe Zhang , Diyi Yang

The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and…

Artificial Intelligence · Computer Science 2026-01-01 Chunhui Wan , Xunan Dai , Zhuo Wang , Minglei Li , Yanpeng Wang , Yinan Mao , Yu Lan , Zhiwen Xiao

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

Large Language Model (LLM)-based web agents excel at knowledge-intensive tasks but face a fundamental conflict between the need for extensive exploration and the constraints of limited context windows. Current solutions typically rely on…

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time…

Artificial Intelligence · Computer Science 2026-03-17 Minhua Lin , Hanqing Lu , Zhan Shi , Bing He , Rui Mao , Zhiwei Zhang , Zongyu Wu , Xianfeng Tang , Hui Liu , Zhenwei Dai , Xiang Zhang , Suhang Wang , Benoit Dumoulin , Jian Pei

We present an autonomous large language model (LLM) agent for end-to-end, data-driven materials theory development. The model can choose an equation form, generate and run its own code, and test how well the theory matches the data without…

Artificial Intelligence · Computer Science 2026-04-23 Samuel Onimpa Alfred , Veera Sundararaghavan

The integration of Monte Carlo Tree Search (MCTS) with Large Language Models (LLMs) has demonstrated significant success in structured, problem-oriented tasks. However, applying these methods to open-ended dialogues, such as those in…

Computation and Language · Computer Science 2025-11-19 Hao Lu , Yanchi Gu , Haoyuan Huang , Yulin Zhou , Ningxin Zhu , Chen Li

Retrieval augmented generation (RAG) reduces hallucinations and factual errors in large language models (LLMs) by conditioning generation on retrieved external knowledge. Recent search agents further cast RAG as an autonomous, multi-turn…

Computation and Language · Computer Science 2026-03-05 Jian Li , Yizhang Jin , Dongqi Liu , Hang Ding , Jiafu Wu , Dongsheng Chen , Yunhang Shen , Yulei Qin , Ying Tai , Chengjie Wang , Xiaotong Yuan , Yabiao Wang

Conventional agent systems often struggle in open-ended environments where task distributions continuously drift and external supervision is scarce. Their reliance on static toolsets or offline training lags behind these dynamics, leaving…

Artificial Intelligence · Computer Science 2026-02-09 Haotian Li , Shijun Yang , Weizhen Qi , Silei Zhao , Rui Hua , Mingzhu Song , Xiaojian Yang , Chao Peng

In this white paper, we present AlphaEvolve, an evolutionary coding agent that substantially enhances capabilities of state-of-the-art LLMs on highly challenging tasks such as tackling open scientific problems or optimizing critical pieces…

Autonomous research agents can already run machine learning experiments without human supervision, but many rely on a narrow search strategy: they repeatedly modify one program and keep changes only when they improve the current best…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Ahmadreza Jeddi , Minh Ngoc Le , Hakki C. Karaimer , Konstantinos G. Derpanis , Babak Taati

Self-evolving large language models (LLMs) learn by generating their own training tasks and solutions, reducing reliance on human-curated supervision. However, in many reasoning domains, the model must also validate generated tasks and…

Artificial Intelligence · Computer Science 2026-05-28 Bowen Wei , Nan Wang , Yuqing Zhou , Jinhao Pan , Ziwei Zhu

Deep search agents have emerged as a promising paradigm for addressing complex information-seeking tasks, but their training remains challenging due to sparse rewards, weak credit assignment, and limited labeled data. Self-play offers a…

Machine Learning · Computer Science 2026-05-26 Yaocheng Zhang , Yuanheng Zhu , Wenyue Chong , Songjun Tu , Qichao Zhang , Jiajun Chai , Xiaohan Wang , Wei Lin , Guojun Yin , Dongbin Zhao

Current Autonomous Scientific Research (ASR) systems, despite leveraging large language models (LLMs) and agentic architectures, remain constrained by fixed workflows and toolsets that prevent adaptation to evolving tasks and environments.…

Artificial Intelligence · Computer Science 2026-04-01 Martin Legrand , Tao Jiang , Matthieu Feraud , Benjamin Navet , Yousouf Taghzouti , Fabien Gandon , Elise Dumont , Louis-Félix Nothias

Large Language Model (LLM)-based optimization has recently shown promise for autonomous problem solving, yet most approaches still cast LLMs as passive constraint checkers rather than proactive strategy designers, limiting their…

Artificial Intelligence · Computer Science 2026-04-06 Beidan Liu , Zhengqiu Zhu , Chen Gao , Tianle Pu , Yong Zhao , Wei Qi , Quanjun Yin

Co-evolutionary self-play, where one language model generates problems and another solves them, promises autonomous curriculum learning without human supervision. In practice, the proposer quickly converges to a narrow distribution of…

Computation and Language · Computer Science 2026-04-29 Jacob Dineen , Aswin RRV , Zhikun Xu , Ben Zhou

Building generalist agents that can handle diverse tasks and evolve themselves across different environments is a long-term goal in the AI community. Large language models (LLMs) are considered a promising foundation to build such agents…