中文
相关论文

相关论文: CATArena: Evaluating Evolutionary Capabilities of …

200 篇论文

Large language models are increasingly deployed as multi-agent systems, where specialized roles communicate and collaborate through structured interactions to solve complex tasks that often exceed the capacity of a single agent. However,…

计算与语言 · 计算机科学 2026-01-28 Yimeng Wang , Jiaxing Zhao , Hongbin Xie , Hexing Ma , Yuzhen Lei , Shuangxue Liu , Xuan Song , Zichen Zhang , Haoran Zhang

Large Language Models (LLMs) such as GPT-4 have demonstrated their ability to understand natural language and generate complex code snippets. This paper introduces a novel Large Language Model Evolutionary Algorithm (LLaMEA) framework,…

神经与进化计算 · 计算机科学 2025-01-31 Niki van Stein , Thomas Bäck

Large language models have recently demonstrated remarkable abilities to self-correct their responses through iterative refinement, often referred to as self-consistency or self-reflection. However, the dynamics of this self-correction…

计算与语言 · 计算机科学 2025-11-13 Hossein A. Rahmani , Satyapriya Krishna , Xi Wang , Mohammadmehdi Naghiaei , Emine Yilmaz

TextArena is an open-source collection of competitive text-based games for training and evaluation of agentic behavior in Large Language Models (LLMs). It spans 57+ unique environments (including single-player, two-player, and multi-player…

计算与语言 · 计算机科学 2025-05-27 Leon Guertler , Bobby Cheng , Simon Yu , Bo Liu , Leshem Choshen , Cheston Tan

Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data…

编程语言 · 计算机科学 2025-12-04 Le Chen , Nuo Xu , Winson Chen , Bin Lei , Pei-Hung Lin , Dunzhi Zhou , Rajeev Thakur , Caiwen Ding , Ali Jannesari , Chunhua Liao

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

人工智能 · 计算机科学 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

In this paper, we present a novel framework for enhancing the capabilities of large language models (LLMs) by leveraging the power of multi-agent systems. Our framework introduces a collaborative environment where multiple intelligent agent…

人工智能 · 计算机科学 2023-06-07 Yashar Talebirad , Amirhossein Nadiri

Model ensemble is a useful approach in reinforcement learning (RL) for training effective agents. Despite wide success of RL, training effective agents remains difficult due to the multitude of factors requiring careful tuning, such as…

机器学习 · 计算机科学 2025-05-22 Yiwen Song , Qianyue Hao , Qingmin Liao , Jian Yuan , Yong Li

Large Language Models (LLMs) have made significant progress in handling complex programming tasks. However, current methods rely on manual model selection and fixed workflows, which limit their ability to adapt to changing task…

软件工程 · 计算机科学 2026-03-18 Yulin Peng , Haowen Hou , Xinxin Zhu , Ying Tiffany He , F. Richard Yu

Self-evolving large language model (LLM) agents continually improve by accumulating and reusing past experience, yet it remains unclear whether they faithfully rely on that experience to guide their behavior. We present the first systematic…

计算与语言 · 计算机科学 2026-02-10 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yang Deng , Yanyan Zhao , Wanxiang Che , Bing Qin , Ting Liu

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

人工智能 · 计算机科学 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

This paper presents a novel approach for unified retrieval-augmented generation (RAG) systems using the recent emerging large language model (LLM) agent concept. Specifically, Agent LLM, which utilizes LLM as fundamental controllers, has…

计算与语言 · 计算机科学 2025-06-02 Hoang Pham , Thuy-Duong Nguyen , Khac-Hoai Nam Bui

Autonomous agents can adapt their behaviour to changing environments, but remain bound to requirements, goals, and capabilities fixed at design time, preventing genuine software evolution. This paper introduces self-evolving software…

软件工程 · 计算机科学 2026-05-01 Marco Robol , Paolo Giorgini

Pre-trained large language models (LLMs) exhibit powerful capabilities for generating natural text. Evolutionary algorithms (EAs) can discover diverse solutions to complex real-world problems. Motivated by the common collective and…

神经与进化计算 · 计算机科学 2025-03-10 Chao Wang , Jiaxuan Zhao , Licheng Jiao , Lingling Li , Fang Liu , Shuyuan Yang

By formally defining the training processes of large language models (LLMs), which usually encompasses pre-training, supervised fine-tuning, and reinforcement learning with human feedback, within a single and unified machine learning…

计算与语言 · 计算机科学 2024-02-14 Yang Liu , Peng Sun , Hang Li

Large language models (LLMs) are increasingly deployed as task-oriented agents, where success depends on their ability to generate accurate function calls under realistic, multilingual conditions. However, existing agent evaluations largely…

计算与语言 · 计算机科学 2025-09-19 Thales Sales Almeida , João Guilherme Alves Santos , Thiago Laitz , Giovana Kerche Bonás

Traditional control system design, reliant on expert knowledge and precise models, struggles with complex, nonlinear, or uncertain dynamics. This paper introduces AgenticControl, a novel multi-agent framework that automates controller…

系统与控制 · 电气工程与系统科学 2025-06-25 Mohammad Narimani , Seyyed Ali Emami

Automating unit test generation remains a significant challenge, particularly for complex methods in real-world projects. While Large Language Models (LLMs) have made strides in code generation, they struggle to achieve high branch coverage…

软件工程 · 计算机科学 2025-09-01 Sijia Gu , Noor Nashid , Ali Mesbah

Reinforcement learning (RL) for large language models (LLMs) increasingly relies on sparse, outcome-level rewards -- yet determining which actions within a long trajectory caused the outcome remains difficult. This credit assignment (CA)…

计算与语言 · 计算机科学 2026-04-14 Chenchen Zhang

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

人工智能 · 计算机科学 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li