English
Related papers

Related papers: HiveMind: Contribution-Guided Online Prompt Optimi…

200 papers

Large Language Models (LLMs) perform well in language tasks but often lack collaborative awareness and struggle to optimize global performance in multi-agent settings. We present a reinforcement learning-augmented LLM agent framework that…

Artificial Intelligence · Computer Science 2026-01-01 Dong Qiu , Duo Xu , Limengxi Yue

Large language model(LLM)-driven multi-agent systems(MAS) coordinate specialized agents through predefined interaction topologies and have shown promise for complex tasks such as competition-level code generation. Recent studies demonstrate…

Multiagent Systems · Computer Science 2026-02-20 Siyu Wang , Ruotian Lu , Zhihao Yang , Yuchao Wang , Yanzhou Zhang , Lei Xu , Qimin Xu , Guojun Yin , Cailian Chen , Xinping Guan

While large language models (LLMs) have recently made tremendous progress towards solving challenging AI problems, they have done so at increasingly steep computational and API costs. We propose a novel strategy where we combine multiple…

Machine Learning · Computer Science 2026-03-24 Wenwen Si , Sooyong Jang , Insup Lee , Osbert Bastani

Prompt-based offline methods are commonly used to optimize large language model (LLM) responses, but evaluating these responses is computationally intensive and often fails to accommodate diverse response styles. This study introduces a…

Human-Computer Interaction · Computer Science 2025-11-12 Xiangxiang Dai , Yuejin Xie , Maoli Liu , Xuchuang Wang , Zhuohua Li , Huanyu Wang , John C. S. Lui

Large language models (LLMs) have become widely adopted as automated judges for evaluating AI-generated content. Despite their success, aligning LLM-based evaluations with human judgments remains challenging. While supervised fine-tuning on…

Artificial Intelligence · Computer Science 2026-02-13 Bo Pan , Xuan Kan , Kaitai Zhang , Yan Yan , Shunwen Tan , Zihao He , Zixin Ding , Junjie Wu , Liang Zhao

Large Language Models (LLMs) have enabled dynamic reasoning in automated data analytics, yet recent multi-agent systems remain limited by rigid, single-path workflows that restrict strategic exploration and often lead to suboptimal…

Artificial Intelligence · Computer Science 2026-01-08 Wonduk Seo , Juhyeon Lee , Yanjun Shao , Qingshan Zhou , Seunghyun Lee , Yi Bu

Hierarchical multi-agent systems based on large language models (LLMs) have become a common paradigm for building AI assistants in vertical domains such as e-commerce, where a master agent coordinates multiple specialized sub-agents.…

Artificial Intelligence · Computer Science 2026-04-02 Junxing Hu , Ai Han , Haolan Zhan , Pu Wei , Zhiqian Zhang , Yuhang Guo , Jiawei Lu , Zhen Chen , Haoran Li , Zicheng Zhang

While the recommendation system (RS) has advanced significantly through deep learning, current RS approaches usually train and fine-tune models on task-specific datasets, limiting their generalizability to new recommendation tasks and their…

Information Retrieval · Computer Science 2024-03-22 Yancheng Wang , Ziyan Jiang , Zheng Chen , Fan Yang , Yingxue Zhou , Eunah Cho , Xing Fan , Xiaojiang Huang , Yanbin Lu , Yingzhen Yang

Large Language Model (LLM) agents often face significant credit assignment challenges in long-horizon, multi-step tasks due to sparse rewards. Existing value-free methods, such as Group Relative Policy Optimization (GRPO), encounter two…

Machine Learning · Computer Science 2026-03-11 Hui-Ze Tan , Xiao-Wen Yang , Hao Chen , Jie-Jing Shao , Yi Wen , Yuteng Shen , Weihong Luo , Xiku Du , Lan-Zhe Guo , Yu-Feng Li

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

We provide a distributed online algorithm for multi-agent submodular maximization under communication delays. We are motivated by the future distributed information-gathering tasks in unknown and dynamic environments, where utility…

Machine Learning · Computer Science 2026-03-31 Zirui Xu , Vasileios Tzoumas

With the rapid advancement of large language models and vision-language models, employing large models as Web Agents has become essential for automated web interaction. However, training Web Agents with reinforcement learning faces critical…

Machine Learning · Computer Science 2025-09-22 Ziyuan Chen , Zhenghui Zhao , Zhangye Han , Miancan Liu , Xianhang Ye , Yiqing Li , Hongbo Min , Jinkui Ren , Xiantao Zhang , Guitao Cao

Large language model (LLM)-based Multi-agent systems (MAS) have shown promise in tackling complex collaborative tasks, where agents are typically orchestrated via role-specific prompts. While the quality of these prompts is pivotal, jointly…

Artificial Intelligence · Computer Science 2026-05-11 Zhexuan Wang , Xuebo Liu , Li Wang , Zifei Shan , Yutong Wang , Zhenxi Song , Min Zhang

This paper re-examines the Shapley value methods for attribution analysis in the area of online advertising. As a credit allocation solution in cooperative game theory, Shapley value method directly quantifies the contribution of online…

Econometrics · Economics 2018-04-17 Kaifeng Zhao , Seyed Hanif Mahboobi , Saeed R. Bagheri

Collaborative multi-agent large language models (LLMs) can solve complex reasoning tasks by decomposing roles, but reinforcement learning for such systems is limited by credit assignment: shared terminal rewards obscure individual…

Artificial Intelligence · Computer Science 2026-05-27 Zhongyi Li , Wan Tian , Yikun Ban , Jinju Chen , Huiming Zhang , Yang Liu , Fuzhen Zhuang

Multi-agent applications often execute complex tasks as multi-stage workflows, where each stage is an LLM call whose output becomes part of context for subsequent steps. Existing LLM serving systems largely assume homogeneous clusters with…

Machine Learning · Computer Science 2026-03-24 Kangqi Ni , Wenyue Hua , Xiaoxiang Shi , Jiang Guo , Shiyu Chang , Tianlong Chen

We revisit multi-agent asynchronous online optimization with delays, where only one of the agents becomes active for making the decision at each round, and the corresponding feedback is received by all the agents after unknown delays.…

Machine Learning · Computer Science 2026-02-05 Lingchan Bao , Tong Wei , Yuanyu Wan

Large Language Models (LLMs) in agentic workflows combine multi-step reasoning, heterogeneous tool use, and collaboration across multiple specialized agents. Existing LLM serving engines optimize individual calls in isolation, while…

Databases · Computer Science 2026-01-21 Junyi Shen , Noppanat Wadlom , Yao Lu

Large language models (LLMs) have transformed software development through code generation capabilities, yet their effectiveness for high-performance computing (HPC) remains limited. HPC code requires specialized optimizations for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-26 Asif Rahman , Veljko Cvetkovic , Kathleen Reece , Aidan Walters , Yasir Hassan , Aneesh Tummeti , Bryan Torres , Denise Cooney , Margaret Ellis , Dimitrios S. Nikolopoulos

Multi-agent reinforcement learning is an area of rapid advancement in artificial intelligence and machine learning. One of the important questions to be answered is how to conduct credit assignment in a multi-agent system. There have been…

Multiagent Systems · Computer Science 2024-02-26 Jianhong Wang