English
Related papers

Related papers: Multi-Agent Sampling: Scaling Inference Compute fo…

200 papers

Agentic AI aims to create systems that set their own goals, adapt proactively to change, and refine behavior through continuous experience. Recent advances suggest that, when facing multiple and unforeseen tasks, agents could benefit from…

The rise of short-form video platforms and the emergence of multimodal large language models (MLLMs) have amplified the need for scalable, effective, zero-shot text-to-video retrieval systems. While recent advances in large-scale…

Information Retrieval · Computer Science 2026-02-24 Jiaxin Wu , Xiao-Yong Wei , Qing Li

Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent…

Multiagent Systems · Computer Science 2023-12-27 Jiawei Wang , Jian Zhao , Zhengtao Cao , Ruili Feng , Rongjun Qin , Yang Yu

Large language models (LLMs) deployed as agents introduce significant safety risks in clinical settings due to their potential for error and single points of failure. We introduce Tiered Agentic Oversight (TAO), a hierarchical multi-agent…

Temporally extended actions improve the ability to explore and plan in single-agent settings. In multi-agent settings, the exponential growth of the joint state space with the number of agents makes coordinated behaviours even more…

Machine Learning · Computer Science 2026-04-21 Raul D. Steleac , Mohan Sridharan , David Abel

Recent advances in large language models (LLMs) demonstrate substantial capabilities in natural language understanding and generation tasks. With the growing number of LLMs, how to harness the collective expertise of multiple LLMs is an…

Computation and Language · Computer Science 2024-06-10 Junlin Wang , Jue Wang , Ben Athiwaratkun , Ce Zhang , James Zou

Test-time scaling has become a standard way to improve performance and boost reliability of neural network models. However, its behavior on agentic, multi-step tasks remains less well-understood: small per-step errors can compound over long…

Artificial Intelligence · Computer Science 2026-02-13 Nicholas Lee , Lutfi Eren Erdogan , Chris Joseph John , Surya Krishnapillai , Michael W. Mahoney , Kurt Keutzer , Amir Gholami

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Multi-agent systems require effective coordination between groups and individuals to achieve common goals. However, current multi-agent reinforcement learning (MARL) methods primarily focus on improving individual policies and do not…

Multiagent Systems · Computer Science 2023-07-31 Jingqing Ruan , Xiaotian Hao , Dong Li , Hangyu Mao

Prompt optimization has become a practical way to improve the performance of Large Language Models (LLMs) without retraining. However, most existing frameworks treat evaluation as a black box, relying solely on outcome scores without…

Multiagent Systems · Computer Science 2026-04-01 Wonduk Seo , Juhyeon Lee , Junseo Koh , Wonseok Choi , Hyunjin An , Jian Park , Seunghyun lee , Haihua Chen , Yi Bu

Process models are frequently used in software engineering to describe business requirements, guide software testing and control system improvement. However, traditional process modeling methods often require the participation of numerous…

Artificial Intelligence · Computer Science 2024-08-08 Leilei Lin , Yumeng Jin , Yingming Zhou , Wenlong Chen , Chen Qian

As the development of Large Language Models (LLMs) shifts from parameter scaling to inference-time collaboration, the Mixture-of-Agents (MoA) framework has emerged as a general paradigm to harness collective intelligence by layering diverse…

Computation and Language · Computer Science 2026-01-26 Jianyu Wen , Yang Wei , Xiongxi Yu , Changxuan Xiao , Ke Zeng

Scaling the amount of compute used to train language models has dramatically improved their capabilities. However, when it comes to inference, we often limit models to making only one attempt at a problem. Here, we explore inference compute…

Machine Learning · Computer Science 2025-01-03 Bradley Brown , Jordan Juravsky , Ryan Ehrlich , Ronald Clark , Quoc V. Le , Christopher Ré , Azalia Mirhoseini

Self-improvement, where models improve beyond their current performance without external supervision, remains a challenge. The core difficulty is sourcing a training signal stronger than what the model itself can currently produce. Majority…

Artificial Intelligence · Computer Science 2026-02-02 Ankur Samanta , Akshayaa Magesh , Runzhe Wu , Ayush Jain , Youliang Yu , Daniel Jiang , Boris Vidolov , Paul Sajda , Yonathan Efroni , Kaveh Hassani

Task-specialized models form the backbone of agentic healthcare systems, enabling the agents to answer clinical queries across tasks such as disease diagnosis, localization, and report generation. Yet, for a given task, a single "best"…

Machine Learning · Computer Science 2026-02-17 Pramit Saha , Joshua Strong , Mohammad Alsharid , Divyanshu Mishra , J. Alison Noble

In numerous settings, agents lack sufficient data to directly learn a model. Collaborating with other agents may help, but it introduces a bias-variance trade-off, when local data distributions differ. A key challenge is for each agent to…

Machine Learning · Computer Science 2025-02-20 Franco Galante , Giovanni Neglia , Emilio Leonardi

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Most recent state-of-the-art (SOTA) large language models (LLMs) use Mixture-of-Experts (MoE) architectures to scale model capacity without proportional per-token compute, enabling higher-quality outputs at manageable serving costs.…

Multi-agent systems for resource allocation (MRAs) have been introduced as a concept for modelling competitive resource allocation problems in distributed computing. An MRA is composed of a set of agents and a set of resources. Each agent…

Multiagent Systems · Computer Science 2022-09-21 Nils Timm , Josua Botha

Model fusion is a key strategy for robust recognition in unconstrained scenarios, as different models provide complementary strengths. This is especially important for whole-body human recognition, where biometric cues such as face, gait,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jie Zhu , Xiao Guo , Yiyang Su , Anil Jain , Xiaoming Liu