English
Related papers

Related papers: Multi-Value Alignment in Normative Multi-Agent Sys…

200 papers

Reinforcement learning with verifiable rewards (RLVR) has achieved remarkable success in logical reasoning tasks, yet whether large language model (LLM) alignment requires fundamentally different approaches remains unclear. Given the…

Artificial Intelligence · Computer Science 2026-03-12 Zhaowei Zhang , Xiaohan Liu , Xuekai Zhu , Junchao Huang , Ceyao Zhang , Zhiyuan Feng , Yaodong Yang , Xiaoyuan Yi , Xing Xie

This paper proposes a definition of system health in the context of multiple agents optimizing a joint reward function. We use this definition as a credit assignment term in a policy gradient algorithm to distinguish the contributions of…

Machine Learning · Computer Science 2021-01-06 Ross E. Allen , Jayesh K. Gupta , Jaime Pena , Yutai Zhou , Javona White Bear , Mykel J. Kochenderfer

As agentic AI becomes more widespread, agents with distinct and possibly conflicting goals will interact in complex ways. These multi-agent interactions pose a fundamental challenge, particularly in social dilemmas, where agents' individual…

Machine Learning · Computer Science 2025-12-02 Dereck Piche , Mohammed Muqeeth , Milad Aghajohari , Juan Duque , Michael Noukhovitch , Aaron Courville

The staggering feats of AI systems have brought to attention the topic of AI Alignment: aligning a "superintelligent" AI agent's actions with humanity's interests. Many existing frameworks/algorithms in alignment study the problem on a…

Machine Learning · Computer Science 2024-10-22 Hong Jun Jeon , Benjamin Van Roy

Orchestrated multi-agent systems represent the next stage in the evolution of artificial intelligence, where autonomous agents collaborate through structured coordination and communication to achieve complex, shared objectives. This paper…

Multiagent Systems · Computer Science 2026-01-21 Apoorva Adimulam , Rajesh Gupta , Sumit Kumar

In this paper, we consider the problem of large scale multi agent reinforcement learning. Firstly, we studied the representation problem of the pairwise value function to reduce the complexity of the interactions among agents. Secondly, we…

Machine Learning · Computer Science 2020-01-13 Weiya Ren

Heterogeneous networks comprise agents with varying capabilities in terms of computation, storage, and communication. In such settings, it is crucial to factor in the operating characteristics in allowing agents to choose appropriate…

Optimization and Control · Mathematics 2022-09-07 Yichuan Li , Petros Voulgaris , Nikolaos M. Freris

Moral judgment is integral to large language models' (LLMs) social reasoning. As multi-agent systems gain prominence, it becomes crucial to understand how LLMs function when collaborating compared to operating as individual agents. In human…

Computation and Language · Computer Science 2025-10-30 Anita Keshmirian , Razan Baltaji , Babak Hemmatian , Hadi Asghari , Lav R. Varshney

In value-based reinforcement learning (RL), unlike in supervised learning, the agent faces not a single, stationary, approximation problem, but a sequence of value prediction problems. Each time the policy improves, the nature of the…

Machine Learning · Computer Science 2021-01-05 Will Dabney , André Barreto , Mark Rowland , Robert Dadashi , John Quan , Marc G. Bellemare , David Silver

As agents based on large language models are increasingly deployed to long-horizon tasks, maintaining their alignment with stakeholder preferences becomes critical. Effective alignment in such settings requires reward models that are…

Artificial Intelligence · Computer Science 2025-12-09 Charlie Masters , Marta Grześkiewicz , Stefano V. Albrecht

In this paper I present several algorithmic techniques for improving the decision process of multiple types of agents behaving in environments where their interests are in conflict. The interactions between the agents are modelled by using…

Computer Science and Game Theory · Computer Science 2009-08-04 Mugurel Ionut Andreica

Explainable AI techniques that describe agent reward functions can enhance human-robot collaboration in a variety of settings. One context where human understanding of agent reward functions is particularly beneficial is in the value…

Robotics · Computer Science 2021-10-11 Lindsay Sanneman , Julie Shah

In this paper, we study a distributed optimization problem for a class of high-order multi-agent systems with unknown dynamics. In comparison with existing results for integrators or linear agents, we need to overcome the difficulties…

Optimization and Control · Mathematics 2019-02-05 Yutao Tang

In the literature of mitigating unfairness in machine learning, many fairness measures are designed to evaluate predictions of learning models and also utilised to guide the training of fair models. It has been theoretically and empirically…

Machine Learning · Computer Science 2024-09-29 Qingquan Zhang , Jialin Liu , Zeqi Zhang , Junyi Wen , Bifei Mao , Xin Yao

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been…

Artificial Intelligence · Computer Science 2017-09-28 Markus Wulfmeier , Ingmar Posner , Pieter Abbeel

The beneficial effects of treatments vary across individuals in most studies. Treatment heterogeneity motivates practitioners to search for the optimal policy based on personal characteristics. A long-standing common practice in policy…

Statistics Theory · Mathematics 2025-01-06 Xuqiao Li , Ying Yan

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

Motivated by the development of dynamics in probability spaces, we propose a novel multi-agent dynamic of consensus type where each agent is a probability measure. The agents move instantaneously towards a weighted barycenter of the…

Analysis of PDEs · Mathematics 2024-07-10 Giacomo Borghi , Michael Herty , Andrey Stavitskiy

Real-world recommender systems often need to balance multiple objectives when deciding which recommendations to present to users. These include behavioural signals (e.g. clicks, shares, dwell time), as well as broader objectives (e.g.…

Information Retrieval · Computer Science 2024-09-17 Olivier Jeunen , Jatin Mandav , Ivan Potapov , Nakul Agarwal , Sourabh Vaid , Wenzhe Shi , Aleksei Ustimenko

As Large Language Models (LLM) based multi-agent systems become increasingly prevalent, the collective behaviors, e.g., collective intelligence, of such artificial communities have drawn growing attention. This work aims to answer a…

Artificial Intelligence · Computer Science 2025-12-12 Muhua Huang , Qinlin Zhao , Xiaoyuan Yi , Xing Xie