English
Related papers

Related papers: Multi-Value Alignment in Normative Multi-Agent Sys…

200 papers

Developing value-aligned AI agents is a complex undertaking and an ongoing challenge in the field of AI. Specifically within the domain of Large Language Models (LLMs), the capability to consolidate multiple independently trained dialogue…

We study a multi-agent decision problem in population games, where agents select from multiple available strategies and continually revise their selections based on the payoffs associated with these strategies. Unlike conventional…

Multiagent Systems · Computer Science 2024-09-17 Shinkyu Park

In an effort to regulate Machine Learning-driven (ML) systems, current auditing processes mostly focus on detecting harmful algorithmic biases. While these strategies have proven to be impactful, some values outlined in documents dealing…

Machine Learning · Computer Science 2022-06-20 Mireia Yurrita , Dave Murray-Rust , Agathe Balayn , Alessandro Bozzon

Alignment in artificial intelligence pursues the consistency between model responses and human preferences as well as values. In practice, the multifaceted nature of human preferences inadvertently introduces what is known as the "alignment…

Computation and Language · Computer Science 2024-10-14 Yiju Guo , Ganqu Cui , Lifan Yuan , Ning Ding , Zexu Sun , Bowen Sun , Huimin Chen , Ruobing Xie , Jie Zhou , Yankai Lin , Zhiyuan Liu , Maosong Sun

Large-scale language technologies are increasingly used in various forms of communication with humans across different contexts. One particular use case for these technologies is conversational agents, which output natural language text in…

Computers and Society · Computer Science 2022-12-22 Atoosa Kasirzadeh , Iason Gabriel

Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a…

Populations and Evolution · Quantitative Biology 2016-09-01 Christoph Adami , Jory Schossau , Arend Hintze

A hybrid evolutionary algorithm with importance sampling method is proposed for multi-dimensional optimization problems in this paper. In order to make use of the information provided in the search process, a set of visited solutions is…

Neural and Evolutionary Computing · Computer Science 2013-08-26 Guanghui Huang , Zhifeng Pan

In this paper, we consider the problem of path finding for a set of homogeneous and autonomous agents navigating a previously unknown stochastic environment. In our problem setting, each agent attempts to maximize a given utility function…

Multiagent Systems · Computer Science 2022-12-06 Sheryl Paul , Jyotirmoy V. Deshmukh

Emerging research in Pluralistic Artificial Intelligence (AI) alignment seeks to address how intelligent systems can be designed and deployed in accordance with diverse human needs and values. We contribute to this pursuit with a dynamic…

Machine Learning · Computer Science 2024-11-01 Hadassah Harland , Richard Dazeley , Peter Vamplew , Hashini Senaratne , Bahareh Nakisa , Francisco Cruz

Finding the optimal parameter setting (i.e. the optimal population size, the optimal mutation probability, the optimal evolutionary model etc) for an Evolutionary Algorithm (EA) is a difficult task. Instead of evolving only the parameters…

Neural and Evolutionary Computing · Computer Science 2021-09-29 Mihai Oltean , Crina Groşan

We investigate two representation alternatives for the controllers of teams of cyber agents. We combine these controller representations with different evolutionary algorithms, one of which introduces a novel LLM-supported mutation…

Neural and Evolutionary Computing · Computer Science 2025-07-09 Erik Hemberg , Eric Liu , Lucille Fuller , Stephen Moskal , Una-May O'Reilly

Ambient Intelligence aims to offer personalized services and easier ways of interaction between people and systems. Since several users and systems may coexist in these environments, it is quite possible that entities with opposing…

Multiagent Systems · Computer Science 2016-04-19 Victor Sanchez-Anguix , Soledad Valero , Vicente Julian , Vicente Botti , Ana Garcia-Fornes

The numerous deployed Artificial Intelligence systems need to be aligned with our ethical considerations. However, such ethical considerations might change as time passes: our society is not fixed, and our social mores evolve. This makes it…

Machine Learning · Computer Science 2023-07-04 Rémy Chaput , Olivier Boissier , Mathieu Guillermin

Cooperation in an open dynamic system fundamentally depends upon information distributed across its components. Yet in an environment with rapidly enlarging complexity, this information may need to change adaptively to enable not only…

Physics and Society · Physics 2021-04-06 Wonhee Jeong , Tarik Hadzibeganovic , Unjong Yu

Value-aware AI should recognise human values and adapt to the value systems (value-based preferences) of different users. This requires operationalization of values, which can be prone to misspecification. The social nature of values…

Artificial Intelligence · Computer Science 2026-02-12 Andrés Holgado-Sánchez , Peter Vamplew , Richard Dazeley , Sascha Ossowski , Holger Billhardt

Creating diverse sets of high quality solutions has become an important problem in recent years. Previous works on diverse solutions problems consider solutions' objective quality and diversity where one is regarded as the optimization goal…

Neural and Evolutionary Computing · Computer Science 2024-01-17 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

We focus on creating agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games -- environments wherein an agent perceives and interacts with a world through natural language. Such…

Computation and Language · Computer Science 2022-05-06 Prithviraj Ammanabrolu , Liwei Jiang , Maarten Sap , Hannaneh Hajishirzi , Yejin Choi

This paper deals with solving distributed optimization problems with equality constraints by a class of uncertain nonlinear heterogeneous dynamic multi-agent systems. It is assumed that each agent with an uncertain dynamic model has limited…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Mohammad Saeed Sarafraz , Mohammad Saleh Tavazoei

One obstacle to applying reinforcement learning algorithms to real-world problems is the lack of suitable reward functions. Designing such reward functions is difficult in part because the user only has an implicit understanding of the task…

Machine Learning · Computer Science 2018-11-20 Jan Leike , David Krueger , Tom Everitt , Miljan Martic , Vishal Maini , Shane Legg

AI alignment considers how we can encode AI systems in a way that is compatible with human values. The normative side of this problem asks what moral values or principles, if any, we should encode in AI. To this end, we present a framework…

Computers and Society · Computer Science 2023-01-11 Betty Li Hou , Brian Patrick Green