English
Related papers

Related papers: Learning the Value Systems of Societies with Prefe…

200 papers

We describe and study a model for an Automated Online Recommendation System (AORS) in which a user's preferences can be time-dependent and can also depend on the history of past recommendations and play-outs. The three key features of the…

Machine Learning · Computer Science 2016-03-31 Rahul Meshram , Aditya Gopalan , D. Manjunath

Existing multi-objective reinforcement learning (MORL) algorithms do not account for objectives that arise from players with differing beliefs. Concretely, consider two players with different beliefs and utility functions who may cooperate…

Artificial Intelligence · Computer Science 2017-05-16 Andrew Critch

We study group decision making with changing preferences as a Markov Decision Process. We are motivated by the increasing prevalence of automated decision-making systems when making choices for groups of people over time. Our main…

Multiagent Systems · Computer Science 2020-11-06 Kshitij Kulkarni , Sven Neth

One common approach to solve multi-objective reinforcement learning (MORL) problems is to extend conventional Q-learning by using vector Q-values in combination with a utility function. However issues can arise with this approach in the…

Machine Learning · Computer Science 2024-01-09 Kewen Ding , Peter Vamplew , Cameron Foale , Richard Dazeley

Value-alignment in normative multi-agent systems is used to promote a certain value and to ensure the consistent behaviour of agents in autonomous intelligent systems with human values. However, the current literature is limited to the…

Multiagent Systems · Computer Science 2023-10-13 Maha Riad , Vinicius de Carvalho , Fatemeh Golpayegani

In human society, the conflict between self-interest and collective well-being often obstructs efforts to achieve shared welfare. Related concepts like the Tragedy of the Commons and Social Dilemmas frequently manifest in our daily lives.…

Multiagent Systems · Computer Science 2025-06-17 Yue Jin , Shuangqing Wei , Giovanni Montana

In an effort to regulate Machine Learning-driven (ML) systems, current auditing processes mostly focus on detecting harmful algorithmic biases. While these strategies have proven to be impactful, some values outlined in documents dealing…

Machine Learning · Computer Science 2022-06-20 Mireia Yurrita , Dave Murray-Rust , Agathe Balayn , Alessandro Bozzon

Many governmental bodies are adopting AI policies for decision-making. In particular, Reinforcement Learning has been used to design policies that citizens would be expected to follow if implemented. Much RL work assumes that citizens…

Machine Learning · Computer Science 2025-10-28 Naina Balepur , Xingrui Pei , Hari Sundaram

Solving multi-objective optimization problems is important in various applications where users are interested in obtaining optimal policies subject to multiple, yet often conflicting objectives. A typical approach to obtain optimal policies…

Systems and Control · Electrical Eng. & Systems 2019-09-27 Huixin Zhan , Yongcan Cao

Customizing robotic behaviors to be aligned with diverse human preferences is an underexplored challenge in the field of embodied AI. In this paper, we present Promptable Behaviors, a novel framework that facilitates efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Minyoung Hwang , Luca Weihs , Chanwoo Park , Kimin Lee , Aniruddha Kembhavi , Kiana Ehsani

This paper introduces the concept of value awareness in AI, which goes beyond the traditional value-alignment problem. Our definition of value awareness presents us with a concise and simplified roadmap for engineering value-aware AI. The…

Artificial Intelligence · Computer Science 2025-12-16 Nardine Osman

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Many important behavior changes are frictionful; they require individuals to expend effort over a long period with little immediate gratification. Here, an artificial intelligence (AI) agent can provide personalized interventions to help…

Artificial Intelligence · Computer Science 2024-01-29 Eura Nofshin , Siddharth Swaroop , Weiwei Pan , Susan Murphy , Finale Doshi-Velez

In this work, we conduct an extensive empirical study of several deep reinforcement learning algorithms on two challenging combinatorial optimization problems: the job-shop and flexible job-shop scheduling problems, both fundamental…

Machine Learning · Computer Science 2025-12-01 Arthur Corrêa , Alexandre Jesus , Paulo Nascimento , Cristóvão Silva , Samuel Moniz

Current work in explainable reinforcement learning generally produces policies in the form of a decision tree over the state space. Such policies can be used for formal safety verification, agent behavior prediction, and manual inspection…

Machine Learning · Computer Science 2021-02-26 Nicholay Topin , Stephanie Milani , Fei Fang , Manuela Veloso

Robots operating in human-shared environments must not only achieve task-level navigation objectives such as safety and efficiency, but also adapt their behavior to human preferences. However, as human preferences are typically expressed in…

Robotics · Computer Science 2026-05-13 Tharun Sethuraman , Subham Agrawal , Nils Dengler , Jorge de Heuvel , Teena Hassan , Maren Bennewitz

Social alignment in AI systems aims to ensure that these models behave according to established societal values. However, unlike humans, who derive consensus on value judgments through social interaction, current language models (LMs) are…

Computation and Language · Computer Science 2023-10-31 Ruibo Liu , Ruixin Yang , Chenyan Jia , Ge Zhang , Denny Zhou , Andrew M. Dai , Diyi Yang , Soroush Vosoughi

Minimizing negative impacts of Artificial Intelligent (AI) systems on human societies without human supervision requires them to be able to align with human values. However, most current work only addresses this issue from a technical point…

Computation and Language · Computer Science 2024-08-13 Mehdi Khamassi , Marceau Nahon , Raja Chatila

Value-alignment in normative multi-agent systems is used to promote a certain value and to ensure the consistent behavior of agents in autonomous intelligent systems with human values. However, the current literature is limited to…

Multiagent Systems · Computer Science 2023-05-15 Maha Riad , Vinicius Renan de Carvalho , Fatemeh Golpayegani

The development of ethical AI systems is currently geared toward setting objective functions that align with human objectives. However, finding such functions remains a research challenge, while in RL, setting rewards by hand is a fairly…

Artificial Intelligence · Computer Science 2023-10-10 Marcin Korecki , Damian Dailisan , Cesare Carissimo