English
Related papers

Related papers: Welfare and Fairness in Multi-objective Reinforcem…

200 papers

Reinforcement learning has been shown to be an effective strategy for automatically training policies for challenging control problems. Focusing on non-cooperative multi-agent systems, we propose a novel reinforcement learning framework for…

Computer Science and Game Theory · Computer Science 2022-06-08 Kishor Jothimurugan , Suguman Bansal , Osbert Bastani , Rajeev Alur

We consider the problem of episodic reinforcement learning where there are multiple stakeholders with different reward functions. Our goal is to output a policy that is socially fair with respect to different reward functions. Prior works…

Machine Learning · Computer Science 2023-02-06 Debmalya Mandal , Jiarui Gan

We consider the problem of learning fair policies in (deep) cooperative multi-agent reinforcement learning (MARL). We formalize it in a principled way as the problem of optimizing a welfare function that explicitly encodes two important…

Machine Learning · Computer Science 2021-06-23 Matthieu Zimmer , Claire Glanois , Umer Siddique , Paul Weng

We study the problem of maximizing Nash social welfare, which is the geometric mean of agents' utilities, in two well-known models. The first model involves one-sided preferences, where a set of indivisible items is allocated among a group…

Computer Science and Game Theory · Computer Science 2025-05-19 Salil Gokhale , Harshul Sagar , Rohit Vaish , Vignesh Viswanathan , Jatin Yadav

The maximization of Nash welfare, which equals the geometric mean of agents' utilities, is widely studied because it balances efficiency and fairness in resource allocation problems. Banerjee, Gkatzelis, Gorokh, and Jin (2022) recently…

Data Structures and Algorithms · Computer Science 2024-11-11 Zhiyi Huang , Minming Li , Xinkai Shu , Tianze Wei

In many real-world applications of reinforcement learning (RL), deployed policies have varied impacts on different stakeholders, creating challenges in reaching consensus on how to effectively aggregate their preferences. Generalized…

Machine Learning · Computer Science 2025-07-17 Cheol Woo Kim , Jai Moondra , Shresth Verma , Madeleine Pollack , Lingkai Kong , Milind Tambe , Swati Gupta

Multi-objective reinforcement learning (MORL) aims to optimize policies in the presence of conflicting objectives, where linear scalarization is commonly used to reduce vector-valued returns into scalar signals. While effective for certain…

Machine Learning · Computer Science 2025-11-19 Woosung Kim , Jinho Lee , Jongmin Lee , Byung-Jun Lee

Recent studies on disparate impact in machine learning applications have sparked a debate around the concept of fairness along with attempts to formalize its different criteria. Many of these approaches focus on reducing prediction errors…

Computers and Society · Computer Science 2018-10-22 Ansh Patel

This paper studies algorithmic decision-making in the presence of strategic individual behaviors, where an ML model is used to make decisions about human agents and the latter can adapt their behavior strategically to improve their future…

Artificial Intelligence · Computer Science 2025-08-22 Tian Xie , Xueru Zhang

We study coverage problems in which, for a set of agents and a given threshold $T$, the goal is to select $T$ subsets (of the agents) that, while satisfying combinatorial constraints, achieve fair and efficient coverage among the agents. In…

Computer Science and Game Theory · Computer Science 2022-07-06 Siddharth Barman , Anand Krishna , Y. Narahari , Soumyarup Sadhukhan

We study the problem of fairly allocating a set of indivisible goods among agents with additive valuations. The extent of fairness of an allocation is measured by its Nash social welfare, which is the geometric mean of the valuations of the…

Computer Science and Game Theory · Computer Science 2018-07-23 Siddharth Barman , Sanath Kumar Krishnamurthy , Rohit Vaish

Motivated by applications such as college admission and insurance rate determination, we propose an evaluation problem where the inputs are controlled by strategic individuals who can modify their features at a cost. A learner can only…

Computer Science and Game Theory · Computer Science 2020-11-05 Nika Haghtalab , Nicole Immorlica , Brendan Lucier , Jack Z. Wang

We study the problem of allocating indivisible goods among agents in a fair and economically efficient manner. In this context, the Nash social welfare-defined as the geometric mean of agents' valuations for their assigned bundles-stands as…

Computer Science and Game Theory · Computer Science 2021-10-27 Siddharth Barman , Paritosh Verma

We consider the problem of locating a facility to serve a set of agents located along a line. The Nash welfare objective function, defined as the product of the agents' utilities, is known to provide a compromise between fairness and…

Computer Science and Game Theory · Computer Science 2023-10-09 Alexander Lam , Haris Aziz , Toby Walsh

Current methodologies in machine learning analyze the effects of various statistical parity notions of fairness primarily in light of their impacts on predictive accuracy and vendor utility loss. In this paper, we propose a new framework…

Machine Learning · Computer Science 2018-07-04 Lily Hu , Yiling Chen

In this paper, we address the issue of fairness in preference-based reinforcement learning (PbRL) in the presence of multiple objectives. The main objective is to design control policies that can optimize multiple objectives while treating…

Machine Learning · Computer Science 2023-09-04 Umer Siddique , Abhinav Sinha , Yongcan Cao

We study multi-objective reinforcement learning with nonlinear preferences over trajectories. That is, we maximize the expected value of a nonlinear function over accumulated rewards (expected scalarized return or ESR) in a multi-objective…

Machine Learning · Computer Science 2025-02-19 Nianli Peng , Muhang Tian , Brandon Fain

Decision support systems (e.g., for ecological conservation) and autonomous systems (e.g., adaptive controllers in smart cities) start to be deployed in real applications. Although their operations often impact many users or stakeholders,…

Machine Learning · Computer Science 2019-07-25 Paul Weng

This paper is merged with arXiv:2107.08965v2. We refer the reader to the full and updated version. We study the problem of allocating a set of indivisible goods among agents with 2-value additive valuations. Our goal is to find an…

Computer Science and Game Theory · Computer Science 2021-10-13 Hannaneh Akrami , Bhaskar Ray Chaudhury , Kurt Mehlhorn , Golnoosh Shahkarami , Quentin Vermande

The maximum Nash social welfare (NSW) -- which maximizes the geometric mean of agents' utilities -- is a fundamental solution concept with remarkable fairness and efficiency guarantees. The computational aspects of NSW have been extensively…

Computer Science and Game Theory · Computer Science 2023-12-15 Pallavi Jain , Rohit Vaish
‹ Prev 1 2 3 10 Next ›