中文
相关论文

相关论文: Socially Fair Reinforcement Learning

200 篇论文

Switching costs, which capture the costs for changing policies, are regarded as a critical metric in reinforcement learning (RL), in addition to the standard metric of losses (or rewards). However, existing studies on switching costs (with…

机器学习 · 计算机科学 2023-02-10 Ming Shi , Yingbin Liang , Ness Shroff

Existing episodic reinforcement algorithms assume that the length of an episode is fixed across time and known a priori. In this paper, we consider a general framework of episodic reinforcement learning when the length of each episode is…

机器学习 · 计算机科学 2023-02-08 Debmalya Mandal , Goran Radanovic , Jiarui Gan , Adish Singla , Rupak Majumdar

Ensuring long-term fairness is crucial when developing automated decision making systems, specifically in dynamic and sequential environments. By maximizing their reward without consideration of fairness, AI agents can introduce disparities…

机器学习 · 计算机科学 2025-01-03 Sahand Rezaei-Shoshtari , Hanna Yurchyk , Scott Fujimoto , Doina Precup , David Meger

In load balancing problems there is a set of clients, each wishing to select a resource from a set of permissible ones, in order to execute a certain task. Each resource has a latency function, which depends on its workload, and a client's…

计算机科学与博弈论 · 计算机科学 2021-05-06 Vittorio Bilò , Gianpiero Monaco , Luca Moscardelli , Cosimo Vinci

We initiate the study of a repeated principal-agent problem over a finite horizon $T$, where a principal sequentially interacts with $K\geq 2$ types of agents arriving in an adversarial order. At each round, the principal strategically…

计算机科学与博弈论 · 计算机科学 2025-08-05 Junyan Liu , Arnab Maiti , Artin Tajdini , Kevin Jamieson , Lillian J. Ratliff

In this paper, we consider a distributed learning problem in a subnetwork zero-sum game, where agents are competing in different subnetworks. These agents are connected through time-varying graphs where each agent has its own cost function…

最优化与控制 · 数学 2021-08-05 Shijie Huang , Jinlong Lei , Yiguang Hong , Uday V. Shanbhag , Jie Chen

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

机器学习 · 计算机科学 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

A decision maker typically (i) incorporates training data to learn about the relative effectiveness of treatments, and (ii) chooses an implementation mechanism that implies an ``optimal'' predicted outcome distribution according to some…

计量经济学 · 经济学 2025-05-29 Anders Bredahl Kock , David Preinerstorfer

We study reinforcement learning (RL) with linear function approximation under the adaptivity constraint. We consider two popular limited adaptivity models: the batch learning model and the rare policy switch model, and propose two efficient…

机器学习 · 计算机科学 2022-01-04 Tianhao Wang , Dongruo Zhou , Quanquan Gu

Robust real-world learning should benefit from both demonstrations and interactions with the environment. Current approaches to learning from demonstration and reward perform supervised learning on expert demonstration data and use…

人工智能 · 计算机科学 2019-05-31 Yang Gao , Huazhe Xu , Ji Lin , Fisher Yu , Sergey Levine , Trevor Darrell

We study the problem of fair allocation of a set of indivisible items among agents with additive valuations, under matroid constraints and two generalizations: $p$-extendible system and independence system constraints. The objective is to…

计算机科学与博弈论 · 计算机科学 2024-11-07 Yuanyuan Wang , Xin Chen , Qingqin Nong

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

机器学习 · 计算机科学 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

We consider the problem where $M$ agents interact with $M$ identical and independent environments with $S$ states and $A$ actions using reinforcement learning for $T$ rounds. The agents share their data with a central server to minimize…

机器学习 · 计算机科学 2021-02-23 Mridul Agarwal , Bhargav Ganguly , Vaneet Aggarwal

There is growing interest in designing recommender systems that aim at being fair towards item producers or their least satisfied users. Inspired by the domain of inequality measurement in economics, this paper explores the use of…

信息检索 · 计算机科学 2023-03-29 Virginie Do , Nicolas Usunier

We study fair division of indivisible goods in a single-parameter environment. In particular, we develop truthful social welfare maximizing mechanisms for fairly allocating indivisible goods. Our fairness guarantees are in terms of solution…

计算机科学与博弈论 · 计算机科学 2019-01-29 Siddharth Barman , Ganesh Ghalme , Shweta Jain , Pooja Kulkarni , Shivika Narang

An ideal strategy in zero-sum games should not only grant the player an average reward no less than the value of Nash equilibrium, but also exploit the (adaptive) opponents when they are suboptimal. While most existing works in Markov games…

机器学习 · 计算机科学 2022-06-15 Qinghua Liu , Yuanhao Wang , Chi Jin

Reinforcement learning has achieved great success in many decision-making tasks, and traditional reinforcement learning algorithms are mainly designed for obtaining a single optimal solution. However, recent works show the importance of…

机器学习 · 计算机科学 2023-08-24 Fanqi Lin , Shiyu Huang , Weiwei Tu

In many real-world applications, reinforcement learning (RL) agents might have to solve multiple tasks, each one typically modeled via a reward function. If reward functions are expressed linearly, and the agent has previously learned a set…

机器学习 · 计算机科学 2022-06-24 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

Reinforcement learning (RL) so far has limited real-world applications. One key challenge is that typical RL algorithms heavily rely on a reset mechanism to sample proper initial states; these reset mechanisms, in practice, are expensive to…

机器学习 · 计算机科学 2023-07-25 Hoai-An Nguyen , Ching-An Cheng

We study the problem of reinforcement learning in infinite-horizon discounted linear Markov decision processes (MDPs), and propose the first computationally efficient algorithm achieving rate-optimal regret guarantees in this setting. Our…

机器学习 · 计算机科学 2026-03-16 Antoine Moulin , Gergely Neu , Luca Viano