English
Related papers

Related papers: Algorithms for Fairness in Sequential Decision Mak…

200 papers

While significant advancements have been made in the field of fair machine learning, the majority of studies focus on scenarios where the decision model operates on a static population. In this paper, we study fairness in dynamic systems…

Machine Learning · Computer Science 2024-01-15 Yaowei Hu , Jacob Lear , Lu Zhang

Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in static settings over temporal domains may lead to delayed and…

Machine Learning · Computer Science 2022-03-01 Jianfeng Chi , Jian Shen , Xinyi Dai , Weinan Zhang , Yuan Tian , Han Zhao

Fairness has emerged as an important concern in automated decision-making in recent years, especially when these decisions affect human welfare. In this work, we study fairness in temporally extended decision-making settings, specifically…

Artificial Intelligence · Computer Science 2022-02-10 Ganesh Ghalme , Vineet Nair , Vishakha Patil , Yilun Zhou

Fair machine learning (ML) methods help identify and mitigate the risk that algorithms encode or automate social injustices. Algorithmic approaches alone cannot resolve structural inequalities, but they can support socio-technical decision…

Machine Learning · Computer Science 2026-04-24 Michelle Seng Ah Lee , Kirtan Padh , David Watson , Niki Kilbertus , Jatinder Singh

Fair decision making has largely been studied with respect to a single decision. Here we investigate the notion of fairness in the context of sequential decision making where multiple stakeholders can be affected by the outcomes of…

Artificial Intelligence · Computer Science 2024-06-21 Parand A. Alamdari , Toryn Q. Klassen , Elliot Creager , Sheila A. McIlraith

Long-term fairness is an important factor of consideration in designing and deploying learning-based decision systems in high-stake decision-making contexts. Recent work has proposed the use of Markov Decision Processes (MDPs) to formulate…

Machine Learning · Computer Science 2022-10-25 Eric Yang Yu , Zhizhen Qin , Min Kyung Lee , Sicun Gao

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…

Optimization and Control · Mathematics 2015-07-07 Mahmoud El Chamie , Behcet Acikmese

We consider fair resource allocation in sequential decision-making environments modeled as weakly coupled Markov decision processes, where resource constraints couple the action spaces of $N$ sub-Markov decision processes (sub-MDPs) that…

Machine Learning · Computer Science 2025-04-29 Xiaohui Tu , Yossiri Adulyasak , Nima Akbarzadeh , Erick Delage

Fairness plays a crucial role in various multi-agent systems (e.g., communication networks, financial markets, etc.). Many multi-agent dynamical interactions can be cast as Markov Decision Processes (MDPs). While existing research has…

Machine Learning · Computer Science 2023-06-02 Peizhong Ju , Arnob Ghosh , Ness B. Shroff

Markov Decision Processes (MDPs) are an effective way to formally describe many Machine Learning problems. In fact, recently MDPs have also emerged as a powerful framework to model financial trading tasks. For example, financial MDPs can…

Computational Engineering, Finance, and Science · Computer Science 2021-07-21 Diego Pino , Javier García , Fernando Fernández , Svitlana S Vyetrenko

Recent studies on fairness in automated decision making systems have both investigated the potential future impact of these decisions on the population at large, and emphasized that imposing ''typical'' fairness constraints such as…

Machine Learning · Computer Science 2019-11-19 Joshua Williams , J. Zico Kolter

We study the sequential decision-making problem of allocating a limited resource to agents that reveal their stochastic demands on arrival over a finite horizon. Our goal is to design fair allocation algorithms that exhaust the available…

Machine Learning · Computer Science 2023-06-21 Parisa Hassanzadeh , Eleonora Kreacic , Sihan Zeng , Yuchen Xiao , Sumitra Ganesh

Equity in real-world sequential decision problems can be enforced using fairness-aware methods. Therefore, we require algorithms that can make suitable and transparent trade-offs between performance and the desired fairness notions. As the…

Machine Learning · Computer Science 2025-09-29 Alexandra Cimpean , Nicole Orzan , Catholijn Jonker , Pieter Libin , Ann Nowé

Most existing notions of algorithmic fairness are one-shot: they ensure some form of allocative equality at the time of decision making, but do not account for the adverse impact of the algorithmic decisions today on the long-term welfare…

Computers and Society · Computer Science 2019-06-28 Hoda Heidari , Vedant Nanda , Krishna P. Gummadi

Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Mean payoff (or long-run average reward) provides a mathematically elegant formalism to express performance related…

Performance · Computer Science 2017-09-08 Jan Křetínský , Tobias Meggendorfer

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

Although many fairness criteria have been proposed for decision making, their long-term impact on the well-being of a population remains unclear. In this work, we study the dynamics of population qualification and algorithmic decisions…

Machine Learning · Computer Science 2020-10-24 Xueru Zhang , Ruibo Tu , Yang Liu , Mingyan Liu , Hedvig Kjellström , Kun Zhang , Cheng Zhang

The online Markov decision process (MDP) is a generalization of the classical Markov decision process that incorporates changing reward functions. In this paper, we propose practical online MDP algorithms with policy iteration and…

Machine Learning · Computer Science 2015-10-16 Yao Ma , Hao Zhang , Masashi Sugiyama

Counterfactuals are widely used in AI to explain how minimal changes to a model's input can lead to a different output. However, established methods for computing counterfactuals typically focus on one-step decision-making, and are not…

Artificial Intelligence · Computer Science 2025-05-15 Paul Kobialka , Lina Gerlach , Francesco Leofante , Erika Ábrahám , Silvia Lizeth Tapia Tarifa , Einar Broch Johnsen

Algorithmic decision-making systems are increasingly used throughout the public and private sectors to make important decisions or assist humans in making these decisions with real social consequences. While there has been substantial…

Human-Computer Interaction · Computer Science 2020-01-28 Ruotong Wang , F. Maxwell Harper , Haiyi Zhu
‹ Prev 1 2 3 10 Next ›