English
Related papers

Related papers: Counterfactually Fair Reinforcement Learning via S…

200 papers

Reinforcement learning (RL) faces substantial challenges when applied to real-life problems, primarily stemming from the scarcity of available data due to limited interactions with the environment. This limitation is exacerbated by the fact…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Cristiano Capone , Paolo Muratore

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger

Whenever a clinician reflects on the efficacy of a sequence of treatment decisions for a patient, they may try to identify critical time steps where, had they made different decisions, the patient's health would have improved. While recent…

Machine Learning · Computer Science 2023-11-07 Stratis Tsirtsis , Manuel Gomez-Rodriguez

Identifying when to give treatments to patients and how to select among multiple treatments over time are important medical problems with a few existing solutions. In this paper, we introduce the Counterfactual Recurrent Network (CRN), a…

Machine Learning · Computer Science 2020-02-12 Ioana Bica , Ahmed M. Alaa , James Jordon , Mihaela van der Schaar

We consider the problem of learning fair policies for multi-stage selection problems from observational data. This problem arises in several high-stakes domains such as company hiring, loan approval, or bail decisions where outcomes (e.g.,…

Machine Learning · Computer Science 2023-12-21 Zhuangzhuang Jia , Grani A. Hanasusanto , Phebe Vayanos , Weijun Xie

Counterfactual explanations (CFEs) are a popular approach in explainable artificial intelligence (xAI), highlighting changes to input data necessary for altering a model's output. A CFE can either describe a scenario that is better than the…

Artificial Intelligence · Computer Science 2023-10-26 Ulrike Kuhl , André Artelt , Barbara Hammer

Fairness in predictions is of direct importance in practice due to legal, ethical, and societal reasons. This is often accomplished through counterfactual fairness, which ensures that the prediction for an individual is the same as that in…

Machine Learning · Computer Science 2025-10-03 Yuchen Ma , Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Algorithmic fairness is typically studied from the perspective of predictions. Instead, here we investigate fairness from the perspective of recourse actions suggested to individuals to remedy an unfavourable classification. We propose two…

Machine Learning · Computer Science 2022-03-08 Julius von Kügelgen , Amir-Hossein Karimi , Umang Bhatt , Isabel Valera , Adrian Weller , Bernhard Schölkopf

Conventional methods for query autocompletion aim to predict which completed query a user will select from a list. A shortcoming of this approach is that users often do not know which query will provide the best retrieval performance on the…

Information Retrieval · Computer Science 2022-04-26 Adam Block , Rahul Kidambi , Daniel N. Hill , Thorsten Joachims , Inderjit S. Dhillon

Recourse generators provide actionable insights, often through feature-based counterfactual explanations (CFEs), to help negatively classified individuals understand how to adjust their input features to achieve a positive classification.…

Machine Learning · Computer Science 2025-06-04 Keziah Naggita , Matthew R. Walter , Avrim Blum

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

Machine Learning · Computer Science 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Why do reinforcement learning (RL) policies fail or succeed? This is a challenging question due to the complex, high-dimensional nature of agent-environment interactions. In this work, we take a causal perspective on explaining the behavior…

Machine Learning · Statistics 2025-07-22 Armin Kekić , Jan Schneider , Dieter Büchler , Bernhard Schölkopf , Michel Besserve

As trustworthy AI continues to advance, the fairness issue in recommendations has received increasing attention. A recommender system is considered unfair when it produces unequal outcomes for different user groups based on user-sensitive…

Artificial Intelligence · Computer Science 2024-10-24 Wei Chen , Meng Yuan , Zhao Zhang , Ruobing Xie , Fuzhen Zhuang , Deqing Wang , Rui Liu

One of the main concerns while deploying machine learning models in real-world applications is fairness. Counterfactual fairness has emerged as an intuitive and natural definition of fairness. However, existing methodologies for enforcing…

Machine Learning · Computer Science 2025-09-08 Krishn Vishwas Kher , Saksham Mittal , Aditya Varun , Shantanu Das , SakethaNath Jagarlapudi

Despite the evolution of language models, they continue to portray harmful societal biases and stereotypes inadvertently learned from training data. These inherent biases often result in detrimental effects in various applications.…

Computation and Language · Computer Science 2024-07-24 Ewoenam Kwaku Tokpo , Toon Calders

Counterfactual reasoning typically involves considering alternatives to actual events. While often applied to understand past events, a distinct form-forward counterfactual reasoning-focuses on anticipating plausible future developments.…

Computation and Language · Computer Science 2025-10-03 Keane Ong , Rui Mao , Deeksha Varshney , Paul Pu Liang , Erik Cambria , Gianmarco Mengaldo

Making fair decisions is crucial to ethically implementing machine learning algorithms in social settings. In this work, we consider the celebrated definition of counterfactual fairness [Kusner et al., NeurIPS, 2017]. We begin by showing…

Machine Learning · Computer Science 2023-03-07 Lucas Rosenblatt , R. Teal Witter

This paper studies satisfaction of temporal properties on unknown stochastic processes that have continuous state spaces. We show how reinforcement learning (RL) can be applied for computing policies that are finite-memory and deterministic…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Milad Kazemi , Sadegh Soudjani

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa

We consider after-study statistical inference for sequentially designed experiments wherein multiple units are assigned treatments for multiple time points using treatment policies that adapt over time. Our goal is to provide inference…

Machine Learning · Statistics 2025-06-10 Raaz Dwivedi , Katherine Tian , Sabina Tomkins , Predrag Klasnja , Susan Murphy , Devavrat Shah