English
Related papers

Related papers: Counterfactually Fair Reinforcement Learning via S…

200 papers

As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a…

Machine Learning · Computer Science 2020-10-09 Amir-Hossein Karimi , Bernhard Schölkopf , Isabel Valera

Federated learning provides an effective paradigm to jointly optimize a model benefited from rich distributed data while protecting data privacy. Nonetheless, the heterogeneity nature of distributed data makes it challenging to define and…

Machine Learning · Computer Science 2022-11-07 Bhaskar Ray Chaudhury , Linyi Li , Mintong Kang , Bo Li , Ruta Mehta

Safe reinforcement learning (RL) offers advanced solutions to constrained optimal control problems. Existing studies in safe RL implicitly assume continuity in policy functions, where policies map states to actions in a smooth,…

Machine Learning · Computer Science 2024-03-29 Wenjun Zou , Yao Lyu , Jie Li , Yujie Yang , Shengbo Eben Li , Jingliang Duan , Xianyuan Zhan , Jingjing Liu , Yaqin Zhang , Keqiang Li

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

Robotics · Computer Science 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

Contrastive learning (CL) benefits the training of sequential recommendation models with informative self-supervision signals. Existing solutions apply general sequential data augmentation strategies to generate positive pairs and encourage…

Information Retrieval · Computer Science 2024-03-19 Peilin Zhou , Jingqi Gao , Yueqi Xie , Qichen Ye , Yining Hua , Jae Boum Kim , Shoujin Wang , Sunghun Kim

Counterfactuals have become a popular technique nowadays for interacting with black-box machine learning models and understanding how to change a particular instance to obtain a desired outcome from the model. However, most existing…

Machine Learning · Computer Science 2021-09-29 Philip Naumann , Eirini Ntoutsi

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Syed Ali Tariq , Tehseen Zia

While Reinforcement Learning (RL) achieves tremendous success in sequential decision-making problems of many domains, it still faces key challenges of data inefficiency and the lack of interpretability. Interestingly, many researchers have…

Artificial Intelligence · Computer Science 2023-06-02 Yan Zeng , Ruichu Cai , Fuchun Sun , Libo Huang , Zhifeng Hao

Explicit and implicit bias clouds human judgement, leading to discriminatory treatment of minority groups. A fundamental goal of algorithmic fairness is to avoid the pitfalls in human judgement by learning policies that improve the overall…

Machine Learning · Computer Science 2020-11-02 Yuzi He , Keith Burghardt , Siyi Guo , Kristina Lerman

A pervasive challenge in Reinforcement Learning (RL) is the "curse of dimensionality" which is the exponential growth in the state-action space when optimizing a high-dimensional target task. The framework of curriculum learning trains the…

Machine Learning · Computer Science 2025-03-24 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the…

Machine Learning · Statistics 2017-03-10 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Session-based Recommendation (SR) systems have recently achieved considerable success, yet their complex, "black box" nature often obscures why certain recommendations are made. Existing explanation methods struggle to pinpoint truly…

Social and Information Networks · Computer Science 2025-12-02 Han Zhou , Hui Fang , Zhu Sun , Wentao Hu

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

Machine-learning models are increasingly driving decisions in high-stakes settings, such as finance, law, and hiring, thus, highlighting the need for transparency. However, the key challenge is to balance transparency -- clarifying `why' a…

Artificial Intelligence · Computer Science 2025-08-29 Sopam Dasgupta , Sadaf MD Halim , Joaquín Arias , Elmer Salazar , Gopal Gupta

It is a long-standing question to discover causal relations among a set of variables in many empirical sciences. Recently, Reinforcement Learning (RL) has achieved promising results in causal discovery from observational data. However,…

Machine Learning · Computer Science 2021-09-16 Xiaoqiang Wang , Yali Du , Shengyu Zhu , Liangjun Ke , Zhitang Chen , Jianye Hao , Jun Wang

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

Reinforcement Learning (RL) has recently been applied to sequential estimation and prediction problems identifying and developing hypothetical treatment strategies for septic patients, with a particular focus on offline learning with…

Machine Learning · Computer Science 2020-11-24 Taylor W. Killian , Haoran Zhang , Jayakumar Subramanian , Mehdi Fatemi , Marzyeh Ghassemi

Fair machine learning is receiving an increasing attention in machine learning fields. Researchers in fair learning have developed correlation or association-based measures such as demographic disparity, mistreatment disparity, calibration,…

Computers and Society · Computer Science 2019-11-20 Wen Huang , Yongkai Wu , Lu Zhang , Xintao Wu