中文
相关论文

相关论文: Counterfactual experience augmented off-policy rei…

200 篇论文

Counterfactual Explanations (CFEs) interpret machine learning models by identifying the smallest change to input features needed to change the model's prediction to a desired output. For classification tasks, CFEs determine how close a…

机器学习 · 计算机科学 2025-10-01 Margarita A. Guerrero , Cristian R. Rojas

Counterfactual instances are a powerful tool to obtain valuable insights into automated decision processes, describing the necessary minimal changes in the input space to alter the prediction towards a desired target. Most previous…

机器学习 · 计算机科学 2021-06-07 Robert-Florian Samoilescu , Arnaud Van Looveren , Janis Klaise

Unlike traditional supervised learning, in many settings only partial feedback is available. We may only observe outcomes for the chosen actions, but not the counterfactual outcomes associated with other alternatives. Such settings…

机器学习 · 计算机科学 2021-12-09 Ruijiang Gao , Max Biggs , Wei Sun , Ligong Han

Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to…

机器学习 · 计算机科学 2023-11-27 Xuan Zhao , Klaus Broelemann , Gjergji Kasneci

Counterfactual explanations (CEs) enhance the interpretability of machine learning models by describing what changes to an input are necessary to change its prediction to a desired class. These explanations are commonly used to guide users'…

机器学习 · 计算机科学 2024-03-07 Anna P. Meyer , Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

机器学习 · 计算机科学 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

Treatment effect estimation, which refers to the estimation of causal effects and aims to measure the strength of the causal relationship, is of great importance in many fields but is a challenging problem in practice. As present,…

机器学习 · 计算机科学 2021-07-20 Zhenyu Guo , Shuai Zheng , Zhizhe Liu , Kun Yan , Zhenfeng Zhu

Counterfactual data augmentation (CDA) -- i.e., adding minimally perturbed inputs during training -- helps reduce model reliance on spurious correlations and improves generalization to out-of-distribution (OOD) data. Prior work on…

计算与语言 · 计算机科学 2022-11-02 Tanay Dixit , Bhargavi Paranjape , Hannaneh Hajishirzi , Luke Zettlemoyer

Counterfactual explanations have emerged as a prominent method in Explainable Artificial Intelligence (XAI), providing intuitive and actionable insights into Machine Learning model decisions. In contrast to other traditional feature…

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

人工智能 · 计算机科学 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

Causal representation learning has attracted significant research interest during the past few years, as a means for improving model generalization and robustness. Causal representations of interventional image pairs (also called…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Panagiotis Alimisis , Christos Diou

With the widespread accumulation of observational data, researchers obtain a new direction to learn counterfactual effects in many domains (e.g., health care and computational advertising) without Randomized Controlled Trials(RCTs).…

机器学习 · 计算机科学 2021-11-01 Guanglin Zhou , Lina Yao , Xiwei Xu , Chen Wang , Liming Zhu

Counterfactual explanations (CE) aim to reveal how small input changes flip a model's prediction, yet many methods modify more features than necessary, reducing clarity and actionability. We introduce \emph{COLA}, a model- and…

机器学习 · 计算机科学 2026-03-02 Lei You , Yijun Bian , Lele Cao

The capability to widely sample the state and action spaces is a key ingredient toward building effective reinforcement learning algorithms. The variational optimization principles exposed in this paper emphasize the importance of an…

机器学习 · 计算机科学 2022-05-25 Emmanuel Daucé

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

机器学习 · 计算机科学 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

In practice, the parameters of control policies are often tuned manually. This is time-consuming and frustrating. Reinforcement learning is a promising alternative that aims to automate this process, yet often requires too many experiments…

The concept of counterfactual explanations (CE) has emerged as one of the important concepts to understand the inner workings of complex AI systems. In this paper, we translate the idea of CEs to linear optimization and propose, motivate,…

最优化与控制 · 数学 2024-05-27 Jannis Kurtz , Ş. İlker Birbil , Dick den Hertog

Reinforcement learning requires interaction with an environment, which is expensive for robots. This constraint necessitates approaches that work with limited environmental interaction by maximizing the reuse of previous experiences. We…

人工智能 · 计算机科学 2024-04-05 Benedict Quartey , Ankit Shah , George Konidaris

Recent advancements in state-of-the-art (SOTA) offline reinforcement learning (RL) have primarily focused on addressing function approximation errors, which contribute to the overestimation of Q-values for out-of-distribution actions, a…

机器学习 · 计算机科学 2025-05-01 Pulkit Agrawal , Rukma Talwadker , Aditya Pareek , Tridib Mukherjee

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

机器学习 · 计算机科学 2022-06-22 Haoqi Yuan , Zongqing Lu