中文
相关论文

相关论文: Explaining Reinforcement Learning: A Counterfactua…

200 篇论文

In recent years, explainability in machine learning has gained importance. In this context, counterfactual explanation (CE), which is an explanation method that uses examples, has attracted attention. However, it has been pointed out that…

机器学习 · 计算机科学 2025-02-04 Keita Kinjo

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

信息检索 · 计算机科学 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

Reinforcement Learning (RL) for control has become increasingly popular due to its ability to learn rich feedback policies that take into account uncertainty and complex representations of the environment. When considering safety…

机器学习 · 计算机科学 2024-05-21 Sean Vaskov , Wilko Schwarting , Chris L. Baker

Reinforcement Learning with Verifiable Rewards (RLVR) improves multimodal reasoning by rewarding verifiable final answers. Yet answer-correct trajectories may still rely on incomplete derivations, weak evidence, or statements that…

计算与语言 · 计算机科学 2026-04-22 Mengzhao Jia , Zhihan Zhang , Meng Jiang

Machine learning models are widely used in real-world applications. However, their complexity makes it often challenging to interpret the rationale behind their decisions. Counterfactual explanations (CEs) have emerged as a viable solution…

机器学习 · 计算机科学 2024-03-04 Muhammad Suffian , Jose M. Alonso-Moral , Alessandro Bogliolo

This paper proposes a novel reinforcement learning (RL) framework for credit underwriting that tackles ungeneralizable contextual challenges. We adapt RL principles for credit scoring, incorporating action space renewal and multi-choice…

In meta reinforcement learning (meta RL), an agent seeks a Bayes-optimal policy -- the optimal policy when facing an unknown task that is sampled from some known task distribution. Previous approaches tackled this problem by inferring a…

机器学习 · 计算机科学 2023-06-06 Era Choshen , Aviv Tamar

A significant challenge in reinforcement learning is quantifying the complex relationship between actions and long-term rewards. The effects may manifest themselves over a long sequence of state-action pairs, making them hard to pinpoint.…

机器学习 · 计算机科学 2022-11-01 Harshad Khadilkar , Hardik Meisheri

Counterfactual explanations (CEs) are a powerful means for understanding how decisions made by algorithms can be changed. Researchers have proposed a number of desiderata that CEs should meet to be practically useful, such as requiring…

机器学习 · 计算机科学 2022-09-26 Marco Virgolin , Saverio Fracaros

Reinforcement Learning (RL) based methods have seen their paramount successes in solving serial decision-making and control problems in recent years. For conventional RL formulations, Markov Decision Process (MDP) and state-action-value…

机器学习 · 计算机科学 2020-06-09 Ziyao Zhang , Liang Ma , Kin K. Leung , Konstantinos Poularakis , Mudhakar Srivatsa

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

机器学习 · 计算机科学 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

The recent success of reinforcement learning's (RL) in solving complex tasks is most often attributed to its capacity to explore and exploit an environment where it has been trained. Sample efficiency is usually not an issue since cheap…

计算与语言 · 计算机科学 2023-03-16 Govardana Sachithanandam Ramachandran , Kazuma Hashimoto , Caiming Xiong

Counterfactual Explanations (CFEs) interpret machine learning models by identifying the smallest change to input features needed to change the model's prediction to a desired output. For classification tasks, CFEs determine how close a…

机器学习 · 计算机科学 2025-10-01 Margarita A. Guerrero , Cristian R. Rojas

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

机器学习 · 统计学 2025-10-15 Licong Lin , Song Mei

Causal inference, or counterfactual prediction, is central to decision making in healthcare, policy and social sciences. To de-bias causal estimators with high-dimensional data in observational studies, recent advances suggest the…

机器学习 · 统计学 2020-10-20 Shuxi Zeng , Serge Assaad , Chenyang Tao , Shounak Datta , Lawrence Carin , Fan Li

Online reinforcement learning (RL) algorithms are often difficult to deploy in complex human-facing applications as they may learn slowly and have poor early performance. To address this, we introduce a practical algorithm for incorporating…

人工智能 · 计算机科学 2022-01-03 Tong Mu , Georgios Theocharous , David Arbour , Emma Brunskill

Recent advances of Reinforcement Learning (RL) have highlighted its potential in complex reasoning tasks, yet effective training often relies on external supervision, which limits the broader applicability. In this work, we propose a novel…

人工智能 · 计算机科学 2025-06-11 Kongcheng Zhang , Qi Yao , Shunyu Liu , Yingjie Wang , Baisheng Lai , Jieping Ye , Mingli Song , Dacheng Tao

Self-supervised feature learning and pretraining methods in reinforcement learning (RL) often rely on information-theoretic principles, termed mutual information skill learning (MISL). These methods aim to learn a representation of the…

This paper proposes FedSVA, an explainable differential privacy (DP) mechanism for federated learning (FL) that dynamically calibrates noise injection based on the privacy contribution of attributes via Shapley Values. Unlike heuristic DP…

密码学与安全 · 计算机科学 2026-04-02 Yunbo Li , Jiaping Gui , Yue Wu

Causal representation learning (CRL) aims at recovering latent causal variables from high-dimensional observations to solve causal downstream tasks, such as predicting the effect of new interventions or more robust classification. A…

机器学习 · 计算机科学 2025-03-06 Dingling Yao , Dario Rancati , Riccardo Cadei , Marco Fumero , Francesco Locatello