中文
相关论文

相关论文: Explaining Reinforcement Learning: A Counterfactua…

200 篇论文

In complex tasks where the reward function is not straightforward and consists of a set of objectives, multiple reinforcement learning (RL) policies that perform task adequately, but employ different strategies can be trained by adjusting…

人工智能 · 计算机科学 2021-12-20 Jasmina Gajcin , Rahul Nair , Tejaswini Pedapati , Radu Marinescu , Elizabeth Daly , Ivana Dusparic

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

计算与语言 · 计算机科学 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and…

机器学习 · 计算机科学 2022-08-17 Yang Yue , Bingyi Kang , Zhongwen Xu , Gao Huang , Shuicheng Yan

Standard approaches to goal-conditioned reinforcement learning (GCRL) that rely on temporal-difference learning can be unstable and sample-inefficient due to bootstrapping. While recent work has explored contrastive and supervised…

机器学习 · 计算机科学 2026-04-21 Franki Nguimatsia Tiofack , Fabian Schramm , Théotime Le Hellard , Justin Carpentier

Reinforcement Learning with Verifiable Rewards (RLVR) improves reasoning in large language models but treats all correct solutions equally, potentially reinforcing flawed traces that get correct answers by chance. We observe that better…

机器学习 · 计算机科学 2026-03-11 Tiehua Mei , Minxuan Lv , Leiyu Pan , Zhenpeng Su , Hongru Hou , Hengrui Chen , Ao Xu , Deqing Yang

The concept of counterfactual explanations (CE) has emerged as one of the important concepts to understand the inner workings of complex AI systems. In this paper, we translate the idea of CEs to linear optimization and propose, motivate,…

最优化与控制 · 数学 2024-05-27 Jannis Kurtz , Ş. İlker Birbil , Dick den Hertog

Federated Learning (FL) wherein multiple institutions collaboratively train a machine learning model without sharing data is becoming popular. Participating institutions might not contribute equally, some contribute more data, some better…

With the widespread accumulation of observational data, researchers obtain a new direction to learn counterfactual effects in many domains (e.g., health care and computational advertising) without Randomized Controlled Trials(RCTs).…

机器学习 · 计算机科学 2021-11-01 Guanglin Zhou , Lina Yao , Xiwei Xu , Chen Wang , Liming Zhu

Explainable artificial intelligence promises to yield insights into relevant features, thereby enabling humans to examine and scrutinize machine learning models or even facilitating scientific discovery. Considering the widespread technique…

机器学习 · 计算机科学 2026-03-30 Jörg Martin , Stefan Haufe

While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models…

机器学习 · 计算机科学 2021-12-01 Jason Ramapuram , Dan Busbridge , Xavier Suau , Russ Webb

Explainable Artificial Intelligence (XAI) has received widespread interest in recent years, and two of the most popular types of explanations are feature attributions, and counterfactual explanations. These classes of approaches have been…

人工智能 · 计算机科学 2023-07-14 Emanuele Albini , Shubham Sharma , Saumitra Mishra , Danial Dervovic , Daniele Magazzeni

Dynamic discrete choice (DDC) models have found widespread application in marketing. However, estimating these becomes challenging in "big data" settings with high-dimensional state-action spaces. To address this challenge, this paper…

计量经济学 · 经济学 2026-01-06 Ahmed Khwaja , Sonal Srivastava

Collaborative machine learning enables multiple data owners to jointly train models for improved predictive performance. However, ensuring incentive compatibility and fair contribution-based rewards remains a critical challenge. Prior work…

计算机科学与博弈论 · 计算机科学 2025-10-16 Björn Filter , Ralf Möller , Özgür Lütfü Özçep

Counterfactual explanations play an important role in detecting bias and improving the explainability of data-driven classification models. A counterfactual explanation (CE) is a minimal perturbed data point for which the decision of the…

机器学习 · 计算机科学 2023-10-27 Donato Maragno , Jannis Kurtz , Tabea E. Röber , Rob Goedhart , Ş. Ilker Birbil , Dick den Hertog

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

机器学习 · 计算机科学 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Counterfactual explanations interpret the recommendation mechanism via exploring how minimal alterations on items or users affect the recommendation decisions. Existing counterfactual explainable approaches face huge search space and their…

信息检索 · 计算机科学 2022-07-15 Xiangmeng Wang , Qian Li , Dianer Yu , Guandong Xu

Counterfactual analysis is central to education market design and provides a foundation for credible policy recommendations. We develop a novel methodology for counterfactual analysis in Gale-Shapley deferred-acceptance (DA) assignment…

计量经济学 · 经济学 2025-12-10 Lixiong Li , Ismaël Mourifié

Counterfactual explanation methods have recently received significant attention for explaining CNN-based image classifiers due to their ability to provide easily understandable explanations that align more closely with human reasoning.…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Syed Ali Tariq , Tehseen Zia

Explainable artificial intelligence (XAI) has become increasingly important in decision-critical domains such as healthcare, finance, and law. Counterfactual (CF) explanations, a key approach in XAI, provide users with actionable insights…

人工智能 · 计算机科学 2025-07-22 Volkan Bakir , Polat Goktas , Sureyya Akyuz

Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Given the impact of these decisions on individuals, organizations, and population groups, it is essential to understand…

人工智能 · 计算机科学 2025-07-29 Venetia Pliatsika , Joao Fonseca , Kateryna Akhynko , Ivan Shevchenko , Julia Stoyanovich