English
Related papers

Related papers: Explanation-Aware Experience Replay in Rule-Dense …

200 papers

Explainable Artificial Intelligence (XAI) has become critical in enhancing the transparency and trustworthiness of AI systems, especially as these systems are increasingly deployed in high-stakes domains such as healthcare and finance.…

Symbolic Computation · Computer Science 2024-08-13 Shengxin Hong , Xiuyi Fan

The unprecedented performance of machine learning models in recent years, particularly Deep Learning and transformer models, has resulted in their application in various domains such as finance, healthcare, and education. However, the…

Human-Computer Interaction · Computer Science 2023-12-20 Milad Rogha

Exploration strategy design is one of the challenging problems in reinforcement learning~(RL), especially when the environment contains a large state space or sparse rewards. During exploration, the agent tries to discover novel areas or…

Machine Learning · Computer Science 2019-06-07 Xiao Ma , Shen-Yi Zhao , Wu-Jun Li

Explainable AI (XAI) is an important developing area but remains relatively understudied for clustering. We propose an explainable-by-design clustering approach that not only finds clusters but also exemplars to explain each cluster. The…

Artificial Intelligence · Computer Science 2022-09-21 Ian Davidson , Michael Livanos , Antoine Gourru , Peter Walker , Julien Velcin , S. S. Ravi

It is known that reinforcement learning (RL) is data-hungry. To improve sample-efficiency of RL, it has been proposed that the learning algorithm utilize data from 'approximately similar' processes. However, since the process models are…

Machine Learning · Computer Science 2025-11-24 Vinay Kanakeri , Shivam Bajaj , Ashwin Verma , Vijay Gupta , Aritra Mitra

The goal of continuous control is to synthesize desired behaviors. In reinforcement learning (RL)-driven approaches, this is often accomplished through careful task reward engineering for efficient exploration and running an off-the-shelf…

Experience replay enables data-efficient learning from past experiences in online reinforcement learning agents. Traditionally, experiences were sampled uniformly from a replay buffer, regardless of differences in experience-specific…

Machine Learning · Computer Science 2025-12-16 Leonard S. Pleiss , Tobias Sutter , Maximilian Schiffer

Explaining how to get from A to B can be challenging. It requires mentally simulating what the listener will do based on what they are told. To capture this process, we propose a computational model that converts utterances into action…

Computation and Language · Computer Science 2026-05-12 Hanqi Zhou , Britt Besch , Charley M. Wu , Tobias Gerstenberg

Artificial intelligence (AI) has been embedded into many aspects of people's daily lives and it has become normal for people to have AI make decisions for them. Reinforcement learning (RL) models increase the space of solvable problems with…

Artificial Intelligence · Computer Science 2022-03-23 Agneza Krajna , Mario Brcic , Tomislav Lipic , Juraj Doncevic

While deep neural networks have achieved impressive performance on a range of NLP tasks, these data-hungry models heavily rely on labeled data, which restricts their applications in scenarios where data annotation is expensive. Natural…

Computation and Language · Computer Science 2020-02-17 Ziqi Wang , Yujia Qin , Wenxuan Zhou , Jun Yan , Qinyuan Ye , Leonardo Neves , Zhiyuan Liu , Xiang Ren

Explainable AI (XAI) aims to make AI systems more transparent, yet many practices emphasise mathematical rigour over practical user needs. We propose an alternative to this model-centric approach by following a design thinking process for…

Human-Computer Interaction · Computer Science 2025-11-03 Elisa Nguyen , Johannes Bertram , Evgenii Kortukov , Jean Y. Song , Seong Joon Oh

Developing autonomous vehicles (AVs) requires not only safety and efficiency, but also realistic, human-like behaviors that are socially aware and predictable. Achieving this requires sim agent policies that are human-like, fast, and…

Machine Learning · Computer Science 2026-02-26 Wei-Jer Chang , Akshay Rangesh , Kevin Joseph , Matthew Strong , Masayoshi Tomizuka , Yihan Hu , Wei Zhan

Autonomous navigation in dense traffic scenarios remains challenging for autonomous vehicles (AVs) because the intentions of other drivers are not directly observable and AVs have to deal with a wide range of driving behaviors. To maneuver…

Robotics · Computer Science 2021-07-12 Bruno Brito , Achin Agarwal , Javier Alonso-Mora

Experience replay lets online reinforcement learning agents remember and reuse experiences from the past. In prior work, experience transitions were uniformly sampled from a replay memory. However, this approach simply replays transitions…

Machine Learning · Computer Science 2016-02-26 Tom Schaul , John Quan , Ioannis Antonoglou , David Silver

Reinforcement learning policies are typically represented by black-box neural networks, which are non-interpretable and not well-suited for safety-critical domains. To address both of these issues, we propose constrained normalizing flow…

Machine Learning · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes A. Stork

Learning new tasks accumulatively without forgetting remains a critical challenge in continual learning. Generative experience replay addresses this challenge by synthesizing pseudo-data points for past learned tasks and later replaying…

Machine Learning · Computer Science 2023-10-09 Zizhao Hu , Mohammad Rostami

The difficulty of identifying the physical model of complex systems has led to exploring methods that do not rely on such complex modeling of the systems. Deep reinforcement learning has been the pioneer for solving this problem without the…

Artificial Intelligence · Computer Science 2023-10-31 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Conflicting explanations, arising from different attribution methods or model internals, limit the adoption of machine learning models in safety-critical domains. We turn this disagreement into an advantage and introduce EXplanation…

Machine Learning · Computer Science 2025-11-18 Sichao Li , Tommy Liu , Quanling Deng , Amanda S. Barnard

As Artificial Intelligence (AI) systems continue to grow in size and complexity, so does the difficulty of the quest for AI transparency. In a world of large models and complex AI systems, why do we explain AI and what should we explain?…

Artificial Intelligence · Computer Science 2026-04-23 Karina Cortinas-Lorenzo , Gavin Doherty

Explainability plays a crucial role in providing a more comprehensive understanding of deep learning models' behaviour. This allows for thorough validation of the model's performance, ensuring that its decisions are based on relevant visual…

Machine Learning · Computer Science 2023-06-16 E. Zhixuan Zeng , Hayden Gunraj , Sheldon Fernandez , Alexander Wong