中文
相关论文

相关论文: "Why did you do that?": Explaining black box model…

200 篇论文

Multimodal classifiers function as opaque black box models. While several techniques exist to interpret their predictions, very few of them are as intuitive and accessible as natural language explanations (NLEs). To build trust, such…

计算与语言 · 计算机科学 2025-12-09 Dibyanayan Bandyopadhyay , Soham Bhattacharjee , Mohammed Hasanuzzaman , Asif Ekbal

An increasing number of machine learning models have been deployed in domains with high stakes such as finance and healthcare. Despite their superior performances, many models are black boxes in nature which are hard to explain. There are…

机器学习 · 统计学 2021-06-16 Zhengze Zhou , Giles Hooker , Fei Wang

With the advancement of technology for artificial intelligence (AI) based solutions and analytics compute engines, machine learning (ML) models are getting more complex day by day. Most of these models are generally used as a black box…

机器学习 · 计算机科学 2022-10-11 P. Sai Ram Aditya , Mayukha Pal

Generating synthetic datasets that accurately reflect real-world observational data is critical for evaluating causal estimators, but it remains a challenging task. Existing generative methods offer a solution by producing synthetic…

机器学习 · 计算机科学 2026-04-07 Pracheta Amaranath , Vinitra Muralikrishnan , Amit Sharma , David Jensen

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

机器学习 · 计算机科学 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

We propose ARISE, a framework that iteratively induces rules and generates synthetic data for text classification. We combine synthetic data generation and automatic rule induction, via bootstrapping, to iteratively filter the generated…

计算与语言 · 计算机科学 2025-02-11 Yashwanth M. , Vaibhav Singh , Ayush Maheshwari , Amrith Krishna , Ganesh Ramakrishnan

Explainability methods for NLP systems encounter a version of the fundamental problem of causal inference: for a given ground-truth input text, we never truly observe the counterfactual texts necessary for isolating the causal effects of…

计算与语言 · 计算机科学 2022-09-29 Zhengxuan Wu , Karel D'Oosterlinck , Atticus Geiger , Amir Zur , Christopher Potts

Counterfactual explanations have emerged as a promising method for elucidating the behavior of opaque black-box models. Recently, several works leveraged pixel-space diffusion models for counterfactual generation. To handle noisy,…

机器学习 · 计算机科学 2023-10-11 Karim Farid , Simon Schrodi , Max Argus , Thomas Brox

This paper attempts to answer a central question in unsupervised learning: what does it mean to "make sense" of a sensory sequence? In our formalization, making sense involves constructing a symbolic causal theory that both explains the…

人工智能 · 计算机科学 2020-07-15 Richard Evans , Jose Hernandez-Orallo , Johannes Welbl , Pushmeet Kohli , Marek Sergot

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

机器学习 · 计算机科学 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

Modern Artificial Intelligence (AI) enabled Intrusion Detection Systems (IDS) are complex black boxes. This means that a security analyst will have little to no explanation or clarification on why an IDS model made a particular prediction.…

密码学与安全 · 计算机科学 2022-07-18 Jesse Ables , Thomas Kirby , William Anderson , Sudip Mittal , Shahram Rahimi , Ioana Banicescu , Maria Seale

Although neural networks can achieve very high predictive performance on various different tasks such as image recognition or natural language processing, they are often considered as opaque "black boxes". The difficulty of interpreting the…

机器学习 · 统计学 2020-01-22 Enguerrand Horel , Virgile Mison , Tao Xiong , Kay Giesecke , Lidia Mangu

In designing generative models, it is commonly believed that in order to learn useful latent structure, we face a fundamental tension between expressivity and structure. In this paper we challenge this view by proposing a new approach to…

机器学习 · 统计学 2026-04-03 Alex Markham , Isaac Hirsch , Jeri A. Chang , Liam Solus , Bryon Aragam

We interpret the predictions of any black-box structured input-structured output model around a specific input-output pair. Our method returns an "explanation" consisting of groups of input-output tokens that are causally related. These…

机器学习 · 计算机科学 2017-11-16 David Alvarez-Melis , Tommi S. Jaakkola

Existing Causal-Why Video Question Answering (VideoQA) models often struggle with higher-order reasoning, relying on opaque, monolithic pipelines that entangle video understanding, causal inference, and answer generation. These black-box…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Paritosh Parmar , Eric Peh , Basura Fernando

Existing multi-behavior recommendations tend to prioritize performance at the expense of explainability, while current explainable methods suffer from limited generalizability due to their reliance on external information. Neuro-Symbolic…

人工智能 · 计算机科学 2026-01-30 Yuzhe Chen , Jie Cao , Youquan Wang , Haicheng Tao , Darko B. Vukovic , Jia Wu

We are used to the availability of big data generated in nearly all fields of science as a consequence of technological progress. However, the analysis of such data possess vast challenges. One of these relates to the explainability of…

人工智能 · 计算机科学 2022-09-14 Frank Emmert-Streib , Olli Yli-Harja , Matthias Dehmer

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Humans can observe a single, imperfect demonstration and immediately generalize to very different problem settings. Robots, in contrast, often require hundreds of examples and still struggle to generalize beyond the training conditions. We…

机器人学 · 计算机科学 2025-08-13 Ben Zandonati , Tomás Lozano-Pérez , Leslie Pack Kaelbling

As black-box machine learning models grow in complexity and find applications in high-stakes scenarios, it is imperative to provide explanations for their predictions. Although Local Interpretable Model-agnostic Explanations (LIME) [22] is…

机器学习 · 计算机科学 2023-11-28 Zeren Tan , Yang Tian , Jian Li