English
Related papers

Related papers: Beyond Black-Box Predictions: Identifying Marginal…

200 papers

End-to-end deep neural networks have achieved remarkable success across various domains but are often criticized for their lack of interpretability. While post hoc explanation methods attempt to address this issue, they often fail to…

Machine Learning · Computer Science 2025-01-22 Weixin Chen , Simon Yu , Huajie Shao , Lui Sha , Han Zhao

Deep neural networks are powerful and popular learning models that achieve state-of-the-art pattern recognition performance on many computer vision, speech, and language processing tasks. However, these networks have also been shown…

Machine Learning · Computer Science 2016-12-20 Nina Narodytska , Shiva Prasad Kasiviswanathan

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Academic tabular benchmarks often contain small sets of curated features. In contrast, data scientists typically collect as many features as possible into their datasets, and even engineer new features from existing ones. To prevent…

Recent foundation models for tabular data achieve strong task-specific performance via in-context learning. Nevertheless, they focus on direct prediction by encapsulating both representation learning and task-specific inference inside a…

Machine Learning · Computer Science 2026-02-05 Frederik Hoppe , Lars Kleinemeier , Astrid Franz , Udo Göbel

We introduce Matched Machine Learning, a framework that combines the flexibility of machine learning black boxes with the interpretability of matching, a longstanding tool in observational causal inference. Interpretability is paramount in…

Methodology · Statistics 2023-04-05 Marco Morucci , Cynthia Rudin , Alexander Volfovsky

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

Artificial neural networks have long been understood as "black boxes": though we know their computation graphs and learned parameters, the knowledge encoded by these weights and functions they perform are not inherently interpretable. As…

Artificial Intelligence · Computer Science 2024-08-13 Adam Davies , Ashkan Khakzar

Neural networks have become a popular tool in predictive modelling, more commonly associated with machine learning and artificial intelligence than with statistics. Generalised Additive Models (GAMs) are flexible non-linear statistical…

Machine Learning · Statistics 2026-01-06 Jessica Doohan , Lucas Kook , Kevin Burke

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of…

Machine Learning · Computer Science 2021-09-29 Fenglei Fan , Jinjun Xiong , Mengzhou Li , Ge Wang

Machine learning-based methods have achieved successful applications in machinery fault diagnosis. However, the main limitation that exists for these methods is that they operate as a black box and are generally not interpretable. This…

Machine Learning · Computer Science 2022-04-20 Gang Chen , Yu Lu , Rong Su , Zhaodan Kong

Deep Neural Networks (DNNs) excel at many tasks, often rivaling or surpassing human performance. Yet their internal processes remain elusive, frequently described as "black boxes." While performance can be refined experimentally, achieving…

Disordered Systems and Neural Networks · Physics 2025-02-03 Sebastiano Ariosto

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Deep networks are highly vulnerable to adversarial attacks, yet conventional attack methods utilize static adversarial perturbations that induce fixed mispredictions. In this work, we exploit an overlooked property of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yaoteng Tan , Zikui Cai , M. Salman Asif

Interpretability of AI models allows for user safety checks to build trust in these models. In particular, decision trees (DTs) provide a global view on the learned model and clearly outlines the role of the features that are critical to…

Machine Learning · Computer Science 2023-04-13 Hector Kohler , Riad Akrour , Philippe Preux

Deep neural networks (DNNs) are known as black-box models. In other words, it is difficult to interpret the internal state of the model. Improving the interpretability of DNNs is one of the hot research topics. However, at present, the…

Machine Learning · Computer Science 2019-09-17 Masanari Kimura , Masayuki Tanaka

To tackle increasingly complex tasks, it has become an essential ability of neural networks to learn abstract representations. These task-specific representations and, particularly, the invariances they capture turn neural networks into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Robin Rombach , Patrick Esser , Björn Ommer

Deep generative models, while revolutionizing fields like image and text generation, largely operate as opaque ``black boxes'', hindering human understanding, control, and alignment. While methods like sparse autoencoders (SAEs) show…

Machine Learning · Computer Science 2026-04-03 Lingjing Kong , Shaoan Xie , Guangyi Chen , Yuewen Sun , Xiangchen Song , Eric P. Xing , Kun Zhang

Despite their dominance in vision and language, deep neural networks often underperform relative to tree-based models on tabular data. To bridge this gap, we incorporate five key inductive biases into deep learning: robustness to irrelevant…

Machine Learning · Statistics 2026-03-24 Kry Yik Chau Lui , Cheng Chi , Kishore Basu , Yanshuai Cao