English
Related papers

Related papers: Beyond Output Faithfulness: Learning Attributions …

200 papers

In this paper, we study the framework of collaborative inference, or edge ensembles. This framework enables multiple edge devices to improve classification accuracy by exchanging intermediate features rather than raw observations. However,…

Information Theory · Computer Science 2025-10-03 Mateus P. Mota , Mattia Merluzzi , Emilio Calvanese Strinati

A salient approach to interpretable machine learning is to restrict modeling to simple models. In the Bayesian framework, this can be pursued by restricting the model structure and prior to favor interpretable models. Fundamentally,…

Machine Learning · Computer Science 2020-09-08 Homayun Afrabandpey , Tomi Peltola , Juho Piironen , Aki Vehtari , Samuel Kaski

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

Machine Learning · Computer Science 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso

AI for Science (AI4Science) workflows often treat the released dataset as a fixed interface to the underlying system. However, in domains relying on \emph{indirect observation}, the learner observes a derivative representation produced by…

Machine Learning · Computer Science 2026-05-26 Ling Zhan , Xiaoyao Yu , Tao Jia

In recent years, model explanation methods have been designed to interpret model decisions faithfully and intuitively so that users can easily understand them. In this paper, we propose a framework, Faithful Attention Explainer (FAE),…

Computation and Language · Computer Science 2024-05-28 Yao Rong , David Scheerer , Enkelejda Kasneci

This paper introduces the Translational Evaluation of Multimodal AI for Inspection (TEMAI) framework, bridging multimodal AI capabilities with industrial inspection implementation. Adapting translational research principles from healthcare…

Human-Computer Interaction · Computer Science 2025-04-22 Zehan Li , Jinzhi Deng , Haibing Ma , Chi Zhang , Dan Xiao

Deep neural networks are increasingly employed in high-stakes medical applications, despite their tendency for shortcut learning in the presence of spurious correlations, which can have potentially fatal consequences in practice. Whereas a…

Artificial Intelligence · Computer Science 2025-07-30 Frederik Pahde , Thomas Wiegand , Sebastian Lapuschkin , Wojciech Samek

Inference amortization methods share information across multiple posterior-inference problems, allowing each to be carried out more efficiently. Generally, they require the inversion of the dependency structure in the generative model, as…

Machine Learning · Statistics 2018-11-30 Stefan Webb , Adam Golinski , Robert Zinkov , N. Siddharth , Tom Rainforth , Yee Whye Teh , Frank Wood

Activation engineering is becoming increasingly popular as a means of online control of large language models (LLMs). In this work, we extend the idea of inference-time steering with vectors that represent a behavioral direction of interest…

Machine Learning · Computer Science 2024-11-26 Christopher M. Ackerman

Explainable AI (xAI) interventions aim to improve interpretability for complex black-box models, not only to improve user trust but also as a means to extract scientific insights from high-performing predictive systems. In molecular…

Machine Learning · Computer Science 2025-04-04 Jonas Teufel , Annika Leinweber , Pascal Friederich

We propose a framework in which multiple entities collaborate to build a machine learning model while preserving privacy of their data. The approach utilizes feature embeddings from shared/per-entity feature extractors transforming data…

Machine Learning · Computer Science 2022-12-14 Alireza Sarmadi , Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Explainable AI (XAI) builds trust in complex systems through model attribution methods that reveal the decision rationale. However, due to the absence of a unified optimal explanation, existing XAI methods lack a ground truth for objective…

Machine Learning · Computer Science 2025-08-06 Yuhan Guo , Lizhong Ding , Shihan Jia , Yanyu Ren , Pengqi Li , Jiarun Fu , Changsheng Li , Ye yuan , Guoren Wang

Methods for building fair predictors often involve tradeoffs between fairness and accuracy and between different fairness criteria, but the nature of these tradeoffs varies. Recent work seeks to characterize these tradeoffs in specific…

Machine Learning · Statistics 2021-09-02 Alan Mishler , Edward Kennedy

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it…

Machine Learning · Computer Science 2025-10-07 David S. Johnson , Olya Hakobyan , Hanna Drimalla

Machine learning models are widely used in real-world applications. However, their complexity makes it often challenging to interpret the rationale behind their decisions. Counterfactual explanations (CEs) have emerged as a viable solution…

Machine Learning · Computer Science 2024-03-04 Muhammad Suffian , Jose M. Alonso-Moral , Alessandro Bogliolo

Bayesian statistical inference loses predictive optimality when generative models are misspecified. Working within an existing coherent loss-based generalisation of Bayesian inference, we show existing Modular/Cut-model inference is…

Methodology · Statistics 2026-05-18 Chris U. Carmona , Geoff K. Nicholls

Interpretability is a crucial aspect of machine learning models that enables humans to understand and trust the decision-making process of these models. In many real-world applications, the interpretability of models is essential for legal,…

Machine Learning · Statistics 2023-07-18 Shree Charran R , Sandipan Das Mahapatra

The self-attention mechanism has been adopted in various popular message passing neural networks (MPNNs), enabling the model to adaptively control the amount of information that flows along the edges of the underlying graph. Such…

Machine Learning · Computer Science 2024-12-23 Yong-Min Shin , Siqing Li , Xin Cao , Won-Yong Shin

Real-world problems are often dependent on multiple data modalities, making multimodal fusion essential for leveraging diverse information sources. In high-stakes domains, such as in healthcare, understanding how each modality contributes…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Mafalda Malafaia , Thalea Schlender , Tanja Alderliesten , Peter A. N. Bosman