English
Related papers

Related papers: A model local interpretation routine for deep lear…

200 papers

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Given the pressing need for assuring algorithmic transparency, Explainable AI (XAI) has emerged as one of the key areas of AI research. In this paper, we develop a novel Bayesian extension to the LIME framework, one of the most widely used…

Artificial Intelligence · Computer Science 2021-06-01 Xingyu Zhao , Wei Huang , Xiaowei Huang , Valentin Robu , David Flynn

Digital mammography is essential to breast cancer detection, and deep learning offers promising tools for faster and more accurate mammogram analysis. In radiology and other high-stakes environments, uninterpretable ("black box") deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Julia Yang , Alina Jade Barnett , Jon Donnelly , Satvik Kishore , Jerry Fang , Fides Regina Schwartz , Chaofan Chen , Joseph Y. Lo , Cynthia Rudin

Nowadays, deep neural networks are being used in many domains because of their high accuracy results. However, they are considered as "black box", means that they are not explainable for humans. On the other hand, in some tasks such as…

Machine Learning · Computer Science 2022-04-08 Niloofar Ranjbar , Reza Safabakhsh

Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little…

Machine Learning · Statistics 2018-06-26 Richard L. Phillips , Kyu Hyun Chang , Sorelle A. Friedler

We explore the observational implications of a large systematic study of high-resolution three dimensional simulations of radio galaxies driven by supersonic jets. For this fiducial study, we employ non-relativistic hydrodynamic adiabatic…

Astrophysics of Galaxies · Physics 2019-09-10 Michael D. Smith , Justin Donohoe

As black-box machine learning models grow in complexity and find applications in high-stakes scenarios, it is imperative to provide explanations for their predictions. Although Local Interpretable Model-agnostic Explanations (LIME) [22] is…

Machine Learning · Computer Science 2023-11-28 Zeren Tan , Yang Tian , Jian Li

We present a deep machine learning (ML) approach to constraining cosmological parameters with multi-wavelength observations of galaxy clusters. The ML approach has two components: an encoder that builds a compressed representation of each…

Instrumentation and Methods for Astrophysics · Physics 2022-02-16 Michelle Ntampaka , Alexey Vikhlinin

Methods for interpreting machine learning black-box models increase the outcomes' transparency and in turn generates insight into the reliability and fairness of the algorithms. However, the interpretations themselves could contain…

Machine Learning · Computer Science 2019-06-05 Yujia Zhang , Kuangyan Song , Yiming Sun , Sarah Tan , Madeleine Udell

Explainable Artificial Intelligence (XAI) methods, such as Local Interpretable Model-Agnostic Explanations (LIME), have advanced the interpretability of black-box machine learning models by approximating their behavior locally using…

Artificial Intelligence · Computer Science 2025-08-22 Rehan Raza , Guanjin Wang , Kok Wai Wong , Hamid Laga , Marco Fisichella

Despite the wide use of explainability techniques to attempt to understand the behavior of Artificial Intelligence (AI), the generated explanations may not always be reliable. An explanation can appear plausible to humans but fail to…

Machine Learning · Computer Science 2026-05-28 Tomás Pereira , João Vitorino , Eva Maia , Isabel Praça

Existing local Explainable AI (XAI) methods, such as LIME, select a region of the input space in the vicinity of a given input instance, for which they approximate the behaviour of a model using a simpler and more interpretable surrogate…

Machine Learning · Computer Science 2024-08-20 Saif Anwar , Nathan Griffiths , Abhir Bhalerao , Thomas Popham

LIME (Local Interpretable Model-agnostic Explanations) is a popular XAI framework for unraveling decision-making processes in vision machine-learning models. The technique utilizes image segmentation methods to identify fixed regions for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Patrick Knab , Sascha Marton , Christian Bartelt

Explainable AI (XAI) techniques have been widely used to help explain and understand the output of deep learning models in fields such as image classification and Natural Language Processing. Interest in using XAI techniques to explain deep…

Computation and Language · Computer Science 2023-05-30 Xiaoliang Wu , Peter Bell , Ajitha Rajan

Explainable Artificial Intelligence (XAI) has emerged as a critical tool for interpreting the predictions of complex deep learning models. While XAI has been increasingly applied in various domains within acoustics, its use in bioacoustics,…

Sound · Computer Science 2025-09-11 Zubair Faruqui , Mackenzie S. McIntire , Rahul Dubey , Jay McEntee

Machine learning techniques have been increasingly useful in astronomical applications over the last few years, for example in the morphological classification of galaxies. Convolutional neural networks have proven to be highly effective in…

Instrumentation and Methods for Astrophysics · Physics 2018-02-07 V. Lukic , M. Brüggen , J. K. Banfield , O. I. Wong , L. Rudnick , R. P. Norris , B. Simmons

Explainable Artificial Intelligence (XAI) has gained importance in interpreting model predictions. Among leading techniques for XAI, Local Interpretable Model-agnostic Explanations (LIME) is most frequently utilized as it notably helps…

Human-Computer Interaction · Computer Science 2026-02-05 Jeongmin Rhee , Changhee Lee , DongHwa Shin , Bohyoung Kim

Interpretability in machine learning models is important in high-stakes decisions, such as whether to order a biopsy based on a mammographic exam. Mammography poses important challenges that are not present in other computer vision tasks:…

Machine Learning · Computer Science 2021-03-24 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

As neural networks become dominant in essential systems, Explainable Artificial Intelligence (XAI) plays a crucial role in fostering trust and detecting potential misbehavior of opaque models. LIME (Local Interpretable Model-agnostic…

Machine Learning · Computer Science 2025-04-01 Patrick Knab , Sascha Marton , Udo Schlegel , Christian Bartelt

The classification of galaxy morphology plays a crucial role in understanding galaxy formation and evolution. Traditionally, this process is done manually. The emergence of deep learning techniques has given room for the automation of this…

Machine Learning · Computer Science 2022-04-06 Ezra Fielding , Clement N. Nyirenda , Mattia Vaccari