English
Related papers

Related papers: Explaining Black-box Models for Biomedical Text Cl…

200 papers

Intelligent systems that use Machine Learning classification algorithms are increasingly common in everyday society. However, many systems use black-box models that do not have characteristics that allow for self-explanation of their…

We propose Black Box Explanations through Transparent Approximations (BETA), a novel model agnostic framework for explaining the behavior of any black-box classifier by simultaneously optimizing for fidelity to the original model and…

Artificial Intelligence · Computer Science 2017-07-06 Himabindu Lakkaraju , Ece Kamar , Rich Caruana , Jure Leskovec

Accurate and robust prediction of patient's response to drug treatments is critical for developing precision medicine. However, it is often difficult to obtain a sufficient amount of coherent drug response data from patients directly for…

Machine Learning · Computer Science 2021-02-02 Di He , Lei Xie

For many use-cases, it is often important to explain the prediction of a black-box model by identifying the most influential training data samples. Existing approaches lack customization for user intent and often provide a homogeneous set…

Machine Learning · Computer Science 2024-08-09 Ikhtiyor Nematov , Dimitris Sacharidis , Tomer Sagi , Katja Hose

As machine learning black boxes are increasingly being deployed in domains such as healthcare and criminal justice, there is growing emphasis on building tools and techniques for explaining these black boxes in an interpretable manner. Such…

Machine Learning · Computer Science 2020-02-04 Dylan Slack , Sophie Hilgard , Emily Jia , Sameer Singh , Himabindu Lakkaraju

Methods for interpreting machine learning black-box models increase the outcomes' transparency and in turn generates insight into the reliability and fairness of the algorithms. However, the interpretations themselves could contain…

Machine Learning · Computer Science 2019-06-05 Yujia Zhang , Kuangyan Song , Yiming Sun , Sarah Tan , Madeleine Udell

Ever-expanding volumes of biomedical text require automated semantic annotation techniques to curate and put to best use. An established field of research seeks to link mentions in text to knowledge bases such as those included in the UMLS…

Artificial Intelligence · Computer Science 2018-11-13 Genevieve Gorrell , Xingyi Song , Angus Roberts

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Automatic text summarization tools help users in biomedical domain to acquire their intended information from various textual resources more efficiently. Some of the biomedical text summarization systems put the basis of their sentence…

Computation and Language · Computer Science 2017-05-31 Milad Moradi , Nasser Ghadiri

Designing faithful yet accurate AI models is challenging, particularly in the field of individual treatment effect estimation (ITE). ITE prediction models deployed in critical settings such as healthcare should ideally be (i) accurate, and…

Machine Learning · Computer Science 2024-06-04 Yinjun Wu , Mayank Keoliya , Kan Chen , Neelay Velingker , Ziyang Li , Emily J Getzen , Qi Long , Mayur Naik , Ravi B Parikh , Eric Wong

After building a classifier with modern tools of machine learning we typically have a black box at hand that is able to predict well for unseen data. Thus, we get an answer to the question what is the most likely label of a given unseen…

Most state-of-the-art machine learning algorithms induce black-box models, preventing their application in many sensitive domains. Hence, many methodologies for explaining machine learning models have been proposed to address this problem.…

Machine Learning · Computer Science 2020-09-15 Tiago Botari , Frederik Hvilshøj , Rafael Izbicki , Andre C. P. L. F. de Carvalho

Recent advances in large language models (LLMs) and biomedical foundation models (BioFMs) have achieved strong results in biological text reasoning, molecular modeling, and single-cell analysis, yet they remain siloed in disjoint embedding…

Quantitative Methods · Quantitative Biology 2025-10-03 Ching-Huei Tsou , Michal Ozery-Flato , Ella Barkan , Diwakar Mahajan , Ben Shapira

We propose a novel eXplainable AI algorithm to compute faithful, easy-to-understand, and complete global decision rules from local explanations for tabular data by combining XAI methods with closed frequent itemset mining. Our method can be…

Machine Learning · Computer Science 2025-04-02 Sebastian Müller , Vanessa Toborek , Tamás Horváth , Christian Bauckhage

We introduce BIOMRC, a large-scale cloze-style biomedical MRC dataset. Care was taken to reduce noise, compared to the previous BIOREAD dataset of Pappas et al. (2018). Experiments show that simple heuristics do not perform well on the new…

Computation and Language · Computer Science 2020-05-14 Petros Stavropoulos , Dimitris Pappas , Ion Androutsopoulos , Ryan McDonald

The rapid adoption of complex Artificial Intelligence (AI) and Machine Learning (ML) models has led to their characterization as black boxes due to the difficulty of explaining their internal decision-making processes. This lack of…

Machine Learning · Computer Science 2026-01-13 Silvia Ruiz-España , Laura Arnal , François Signol , Juan-Carlos Perez-Cortes , Joaquim Arlandis

Inner interpretability is a promising field aiming to uncover the internal mechanisms of AI systems through scalable, automated methods. While significant research has been conducted on large language models, limited attention has been paid…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jinyung Hong , Yearim Kim , Keun Hee Park , Sangyu Han , Nojun Kwak , Theodore P. Pavlic

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

In this paper we present a new approach to solve semi-supervised classification tasks for biomedical applications, involving a supervised autoencoder network. We create a network architecture that encodes labels into the latent space of an…

Machine Learning · Computer Science 2022-08-24 Cyprien Gille , Frederic Guyard , Michel Barlaud

Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of…