English
Related papers

Related papers: Explaining black-box text classifiers for disease-…

200 papers

Prediction of survival in patients diagnosed with a brain tumour is challenging because of heterogeneous tumour behaviours and responses to treatment. Better estimations of prognosis would support treatment planning and patient support.…

Machine Learning · Computer Science 2021-06-18 Colleen E. Charlton , Michael Tin Chung Poon , Paul M. Brennan , Jacques D. Fleuriot

Despite Convolutional Neural Networks having reached human-level performance in some medical tasks, their clinical use has been hindered by their lack of interpretability. Two major interpretability strategies have been proposed to tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 José Pereira Amorim , Pedro Henriques Abreu , João Santos , Henning Müller

The recent boom of large language models (LLMs) has re-ignited the hope that artificial intelligence (AI) systems could aid medical diagnosis. Yet despite dazzling benchmark scores, LLM assistants have yet to deliver measurable improvements…

Artificial Intelligence · Computer Science 2025-07-03 Matthew JY Kang , Wenli Yang , Monica R Roberts , Byeong Ho Kang , Charles B Malpas

Unsupervised black-box models are challenging to interpret. Indeed, most existing explainability methods require labels to select which component(s) of the black-box's output to interpret. In the absence of labels, black-box outputs often…

Machine Learning · Computer Science 2022-06-10 Jonathan Crabbé , Mihaela van der Schaar

The adoption of intelligent systems creates opportunities as well as challenges for medical work. On the positive side, intelligent systems have the potential to compute complex data from patients and generate automated diagnosis…

Human-Computer Interaction · Computer Science 2019-02-19 Yao Xie , Ge Gao , Xiang 'Anthony' Chen

Deep neural networks are becoming more and more popular due to their revolutionary success in diverse areas, such as computer vision, natural language processing, and speech recognition. However, the decision-making processes of these…

Computation and Language · Computer Science 2021-10-15 Oana-Maria Camburu

With the advent of deep learning, text generation language models have improved dramatically, with text at a similar level as human-written text. This can lead to rampant misinformation because content can now be created cheaply and…

Computation and Language · Computer Science 2023-01-24 Sai Gurrapu , Lifu Huang , Feras A. Batarseh

An important limitation to the development of AI-based solutions for In Vitro Fertilization (IVF) is the black-box nature of most state-of-the-art models, due to the complexity of deep learning architectures, which raises potential bias and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Tristan Gomez , Thomas Fréour , Harold Mouchère

In medical imaging, particularly in early disease detection and prognosis tasks, discerning the rationale behind an AI model's predictions is crucial for evaluating the reliability of its decisions. Conventional explanation methods face…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yingying Fang , Zihao Jin , Xiaodan Xing , Simon Walsh , Guang Yang

Most modern approaches for audio processing are opaque, in the sense that they do not provide an explanation for their decisions. For this reason, various methods have been proposed to explain the outputs generated by these models. Good…

Sound · Computer Science 2025-10-21 Cecilia Bolaños , Leonardo Pepino , Martin Meza , Luciana Ferrer

Meta-learning is a field that aims at discovering how different machine learning algorithms perform on a wide range of predictive tasks. Such knowledge speeds up the hyperparameter tuning or feature engineering. With the use of surrogate…

Machine Learning · Statistics 2021-07-13 Katarzyna Woźnica , Przemysław Biecek

As post hoc explanation methods are increasingly being leveraged to explain complex models in high-stakes settings, it becomes critical to ensure that the quality of the resulting explanations is consistently high across various population…

Machine Learning · Computer Science 2022-07-05 Jessica Dai , Sohini Upadhyay , Ulrich Aivodji , Stephen H. Bach , Himabindu Lakkaraju

Recent advancement in machine learning algorithms reaches a point where medical devices can be equipped with artificial intelligence (AI) models for diagnostic support and routine automation in clinical settings. In medicine and healthcare,…

Machine Learning · Statistics 2025-02-21 Takeshi Abe , Yoshiyuki Asai

Post-hoc explainability is essential for understanding black-box machine learning models. Surrogate-based techniques are widely used for local and global model-agnostic explanations but have significant limitations. Local surrogates capture…

Machine Learning · Computer Science 2026-03-19 Simone Piaggesi , Riccardo Guidotti , Fosca Giannotti , Dino Pedreschi

Estimating personalized effects of treatments is a complex, yet pervasive problem. To tackle it, recent developments in the machine learning (ML) literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but…

Machine Learning · Computer Science 2022-06-17 Jonathan Crabbé , Alicia Curth , Ioana Bica , Mihaela van der Schaar

Medical experts may use Artificial Intelligence (AI) systems with greater trust if these are supported by contextual explanations that let the practitioner connect system inferences to their context of use. However, their importance in…

Several approaches have been developed for answering users' specific questions about AI behavior and for assessing their core functionality in terms of primitive executable actions. However, the problem of summarizing an AI agent's broad…

Artificial Intelligence · Computer Science 2022-05-31 Pulkit Verma , Shashank Rao Marpally , Siddharth Srivastava

The debate between self-interpretable models and post-hoc explanations for black-box models is central to Explainable AI (XAI). Self-interpretable models, such as concept-based networks, offer insights by connecting decisions to…

Machine Learning · Computer Science 2025-02-26 Shaobo Wang , Hongxuan Tang , Mingyang Wang , Hongrui Zhang , Xuyang Liu , Weiya Li , Xuming Hu , Linfeng Zhang

Deep learning models (DLMs) achieve increasingly high performance both on structured and unstructured data. They significantly extended applicability of machine learning to various domains. Their success in making predictions, detecting…

Artificial Intelligence · Computer Science 2025-01-03 Matej Mihelčić , Ivan Grubišić , Miha Keber

Explainability in time series models is crucial for fostering trust, facilitating debugging, and ensuring interpretability in real-world applications. In this work, we introduce Implet, a novel post-hoc explainer that generates accurate and…

Machine Learning · Computer Science 2025-05-14 Fanyu Meng , Ziwen Kan , Shahbaz Rezaei , Zhaodan Kong , Xin Chen , Xin Liu