English
Related papers

Related papers: A Framework for Interpretability in Machine Learni…

200 papers

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

Machine Learning · Computer Science 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is…

Machine Learning · Computer Science 2020-05-01 Jayaraman J. Thiagarajan , Prasanna Sattigeri , Deepta Rajan , Bindya Venkatesh

Interpretability of machine learning models is critical for data-driven precision medicine efforts. However, highly predictive models are generally complex and are difficult to interpret. Here using Model-Agnostic Explanations algorithm, we…

Quantitative Methods · Quantitative Biology 2016-10-31 Gajendra Jung Katuwal , Robert Chen

Machine learning methods can be a valuable aid in the scientific process, but they need to face challenging settings where data come from inhomogeneous experimental conditions. Recent meta-learning methods have made significant progress in…

Machine Learning · Computer Science 2024-03-21 Matthieu Blanke , Marc Lelarge

As large language models (LLMs) continue to advance, there is a growing urgency to enhance the interpretability of their internal knowledge mechanisms. Consequently, many interpretation methods have emerged, aiming to unravel the knowledge…

Computation and Language · Computer Science 2025-06-11 Jiaxiang Liu , Boxuan Xing , Chenhao Yuan , Chenxiang Zhang , Di Wu , Xiusheng Huang , Haida Yu , Chuhan Lang , Pengfei Cao , Jun Zhao , Kang Liu

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Classification and segmentation are crucial in medical image analysis as they enable accurate diagnosis and disease monitoring. However, current methods often prioritize the mutual learning features and shared model parameters, while…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Kai Ren , Ke Zou , Xianjie Liu , Yidi Chen , Xuedong Yuan , Xiaojing Shen , Meng Wang , Huazhu Fu

Large language models (LLMs) are often portrayed as merely imitating linguistic patterns without genuine understanding. We argue that recent findings in mechanistic interpretability (MI), the emerging field probing the inner workings of…

Computation and Language · Computer Science 2026-02-26 Pierre Beckmann , Matthieu Queloz

In response to the COVID-19 pandemic, the integration of interpretable machine learning techniques has garnered significant attention, offering transparent and understandable insights crucial for informed clinical decision making. This…

Machine Learning · Computer Science 2024-09-10 Jinzhi Shen , Ke Ma

As machine learning becomes an important part of many real world applications affecting human lives, new requirements, besides high predictive accuracy, become important. One important requirement is transparency, which has been associated…

Machine Learning · Computer Science 2019-08-01 Tiago Botari , Rafael Izbicki , Andre C. P. L. F. de Carvalho

Artificial Intelligence is providing astonishing results, with medicine being one of its favourite playgrounds. In a few decades, computers may be capable of formulating diagnoses and choosing the correct treatment, while robots may perform…

Clinical decisions are high-stakes and require explicit justification, making model interpretability essential for auditing deep clinical models prior to deployment. As the ecosystem of model architectures and explainability methods…

Machine Learning · Computer Science 2026-03-27 Yongda Fan , John Wu , Andrea Fitzpatrick , Naveen Baskaran , Jimeng Sun , Adam Cross

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

This article proposes a new integration of linguistic anthropology and machine learning (ML) around convergent interests in both the underpinnings of language and making language technologies more socially responsible. While linguistic…

Computers and Society · Computer Science 2024-11-11 Graham M. Jones , Shai Satran , Arvind Satyanarayan

Clinical adoption of deep learning models has been hindered, in part, because the black-box nature of neural networks leads to concerns regarding their trustworthiness and reliability. These concerns are particularly relevant in the field…

Image and Video Processing · Electrical Eng. & Systems 2024-06-27 Lindsay Munroe , Mariana da Silva , Faezeh Heidari , Irina Grigorescu , Simon Dahan , Emma C. Robinson , Maria Deprez , Po-Wah So

Machine learning (ML) has seen significant growth in both popularity and importance. The high prediction accuracy of ML models is often achieved through complex black-box architectures that are difficult to interpret. This interpretability…

Machine Learning · Statistics 2024-07-29 David Köhler , David Rügamer , Matthias Schmid

The ability to interpret machine learning model decisions is critical in such domains as healthcare, where trust in model predictions is as important as their accuracy. Inspired by the development of prototype parts-based deep neural…

Machine Learning · Computer Science 2026-03-06 Jacek Karolczak , Jerzy Stefanowski

The escalating integration of machine learning in high-stakes fields such as healthcare raises substantial concerns about model fairness. We propose an interpretable framework - Fairness-Aware Interpretable Modeling (FAIM), to improve model…

Machine Learning · Computer Science 2024-03-11 Mingxuan Liu , Yilin Ning , Yuhe Ke , Yuqing Shang , Bibhas Chakraborty , Marcus Eng Hock Ong , Roger Vaughan , Nan Liu

Despite increasing interest in the field of Interpretable Machine Learning (IML), a significant gap persists between the technical objectives targeted by researchers' methods and the high-level goals of consumers' use cases. In this work,…

Machine Learning · Computer Science 2021-07-30 Valerie Chen , Jeffrey Li , Joon Sik Kim , Gregory Plumb , Ameet Talwalkar

Despite the recent success of neural network models in mimicking animal performance on visual perceptual tasks, critics worry that these models fail to illuminate brain function. We take it that a central approach to explanation in systems…

Neurons and Cognition · Quantitative Biology 2021-04-13 Rosa Cao , Daniel Yamins