English
Related papers

Related papers: Improving Model's Interpretability and Reliability…

200 papers

Recent efforts in Machine Learning (ML) interpretability have focused on creating methods for explaining black-box ML models. However, these methods rely on the assumption that simple approximations, such as linear models or decision-trees,…

Machine Learning · Computer Science 2019-06-13 Owen Lahav , Nicholas Mastronarde , Mihaela van der Schaar

We propose DeepMiner, a framework to discover interpretable representations in deep neural networks and to build explanations for medical predictions. By probing convolutional neural networks (CNNs) trained to classify cancer in mammograms,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jimmy Wu , Bolei Zhou , Diondra Peck , Scott Hsieh , Vandana Dialani , Lester Mackey , Genevieve Patterson

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

Nowadays, deep neural networks are being used in many domains because of their high accuracy results. However, they are considered as "black box", means that they are not explainable for humans. On the other hand, in some tasks such as…

Machine Learning · Computer Science 2022-04-08 Niloofar Ranjbar , Reza Safabakhsh

In explainable artificial intelligence (XAI) research, the predominant focus has been on interpreting models for experts and practitioners. Model agnostic and local explanation approaches are deemed interpretable and sufficient in many…

Artificial Intelligence · Computer Science 2024-02-01 Adarsa Sivaprasad , Ehud Reiter , Nava Tintarev , Nir Oren

This paper explores interpretability techniques for two of the most successful learning algorithms in medical decision-making literature: deep neural networks and random forests. We applied these algorithms in a real-world medical dataset…

Machine Learning · Computer Science 2020-02-24 Catarina Moreira , Renuka Sindhgatta , Chun Ouyang , Peter Bruza , Andreas Wichert

Interpretability of machine learning models is critical for data-driven precision medicine efforts. However, highly predictive models are generally complex and are difficult to interpret. Here using Model-Agnostic Explanations algorithm, we…

Quantitative Methods · Quantitative Biology 2016-10-31 Gajendra Jung Katuwal , Robert Chen

The wide-spread adoption of representation learning technologies in clinical decision making strongly emphasizes the need for characterizing model reliability and enabling rigorous introspection of model behavior. While the former need is…

Machine Learning · Computer Science 2020-05-01 Jayaraman J. Thiagarajan , Prasanna Sattigeri , Deepta Rajan , Bindya Venkatesh

Prediction of survival in patients diagnosed with a brain tumour is challenging because of heterogeneous tumour behaviours and responses to treatment. Better estimations of prognosis would support treatment planning and patient support.…

Machine Learning · Computer Science 2021-06-18 Colleen E. Charlton , Michael Tin Chung Poon , Paul M. Brennan , Jacques D. Fleuriot

Verification of biomedical claims is critical for healthcare decision-making, public health policy and scientific research. We present an interactive biomedical claim verification system by integrating LLMs, transparent model explanations,…

Human-Computer Interaction · Computer Science 2025-03-03 Siting Liang , Daniel Sonntag

Model interpretability is an increasingly important component of practical machine learning. Some of the most common forms of interpretability systems are example-based, local, and global explanations. One of the main challenges in…

Machine Learning · Computer Science 2019-01-08 Gregory Plumb , Denali Molitor , Ameet Talwalkar

Interpretable classification models are built with the purpose of providing a comprehensible description of the decision logic to an external oversight agent. When considered in isolation, a decision tree, a set of classification rules, or…

Machine Learning · Computer Science 2019-03-18 Riccardo Guidotti , Salvatore Ruggieri

Deep learning shows promise for medical image analysis but lacks interpretability, hindering adoption in healthcare. Attribution techniques that explain model reasoning may increase trust in deep learning among clinical stakeholders. This…

Machine Learning · Computer Science 2023-08-08 Yusuf Brima , Marcellin Atemkeng

Machine learning models that offer excellent predictive performance often lack the interpretability necessary to support integrated human machine decision-making. In clinical medicine and other high-risk settings, domain experts may be…

Machine Learning · Computer Science 2021-04-19 Zach Wood-Doughty , Isabel Cachola , Mark Dredze

Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a…

Machine Learning · Computer Science 2016-08-10 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

The increasing availability of large collections of electronic health record (EHR) data and unprecedented technical advances in deep learning (DL) have sparked a surge of research interest in developing DL based clinical decision support…

Machine Learning · Computer Science 2021-12-07 Di Jin , Elena Sergeeva , Wei-Hung Weng , Geeticka Chauhan , Peter Szolovits

Model interpretability has become an important problem in machine learning (ML) due to the increased effect that algorithmic decisions have on humans. Counterfactual explanations can help users understand not only why ML models make certain…

Machine Learning · Computer Science 2021-12-20 Ana Lucic , Harrie Oosterhuis , Hinda Haned , Maarten de Rijke

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Interpretable deep learning is a fundamental building block towards safer AI, especially when the deployment possibilities of deep learning-based computer-aided medical diagnostic systems are so eminent. However, without a computational…

Machine Learning · Computer Science 2018-06-27 Anirban Mukhopadhyay

Digital mammography is essential to breast cancer detection, and deep learning offers promising tools for faster and more accurate mammogram analysis. In radiology and other high-stakes environments, uninterpretable ("black box") deep…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Julia Yang , Alina Jade Barnett , Jon Donnelly , Satvik Kishore , Jerry Fang , Fides Regina Schwartz , Chaofan Chen , Joseph Y. Lo , Cynthia Rudin