中文
相关论文

相关论文: Clarifying Model Transparency: Interpretability ve…

200 篇论文

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

计算机视觉与模式识别 · 计算机科学 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

A major requirement for credit scoring models is to provide a maximally accurate risk prediction. Additionally, regulators demand these models to be transparent and auditable. Thus, in credit scoring, very simple predictive models such as…

机器学习 · 统计学 2020-09-30 Michael Bücker , Gero Szepannek , Alicja Gosiewska , Przemyslaw Biecek

Interpretability, explainability and transparency are key issues to introducing Artificial Intelligence methods in many critical domains: This is important due to ethical concerns and trust issues strongly connected to reliability,…

机器学习 · 计算机科学 2023-01-25 George A. Vouros

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

计算与语言 · 计算机科学 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

机器学习 · 计算机科学 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

人工智能 · 计算机科学 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

机器学习 · 计算机科学 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

Explainable Artificial Intelligence (XAI) is an emerging research topic of machine learning aimed at unboxing how AI systems' black-box choices are made. This research field inspects the measures and models involved in decision-making and…

人工智能 · 计算机科学 2021-02-04 Guang Yang , Qinghao Ye , Jun Xia

Interpretability is the study of explaining models in understandable terms to humans. At present, interpretability is divided into two paradigms: the intrinsic paradigm, which believes that only models designed to be explained can be…

机器学习 · 计算机科学 2024-11-14 Andreas Madsen , Himabindu Lakkaraju , Siva Reddy , Sarath Chandar

From self-driving vehicles and back-flipping robots to virtual assistants who book our next appointment at the hair salon or at that restaurant for dinner - machine learning systems are becoming increasingly ubiquitous. The main reason for…

机器学习 · 计算机科学 2018-08-16 Milo Honegger

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

人工智能 · 计算机科学 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

人工智能 · 计算机科学 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

计算机视觉与模式识别 · 计算机科学 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Deep learning (DL) models have been popular due to their ability to learn directly from the raw data in an end-to-end paradigm, alleviating the concern of a separate error-prone feature extraction phase. Recent DL-based neuroimaging studies…

机器学习 · 计算机科学 2023-07-20 Md. Mahfuzur Rahman , Vince D. Calhoun , Sergey M. Plis

Recent advancements in AI applications to healthcare have shown incredible promise in surpassing human performance in diagnosis and disease prognosis. With the increasing complexity of AI models, however, concerns regarding their opacity,…

机器学习 · 计算机科学 2023-08-17 Munib Mesinovic , Peter Watkinson , Tingting Zhu

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

计算机视觉与模式识别 · 计算机科学 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

In machine learning (ML), it is in general challenging to provide a detailed explanation on how a trained model arrives at its prediction. Thus, usually we are left with a black-box, which from a scientific standpoint is not satisfactory.…

材料科学 · 物理学 2021-04-22 Luca M. Ghiringhelli

Predictions obtained by, e.g., artificial neural networks have a high accuracy but humans often perceive the models as black boxes. Insights about the decision making are mostly opaque for humans. Particularly understanding the decision…

机器学习 · 计算机科学 2021-01-21 Nadia Burkart , Marco F. Huber

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

人工智能 · 计算机科学 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

机器学习 · 计算机科学 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar