中文
相关论文

相关论文: Stop Explaining Black Box Machine Learning Models …

200 篇论文

Interpretability has become an essential topic for artificial intelligence in some high-risk domains such as healthcare, bank and security. For commonly-used tabular data, traditional methods trained end-to-end machine learning models with…

人工智能 · 计算机科学 2022-08-18 Haixiao Chi , Dawei Wang , Gaojie Cui , Feng Mao , Beishui Liao

Interpretable machine learning has exploded as an area of interest over the last decade, sparked by the rise of increasingly large datasets and deep neural networks. Simultaneously, large language models (LLMs) have demonstrated remarkable…

计算与语言 · 计算机科学 2024-02-06 Chandan Singh , Jeevana Priya Inala , Michel Galley , Rich Caruana , Jianfeng Gao

The increasing availability of large collections of electronic health record (EHR) data and unprecedented technical advances in deep learning (DL) have sparked a surge of research interest in developing DL based clinical decision support…

机器学习 · 计算机科学 2021-12-07 Di Jin , Elena Sergeeva , Wei-Hung Weng , Geeticka Chauhan , Peter Szolovits

Machine learning models are exceptionally effective in capturing complex non-linear relationships of high-dimensional datasets and making accurate predictions. However, their intrinsic ``black-box'' nature makes it difficult to interpret…

等离子体物理 · 物理学 2024-07-29 Tadas Pyragius , Cary Colgan , Hazel Lowe , Filip Janky , Matteo Fontana , Yichen Cai , Graham Naylor

The aim of this article is to understand the problem of "black box" algorithms, an issue inherent to the nascent field of Explainable Artificial Intelligence (XAI). While it is relatively easy to understand something someone explained to…

计算机与社会 · 计算机科学 2026-05-14 Remy Demichelis

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

计算与语言 · 计算机科学 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

In AI and law, systems that are designed for decision support should be explainable when pursuing justice. In order for these systems to be fair and responsible, they should make correct decisions and make them using a sound and transparent…

人工智能 · 计算机科学 2021-05-17 Cor Steging , Silja Renooij , Bart Verheij

Neural networks are among the most accurate supervised learning methods in use today. However, their opacity makes them difficult to trust in critical applications, especially when conditions in training may differ from those in practice.…

机器学习 · 计算机科学 2018-10-03 Andrew Slavin Ross

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

机器学习 · 统计学 2022-02-28 Matthew J. Vowels

As opaque decision systems are being increasingly adopted in almost any application field, issues about their lack of transparency and human readability are a concrete concern for end-users. Amongst existing proposals to associate…

人工智能 · 计算机科学 2022-11-02 Federico Sabbatini , Roberta Calegari

Advanced machine learning models have recently achieved high predictive accuracy for weather and climate prediction. However, these complex models often lack inherent transparency and interpretability, acting as "black boxes" that impede…

大气与海洋物理 · 物理学 2024-03-29 Ruyi Yang , Jingyu Hu , Zihao Li , Jianli Mu , Tingzhao Yu , Jiangjiang Xia , Xuhong Li , Aritra Dasgupta , Haoyi Xiong

ML model design either starts with an interpretable model or a Blackbox and explains it post hoc. Blackbox models are flexible but difficult to explain, while interpretable models are inherently explainable. Yet, interpretable models…

机器学习 · 计算机科学 2023-07-13 Shantanu Ghosh , Ke Yu , Forough Arabshahi , Kayhan Batmanghelich

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

人工智能 · 计算机科学 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

人工智能 · 计算机科学 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

The shift from symbolic AI systems to black-box, sub-symbolic, and statistical ones has motivated a rapid increase in the interest toward explainable AI (XAI), i.e. approaches to make black-box AI systems explainable to human decision…

人工智能 · 计算机科学 2022-10-28 Federico Cabitza , Matteo Cameli , Andrea Campagner , Chiara Natali , Luca Ronzio

Interpretability is the study of explaining models in understandable terms to humans. At present, interpretability is divided into two paradigms: the intrinsic paradigm, which believes that only models designed to be explained can be…

机器学习 · 计算机科学 2024-11-14 Andreas Madsen , Himabindu Lakkaraju , Siva Reddy , Sarath Chandar

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

机器学习 · 计算机科学 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Large Language Models (LLMs) exhibit remarkable capabilities across a spectrum of tasks in financial services, including report generation, chatbots, sentiment analysis, regulatory compliance, investment advisory, financial knowledge…

计算工程、金融与科学 · 计算机科学 2025-06-02 Hariom Tatsat , Ariye Shater

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

机器学习 · 计算机科学 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

Interpretability in machine learning (ML) is crucial for high stakes decisions and troubleshooting. In this work, we provide fundamental principles for interpretable ML, and dispel common misunderstandings that dilute the importance of this…

机器学习 · 计算机科学 2021-09-02 Cynthia Rudin , Chaofan Chen , Zhi Chen , Haiyang Huang , Lesia Semenova , Chudi Zhong