English
Related papers

Related papers: Interpretability of Blackbox Machine Learning Mode…

200 papers

It is commonly believed that increasing the interpretability of a machine learning model may decrease its predictive power. However, inspecting input-output relationships of those models using visual analytics, while treating them as…

Machine Learning · Statistics 2016-06-22 Josua Krause , Adam Perer , Enrico Bertini

As the discipline has evolved, research in machine learning has been focused more and more on creating more powerful neural networks, without regard for the interpretability of these networks. Such "black-box models" yield state-of-the-art…

Machine Learning · Computer Science 2021-09-02 Lachlan O'Neill , Simon Angus , Satya Borgohain , Nader Chmait , David L. Dowe

Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on…

Artificial Intelligence · Computer Science 2024-01-17 Haoyi Xiong , Xuhong Li , Xiaofei Zhang , Jiamin Chen , Xinhao Sun , Yuchen Li , Zeyi Sun , Mengnan Du

The impressive capabilities of deep learning models are often counterbalanced by their inherent opacity, commonly termed the "black box" problem, which impedes their widespread acceptance in high-trust domains. In response, the intersecting…

Machine Learning · Computer Science 2025-09-16 Mitali Raj

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte

The lack of interpretability remains a barrier to the adoption of deep neural networks. Recently, tree regularization has been proposed to encourage deep neural networks to resemble compact, axis-aligned decision trees without significant…

Machine Learning · Computer Science 2020-03-17 Mike Wu , Sonali Parbhoo , Michael Hughes , Ryan Kindle , Leo Celi , Maurizio Zazzi , Volker Roth , Finale Doshi-Velez

As machine learning becomes an important part of many real world applications affecting human lives, new requirements, besides high predictive accuracy, become important. One important requirement is transparency, which has been associated…

Machine Learning · Computer Science 2019-08-01 Tiago Botari , Rafael Izbicki , Andre C. P. L. F. de Carvalho

This paper proposes a new method for interpreting and simplifying a black box model of a deep random forest (RF) using a proposed rule elimination. In deep RF, a large number of decision trees are connected to multiple layers, thereby…

Artificial Intelligence · Computer Science 2020-12-15 Sangwon Kim , Mira Jeong , Byoung Chul Ko

With the long term accumulation of high quality educational data, artificial intelligence has shown excellent performance in knowledge tracing. However, due to the lack of interpretability and transparency of some algorithms, this approach…

Computation and Language · Computer Science 2024-03-13 Yanhong Bai , Jiabao Zhao , Tingjiang Wei , Qing Cai , Liang He

Deep learning (DL) based computer vision (CV) models are generally considered as black boxes due to poor interpretability. This limitation impedes efficient diagnoses or predictions of system failure, thereby precluding the widespread…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Sikai Chen , Jiqian Dong , Runjia Du , Yujie Li , Samuel Labi

Deep Neural Networks (DNNs) do not inherently compute or exhibit empirically-justified task confidence. In mission critical applications, it is important to both understand associated DNN reasoning and its supporting evidence. In this…

Machine Learning · Computer Science 2024-03-14 Paul Ardis , Arjuna Flenner

Deep learning has become the dominant approach for creating high capacity, scalable models across diverse data modalities. However, because these models rely on a large number of learned parameters, tightly couple feature extraction with…

Artificial Intelligence · Computer Science 2026-05-12 Adam Gould , Francesca Toni

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

This paper presents a novel concept learning framework for enhancing model interpretability and performance in visual classification tasks. Our approach appends an unsupervised explanation generator to the primary classifier network and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tanmay Garg , Deepika Vemuri , Vineeth N Balasubramanian

Deep learning methods have shown great promise in many practical applications, ranging from speech recognition, visual object recognition, to text processing. However, most of the current deep learning methods suffer from scalability…

Machine Learning · Statistics 2015-08-31 Yanping Huang , Sai Zhang

Computationally explicit hypotheses of brain function derived from machine learning (ML)-based models have recently revolutionized neuroscience. Despite the unprecedented ability of these artificial neural networks (ANNs) to capture…

Neurons and Cognition · Quantitative Biology 2023-12-12 Kohitij Kar , Simon Kornblith , Evelina Fedorenko

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

Deep neural networks have demonstrated remarkable performance across various domains, yet their decision-making processes remain opaque. Although many explanation methods are dedicated to bringing the obscurity of DNNs to light, they…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Kanglong Fan , Yunqiao Yang , Chen Ma

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

In machine learning algorithm design, there exists a trade-off between the interpretability and performance of the algorithm. In general, algorithms which are simpler and easier for humans to comprehend tend to show worse performance than…

Machine Learning · Computer Science 2024-07-15 Eric M. Vernon , Naoki Masuyama , Yusuke Nojima