English
Related papers

Related papers: An interpretable neural network model through piec…

200 papers

Interpretability and explainability have gained more and more attention in the field of machine learning as they are crucial when it comes to high-stakes decisions and troubleshooting. Since both provide information about predictors and…

Machine Learning · Computer Science 2024-04-26 Benjamin Leblanc , Pascal Germain

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

The importance of explainability in machine learning continues to grow, as both neural-network architectures and the data they model become increasingly complex. Unique challenges arise when a model's input features become high dimensional:…

Machine Learning · Computer Science 2021-12-21 Damien de Mijolla , Christopher Frye , Markus Kunesch , John Mansir , Ilya Feige

Linear approximations to the decision boundary of a complex model have become one of the most popular tools for interpreting predictions. In this paper, we study such linear explanations produced either post-hoc by a few recent methods or…

Machine Learning · Computer Science 2018-01-31 Maruan Al-Shedivat , Avinava Dubey , Eric P. Xing

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

Machine Learning · Computer Science 2020-08-04 Aria Khademi , Vasant Honavar

Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Bor-Shiun Wang , Chien-Yi Wang , Wei-Chen Chiu

Explainability in time series models is crucial for fostering trust, facilitating debugging, and ensuring interpretability in real-world applications. In this work, we introduce Implet, a novel post-hoc explainer that generates accurate and…

Machine Learning · Computer Science 2025-05-14 Fanyu Meng , Ziwen Kan , Shahbaz Rezaei , Zhaodan Kong , Xin Chen , Xin Liu

Artificial neural networks are often very complex and too deep for a human to understand. As a result, they are usually referred to as black boxes. For a lot of real-world problems, the underlying pattern itself is very complicated, such…

Machine Learning · Computer Science 2020-11-26 Yang Li

Graph Neural Networks have been widely applied in critical decision-making areas that demand interpretable predictions, leading to the flourishing development of interpretability algorithms. However, current graph interpretability…

Machine Learning · Computer Science 2024-09-04 Xiaodi Li , Jianfeng Gui , Qian Gao , Haoyuan Shi , Zhenyu Yue

Artificial intelligence (AI) is currently based largely on black-box machine learning models which lack interpretability. The field of eXplainable AI (XAI) strives to address this major concern, being critical in high-stakes areas such as…

Artificial Intelligence · Computer Science 2024-06-26 Sean Tull , Robin Lorenz , Stephen Clark , Ilyas Khan , Bob Coecke

Driven by an increasing need for model interpretability, interpretable models have become strong competitors for black-box models in many real applications. In this paper, we propose a novel type of model where interpretable models compete…

Machine Learning · Computer Science 2019-09-24 Hassan Rafique , Tong Wang , Qihang Lin

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Convolutional neural network (CNN) models have seen advanced improvements in performance in various domains, but lack of interpretability is a major barrier to assurance and regulation during operation for acceptance and deployment of…

Machine Learning · Computer Science 2022-11-02 Wenli Yang , Guan Huang , Renjie Li , Jiahao Yu , Yanyu Chen , Quan Bai , Beyong Kang

As the discipline has evolved, research in machine learning has been focused more and more on creating more powerful neural networks, without regard for the interpretability of these networks. Such "black-box models" yield state-of-the-art…

Machine Learning · Computer Science 2021-09-02 Lachlan O'Neill , Simon Angus , Satya Borgohain , Nader Chmait , David L. Dowe

Interpretability methods are developed to understand the working mechanisms of black-box models, which is crucial to their responsible deployment. Fulfilling this goal requires both that the explanations generated by these methods are…

Computation and Language · Computer Science 2022-05-03 Yilun Zhou , Marco Tulio Ribeiro , Julie Shah

Estimating personalized effects of treatments is a complex, yet pervasive problem. To tackle it, recent developments in the machine learning (ML) literature on heterogeneous treatment effect estimation gave rise to many sophisticated, but…

Machine Learning · Computer Science 2022-06-17 Jonathan Crabbé , Alicia Curth , Ioana Bica , Mihaela van der Schaar

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make…

Machine Learning · Computer Science 2019-06-13 Thibault Laugel , Marie-Jeanne Lesot , Christophe Marsala , Marcin Detyniecki

Machine learning methods can be a valuable aid in the scientific process, but they need to face challenging settings where data come from inhomogeneous experimental conditions. Recent meta-learning methods have made significant progress in…

Machine Learning · Computer Science 2024-03-21 Matthieu Blanke , Marc Lelarge

Deep learning models have achieved remarkable success in different areas of machine learning over the past decade; however, the size and complexity of these models make them difficult to understand. In an effort to make them more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Nicole Meister , Ruth Fong , Olga Russakovsky

Computationally explicit hypotheses of brain function derived from machine learning (ML)-based models have recently revolutionized neuroscience. Despite the unprecedented ability of these artificial neural networks (ANNs) to capture…

Neurons and Cognition · Quantitative Biology 2023-12-12 Kohitij Kar , Simon Kornblith , Evelina Fedorenko