English
Related papers

Related papers: InterpNET: Neural Introspection for Interpretable …

200 papers

Imagine experiencing a crash as the passenger of an autonomous vehicle. Wouldn't you want to know why it happened? Current end-to-end optimizable deep neural networks (DNNs) in 3D detection, multi-object tracking, and motion forecasting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Benjamin Thérien , Krzysztof Czarnecki

Even though convolutional neural networks have become the method of choice in many fields of computer vision, they still lack interpretability and are usually designed manually in a cumbersome trial-and-error process. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Maria Ximena Bastidas Rodriguez , Adrien Gruson , Luisa F. Polania , Shin Fujieda , Flavio Prieto Ortiz , Kohei Takayama , Toshiya Hachisuka

This paper proposes a new paradigm for learning a set of independent logical rules in disjunctive normal form as an interpretable model for classification. We consider the problem of learning an interpretable decision rule set as training a…

Machine Learning · Computer Science 2021-03-15 Litao Qiao , Weijia Wang , Bill Lin

Deep neural network models have been proven to be very successful in image classification tasks, also for medical diagnosis, but their main concern is its lack of interpretability. They use to work as intuition machines with high…

Machine Learning · Computer Science 2019-04-26 Jordi de la Torre , Aida Valls , Domenec Puig

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

As artificial intelligence increasingly drives critical decisions, the ability to genuinely explain how neural networks make predictions is essential for trust. Yet, most current explanation methods offer post-hoc rationalizations rather…

Machine Learning · Computer Science 2026-05-08 Corentin Lobet , Francesca Chiaromonte

In complex inferential tasks like question answering, machine learning models must confront two challenges: the need to implement a compositional reasoning process, and, in many applications, the need for this reasoning process to be…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Ronghang Hu , Jacob Andreas , Trevor Darrell , Kate Saenko

Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack…

Machine Learning · Computer Science 2025-04-08 Linhui Huang , Sayeri Lala , Niraj K. Jha

Despite their great success in recent years, deep neural networks (DNN) are mainly black boxes where the results obtained by running through the network are difficult to understand and interpret. Compared to e.g. decision trees or bayesian…

Machine Learning · Computer Science 2019-07-02 Jan Niclas Reimann , Andreas Schwung

Model interpretability is a requirement in many applications in which crucial decisions are made by users relying on a model's outputs. The recent movement for "algorithmic fairness" also stipulates explainability, and therefore…

Machine Learning · Computer Science 2018-08-21 Xuan Liu , Xiaoguang Wang , Stan Matwin

In human-centric settings like education or healthcare, model accuracy and model explainability are key factors for user adoption. Towards these two goals, intrinsically interpretable deep learning models have gained popularity, focusing on…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy , Syrielle Montariol , Julian Blackwell , Jibril Frej , Martin Jaggi , Tanja Käser

Deep convolutional neural networks have proven their effectiveness, and have been acknowledged as the most dominant method for image classification. However, a severe drawback of deep convolutional neural networks is poor explainability.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Bin Wang , Wenbin Pei , Bing Xue , Mengjie Zhang

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

Traditionally, the vision community has devised algorithms to estimate the distance between an original image and images that have been subject to perturbations. Inspiration was usually taken from the human visual perceptual system and how…

Machine Learning · Computer Science 2020-11-18 Alexander Hepburn , Valero Laparra , Jesús Malo , Ryan McConville , Raul Santos-Rodriguez

We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e.g., in ProtoPNet. While earlier approaches associate every class with multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Hamed Ayoobi , Nico Potyka , Francesca Toni

In meta-learning approaches, it is difficult for a practitioner to make sense of what kind of representations the model employs. Without this ability, it can be difficult to both understand what the model knows as well as to make meaningful…

Machine Learning · Computer Science 2022-04-05 Pedro Sandoval-Segura , Wallace Lawson

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

We present an interpretable neural network approach to predicting and understanding politeness in natural language requests. Our models are based on simple convolutional neural networks directly on raw text, avoiding any manual…

Computation and Language · Computer Science 2016-10-11 Malika Aubakirova , Mohit Bansal

Deep neural networks have demonstrated remarkable performance in many data-driven and prediction-oriented applications, and sometimes even perform better than humans. However, their most significant drawback is the lack of interpretability,…

Machine Learning · Computer Science 2023-02-22 Jiahui Li , Kun Kuang , Lin Li , Long Chen , Songyang Zhang , Jian Shao , Jun Xiao

We propose a new interpretability method for neural networks, which is based on a novel mathematico-philosophical theory of reasons. Our method computes a vector for each neuron, called its reasons vector. We then can compute how strongly…

Machine Learning · Computer Science 2025-05-21 Levin Hornischer , Hannes Leitgeb