English
Related papers

Related papers: Compositionality Unlocks Deep Interpretable Models

200 papers

Neural architectures are the foundation for improving performance of deep neural networks (DNNs). This paper presents deep compositional grammatical architectures which harness the best of two worlds: grammar models and DNNs. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xilai Li , Xi Song , Tianfu Wu

It has long been conjectured that hypotheses spaces suitable for data that is compositional in nature, such as text or images, may be more efficiently represented with deep hierarchical networks than with shallow ones. Despite the vast…

Neural and Evolutionary Computing · Computer Science 2016-10-18 Nadav Cohen , Or Sharir , Amnon Shashua

Even though convolutional neural networks have become the method of choice in many fields of computer vision, they still lack interpretability and are usually designed manually in a cumbersome trial-and-error process. This paper aims at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Maria Ximena Bastidas Rodriguez , Adrien Gruson , Luisa F. Polania , Shin Fujieda , Flavio Prieto Ortiz , Kohei Takayama , Toshiya Hachisuka

We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and…

Machine Learning · Computer Science 2020-12-10 Sercan O. Arik , Tomas Pfister

Imagine experiencing a crash as the passenger of an autonomous vehicle. Wouldn't you want to know why it happened? Current end-to-end optimizable deep neural networks (DNNs) in 3D detection, multi-object tracking, and motion forecasting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Benjamin Thérien , Krzysztof Czarnecki

This paper integrates deep neural networks (DNNs) into structural economic models to increase flexibility and capture rich heterogeneity while preserving interpretability. Economic structure and machine learning are complements in empirical…

Econometrics · Economics 2025-04-28 Max H. Farrell , Tengyuan Liang , Sanjog Misra

The field of computational pathology has witnessed great advancements since deep neural networks have been widely applied. These networks usually require large numbers of annotated data to train vast parameters. However, it takes…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yixiao Zhang , Adam Kortylewski , Qing Liu , Seyoun Park , Benjamin Green , Elizabeth Engle , Guillermo Almodovar , Ryan Walk , Sigfredo Soto-Diaz , Janis Taube , Alex Szalay , Alan Yuille

We propose a highly structured neural network architecture for semantic segmentation with an extremely small model size, suitable for low-power embedded and mobile platforms. Specifically, our architecture combines i) a Haar wavelet-based…

Computer Vision and Pattern Recognition · Computer Science 2017-06-19 Michael Tschannen , Lukas Cavigelli , Fabian Mentzer , Thomas Wiatowski , Luca Benini

The development of efficient machine learning models for molecular systems representation is becoming crucial in scientific research. We introduce TensorNet, an innovative O(3)-equivariant message-passing neural network architecture that…

Machine Learning · Computer Science 2023-10-31 Guillem Simeon , Gianni de Fabritiis

Combining additive models and neural networks allows to broaden the scope of statistical regression and extend deep learning-based approaches by interpretable structured additive predictors at the same time. Existing attempts uniting the…

Machine Learning · Statistics 2022-07-12 David Rügamer , Chris Kolb , Nadja Klein

Complex tables with multi-level headers, merged cells and heterogeneous layouts pose persistent challenges for LLMs in both understanding and reasoning. Existing approaches typically rely on table linearization or normalized grid modeling.…

Computation and Language · Computer Science 2026-02-03 Bin Cao , Huixian Lu , Chenwen Ma , Ting Wang , Ruizhe Li , Jing Fan

Our proposed deeply-supervised nets (DSN) method simultaneously minimizes classification error while making the learning process of hidden layers direct and transparent. We make an attempt to boost the classification performance by studying…

Machine Learning · Statistics 2017-04-26 Chen-Yu Lee , Saining Xie , Patrick Gallagher , Zhengyou Zhang , Zhuowen Tu

Modelling compositionality has been a longstanding area of research in the field of vector space semantics. The categorical approach to compositionality maps grammar onto vector spaces in a principled way, but comes under fire for requiring…

Computation and Language · Computer Science 2019-01-31 Martha Lewis

Deep neural networks (DNNs) have delivered a remarkable performance in many tasks of computer vision. However, over-parameterized representations of popular architectures dramatically increase their computational complexity and storage…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Chang Nie , Huan Wang , Lu Zhao

We introduce a new family of neural network models called Convolutional Dynamic Alignment Networks (CoDA Nets), which are performant classifiers with a high degree of inherent interpretability. Their core building blocks are Dynamic…

Machine Learning · Statistics 2024-01-17 Moritz Böhle , Mario Fritz , Bernt Schiele

Nonlinear methods such as Deep Neural Networks (DNNs) are the gold standard for various challenging machine learning problems, e.g., image classification, natural language processing or human action recognition. Although these methods…

Machine Learning · Computer Science 2017-11-15 Grégoire Montavon , Sebastian Bach , Alexander Binder , Wojciech Samek , Klaus-Robert Müller

This paper introduces an Interpretable Neural Network (INN) incorporating spatial information to tackle the opaque parameterization process of random weighted neural networks. The INN leverages spatial information to elucidate the…

Machine Learning · Computer Science 2024-04-16 Jing Nan , Wei Dai

Deep networks for Monocular Depth Estimation (MDE) have achieved promising performance recently and it is of great importance to further understand the interpretability of these networks. Existing methods attempt to provide posthoc…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Zunzhi You , Yi-Hsuan Tsai , Wei-Chen Chiu , Guanbin Li

With the widespread applications of deep convolutional neural networks (DCNNs), it becomes increasingly important for DCNNs not only to make accurate predictions but also to explain how they make their decisions. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Xinrui Cui , Dan Wang , Z. Jane Wang

To tackle interpretability in deep learning, we present a novel framework to jointly learn a predictive model and its associated interpretation model. The interpreter provides both local and global interpretability about the predictive…

Machine Learning · Computer Science 2022-02-24 Jayneel Parekh , Pavlo Mozharovskyi , Florence d'Alché-Buc