English
Related papers

Related papers: Seeking Interpretability and Explainability in Bin…

200 papers

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

Neural networks are powerful tools for cognitive modeling due to their flexibility and emergent properties. However, interpreting their learned representations remains challenging due to their sub-symbolic semantics. In this work, we…

Machine Learning · Computer Science 2026-04-07 Andrew Nam , Declan Campbell , Thomas Griffiths , Jonathan Cohen , Sarah-Jane Leslie

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representations for deep neural networks. While hard constraining…

Machine Learning · Computer Science 2015-11-20 Zhirong Wu , Dahua Lin , Xiaoou Tang

While the deployment of neural networks, yielding impressive results, becomes more prevalent in various applications, their interpretability and understanding remain a critical challenge. Network inversion, a technique that aims to…

Machine Learning · Computer Science 2024-02-20 Pirzada Suhail , Supratik Chakraborty , Amit Sethi

GNNs are powerful models based on node representation learning that perform particularly well in many machine learning problems related to graphs. The major obstacle to the deployment of GNNs is mostly a problem of societal acceptability…

Machine Learning · Computer Science 2024-06-18 Luca Veyrin-Forrer , Ataollah Kamal , Stefan Duffner , Marc Plantevit , Céline Robardet

Binary Neural Networks (BNNs) are receiving an upsurge of attention for bringing power-hungry deep learning towards edge devices. The traditional wisdom in this space is to employ sign() for binarizing featuremaps. We argue and illustrate…

Machine Learning · Computer Science 2022-10-26 Sieger Falkena , Hadi Jamali-Rad , Jan van Gemert

Attention networks have proven to be an effective approach for embedding categorical inference within a deep neural network. However, for many tasks we may want to model richer structural dependencies without abandoning end-to-end training.…

Computation and Language · Computer Science 2017-02-17 Yoon Kim , Carl Denton , Luong Hoang , Alexander M. Rush

Efficient inference of Deep Neural Networks (DNNs) is essential to making AI ubiquitous. Two important algorithmic techniques have shown promise for enabling efficient inference - sparsity and binarization. These techniques translate into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Sachit Kuhar , Alexey Tumanov , Judy Hoffman

Although neural networks can achieve very high predictive performance on various different tasks such as image recognition or natural language processing, they are often considered as opaque "black boxes". The difficulty of interpreting the…

Machine Learning · Statistics 2020-01-22 Enguerrand Horel , Virgile Mison , Tao Xiong , Kay Giesecke , Lidia Mangu

Shapley values are ubiquitous in interpretable Machine Learning due to their strong theoretical background and efficient implementation in the SHAP library. Computing these values previously induced an exponential cost with respect to the…

Machine Learning · Computer Science 2022-12-06 Gabriel Laberge , Yann Pequignot

Interpretability is central for scientific machine learning, as understanding \emph{why} models make predictions enables hypothesis generation and validation. While tabular foundation models show strong performance, existing explanation…

Machine Learning · Computer Science 2026-04-01 Luan Borges Teodoro Reis Sena , Francisco Galuppo Azevedo

Network binarization is a promising hardware-aware direction for creating efficient deep models. Despite its memory and computational advantages, reducing the accuracy gap between binary models and their real-valued counterparts remains an…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Recent years have seen a growing interest in methods for predicting an unknown variable of interest, such as a subject's diagnosis, from medical images depicting its anatomical-functional effects. Methods based on discriminative modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Chiara Mauri , Stefano Cerri , Oula Puonti , Mark Mühlau , Koen Van Leemput

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Introduction: Machine learning provides fundamental tools both for scientific research and for the development of technologies with significant impact on society. It provides methods that facilitate the discovery of regularities in data and…

Machine Learning · Computer Science 2019-03-12 Andrea Ceni , Peter Ashwin , Lorenzo Livi

Based on the assumption that there exists a neural network that efficiently represents a set of Boolean functions between all binary inputs and outputs, we propose a process for developing and deploying neural networks whose weight…

Machine Learning · Computer Science 2020-02-25 Minje Kim , Paris Smaragdis

In the realm of human activity recognition (HAR), the integration of explainable Artificial Intelligence (XAI) emerges as a critical necessity to elucidate the decision-making processes of complex models, fostering transparency and trust.…

Artificial Intelligence · Computer Science 2024-08-22 Yiran Huang , Yexu Zhou , Haibin Zhao , Till Riedel , Michael Beigl