English
Related papers

Related papers: Pay Attention to What and Where? Interpretable Fea…

200 papers

Time series models with recurrent neural networks (RNNs) can have high accuracy but are unfortunately difficult to interpret as a result of feature-interactions, temporal-interactions, and non-linear transformations. Interpretability is…

Machine Learning · Computer Science 2021-09-17 Asif Rahman , Yale Chang , Jonathan Rubin

Eye feature extraction from event-based data streams can be performed efficiently and with low energy consumption, offering great utility to real-world eye tracking pipelines. However, few eye feature extractors are designed to handle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Viet Dung Nguyen , Mobina Ghorbaninejad , Chengyi Ma , Reynold Bailey , Gabriel J. Diaz , Alexander Fix , Ryan J. Suess , Alexander Ororbia

Visual attention mechanisms have proven to be integrally important constituent components of many modern deep neural architectures. They provide an efficient and effective way to utilize visual information selectively, which has shown to be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Siddhesh Khandelwal , Leonid Sigal

In neuroscience, attention has been shown to bidirectionally interact with reinforcement learning (RL) processes. This interaction is thought to support dimensionality reduction of task representations, restricting computations to relevant…

Artificial Intelligence · Computer Science 2020-07-14 Lennart Bramlage , Aurelio Cortese

Small objects are difficult to detect because of their low resolution and small size. The existing small object detection methods mainly focus on data preprocessing or narrowing the differences between large and small objects. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Fan Zhang , Licheng Jiao , Lingling Li , Fang Liu , Xu Liu

We propose Partially Interpretable Estimators (PIE) which attribute a prediction to individual features via an interpretable model, while a (possibly) small part of the PIE prediction is attributed to the interaction of features via a…

Machine Learning · Computer Science 2021-05-07 Tong Wang , Jingyi Yang , Yunyi Li , Boxiang Wang

Explainable AI (XAI) has become critical as transformer-based models are deployed in high-stakes applications including healthcare, legal systems, and financial services, where opacity hinders trust and accountability. Transformers…

Computation and Language · Computer Science 2026-01-22 George Mihaila

Reinforcement learning (RL) has shown an outstanding capability for solving complex computational problems. However, most RL algorithms lack an explicit method that would allow learning from contextual information. Humans use context to…

Machine Learning · Computer Science 2023-10-17 Francisco Munguia-Galeano , Ah-Hwee Tan , Ze Ji

The study of the attribution of input features to the output of neural network models is an active area of research. While numerous Explainable AI (XAI) techniques have been proposed to interpret these models, the systematic and automated…

Computation and Language · Computer Science 2026-03-13 Aria Nourbakhsh , Salima Lamsiyah , Adelaide Danilov , Christoph Schommer

Attribution algorithms are essential for enhancing the interpretability and trustworthiness of deep learning models by identifying key features driving model decisions. Existing frameworks, such as InterpretDL and OmniXAI, integrate…

Machine Learning · Computer Science 2025-05-13 Zhiyu Zhu , Jiayu Zhang , Zhibo Jin , Fang Chen , Jianlong Zhou

Human vision is highly adaptive, efficiently sampling intricate environments by sequentially fixating on task-relevant regions. In contrast, prevailing machine vision models passively process entire scenes at once, resulting in excessive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yulin Wang , Yang Yue , Yang Yue , Huanqian Wang , Haojun Jiang , Yizeng Han , Zanlin Ni , Yifan Pu , Minglei Shi , Rui Lu , Qisen Yang , Andrew Zhao , Zhuofan Xia , Shiji Song , Gao Huang

The accuracy-speed-memory trade-off is always the priority to consider for several computer vision perception tasks. Previous methods mainly focus on a single or small couple of these tasks, such as creating effective data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xinhao Xiang , Simon Dräger , Jiawei Zhang

This paper is a contribution towards interpretability of the deep learning models in different applications of time-series. We propose a temporal attention layer that is capable of selecting the relevant information to perform various…

Computer Vision and Pattern Recognition · Computer Science 2018-06-25 Phongtharin Vinayavekhin , Subhajit Chaudhury , Asim Munawar , Don Joven Agravante , Giovanni De Magistris , Daiki Kimura , Ryuki Tachibana

Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack…

Machine Learning · Computer Science 2025-04-08 Linhui Huang , Sayeri Lala , Niraj K. Jha

The Convolutional Neural Networks (CNNs) generate the feature representation of complex objects by collecting hierarchical and different parts of semantic sub-features. These sub-features can usually be distributed in grouped form in the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Xiang Li , Xiaolin Hu , Jian Yang

Referring Expression Comprehension (REC) aims to localize the target objects specified by free-form natural language descriptions in images. While state-of-the-art methods achieve impressive performance, they perform a dense perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Wei Su , Peihan Miao , Huanzhang Dou , Xi Li

This paper introduces innovative frameworks for visual abstract reasoning, aiming to boost deep learning model performance. It emphasizes the importance of separating abstract concept and reasoning feature extraction processes. The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ruizhuo Song , Beiming Yuan

We propose a regularization scheme for image reconstruction that leverages the power of deep learning while hinging on classic sparsity-promoting models. Many deep-learning-based models are hard to interpret and cumbersome to analyze…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Mehrsa Pourya , Sebastian Neumayer , Michael Unser

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

Decoding brain cognitive states from neuroimaging signals is an important topic in neuroscience. In recent years, deep neural networks (DNNs) have been recruited for multiple brain state decoding and achieved good performance. However, the…

Image and Video Processing · Electrical Eng. & Systems 2021-10-05 Zhoufan Jiang , Yanming Wang , ChenWei Shi , Yueyang Wu , Rongjie Hu , Shishuo Chen , Sheng Hu , Xiaoxiao Wang , Bensheng Qiu