English
Related papers

Related papers: Attention-like feature explanation for tabular dat…

200 papers

Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Xi Li , Huimin Ma , Hongbing Ma , Yidong Wang

Understanding why a model makes a certain prediction can be as crucial as the prediction's accuracy in many applications. However, the highest accuracy for large modern datasets is often achieved by complex models that even experts struggle…

Artificial Intelligence · Computer Science 2017-11-28 Scott Lundberg , Su-In Lee

Counterfactual Explanations are becoming a de-facto standard in post-hoc interpretable machine learning. For a given classifier and an instance classified in an undesired class, its counterfactual explanation corresponds to small…

Machine Learning · Computer Science 2024-01-17 Veronica Piccialli , Dolores Romero Morales , Cecilia Salvatore

We study the robustness of global post-hoc explanations for predictive models trained on tabular data. Effects of predictor features in black-box supervised learning are an essential diagnostic tool for model debugging and scientific…

Machine Learning · Computer Science 2025-07-29 Hubert Baniecki , Giuseppe Casalicchio , Bernd Bischl , Przemyslaw Biecek

Deep neural networks learn fragile "shortcut" features, rendering them difficult to interpret (black box) and vulnerable to adversarial attacks. This paper proposes semantic features as a general architectural solution to this problem. The…

Machine Learning · Computer Science 2024-04-18 Maciej Satkiewicz

Attention is a state of arousal capable of dealing with limited processing bottlenecks in human beings by focusing selectively on one piece of information while ignoring other perceptible information. For decades, concepts and functions of…

Machine Learning · Computer Science 2021-12-14 Alana Santana , Esther Colombini

Evidence-based fact checking aims to verify the truthfulness of a claim against evidence extracted from textual sources. Learning a representation that effectively captures relations between a claim and evidence can be challenging. Recent…

Computation and Language · Computer Science 2021-06-03 Canasai Kruengkrai , Junichi Yamagishi , Xin Wang

Automated visualization recommendation facilitates the rapid creation of effective visualizations, which is especially beneficial for users with limited time and limited knowledge of data visualization. There is an increasing trend in…

Human-Computer Interaction · Computer Science 2023-10-19 Songheng Zhang , Haotian Li , Huamin Qu , Yong Wang

Attention Mechanism is a widely used method for improving the performance of convolutional neural networks (CNNs) on computer vision tasks. Despite its pervasiveness, we have a poor understanding of what its effectiveness stems from. It is…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Xiang Ye , Zihang He , Heng Wang , Yong Li

We develop new algorithms for simultaneous learning of multiple tasks (e.g., image classification, depth estimation), and for adapting to unseen task/domain distributions within those high-level tasks (e.g., different environments). First,…

Machine Learning · Computer Science 2020-06-16 Kiran Lekkala , Laurent Itti

Learning to capture long-range relations is fundamental to image/video recognition. Existing CNN models generally rely on increasing depth to model such relations which is highly inefficient. In this work, we propose the "double attention…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Yunpeng Chen , Yannis Kalantidis , Jianshu Li , Shuicheng Yan , Jiashi Feng

Deep learning technology has made great progress in multi-view 3D reconstruction tasks. At present, most mainstream solutions establish the mapping between views and shape of an object by assembling the networks of 2D encoder and 3D decoder…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhenwei Zhu , Liying Yang , Xuxin Lin , Chaohao Jiang , Ning Li , Lin Yang , Yanyan Liang

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

In recent years, there has been a growing interest in explainable AI methods. In addition to making accurate predictions, we also want to understand what the model's decision is based on. One of the fundamental levels of interpretability is…

Machine Learning · Computer Science 2026-03-11 Patryk Marszałek , Kamil Książek , Oleksii Furman , Ulvi Movsum-zada , Przemysław Spurek , Marek Śmieja

Complex black-box predictive models may have high performance, but lack of interpretability causes problems like lack of trust, lack of stability, sensitivity to concept drift. On the other hand, achieving satisfactory accuracy of…

Machine Learning · Computer Science 2020-02-12 Alicja Gosiewska , Przemyslaw Biecek

Mechanistic interpretability strives to explain model behavior in terms of bottom-up primitives. The leading paradigm is to express hidden states as a sparse linear combination of basis vectors, called features. However, this only…

Computation and Language · Computer Science 2025-10-22 Dan Friedman , Adithya Bhaskar , Alexander Wettig , Danqi Chen

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

Linear layers in neural networks (NNs) trained by gradient descent can be expressed as a key-value memory system which stores all training datapoints and the initial weights, and produces outputs using unnormalised dot attention over the…

Machine Learning · Computer Science 2022-06-20 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Modern instance-based model-agnostic explanation methods (LIME, SHAP, L2X) are of great use in data-heavy industries for model diagnostics, and for end-user explanations. These methods generally return either a weighting or subset of input…

Machine Learning · Computer Science 2019-12-03 Matt Chapman-Rounds , Marc-Andre Schulz , Erik Pazos , Konstantinos Georgatzis

For many computer vision applications, such as image description and human identification, recognizing the visual attributes of humans is an essential yet challenging problem. Its challenges originate from its multi-label nature, the large…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Nikolaos Sarafianos , Xiang Xu , Ioannis A. Kakadiaris