English
Related papers

Related papers: Attention-like feature explanation for tabular dat…

200 papers

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

As an effective data preprocessing step, feature selection has shown its effectiveness to prepare high-dimensional data for many machine learning tasks. The proliferation of high di-mension and huge volume big data, however, has brought…

Machine Learning · Computer Science 2019-03-01 Ning Gui , Danni Ge , Ziyin Hu

Attention networks show promise for both vision and language tasks, by emphasizing relationships between constituent elements through weighting functions. Such elements could be regions in an image output by a region proposal network, or…

Machine Learning · Computer Science 2019-10-07 Chu Wang , Babak Samari , Vladimir Kim , Siddhartha Chaudhuri , Kaleem Siddiqi

In-context learning with attention enables large neural networks to make context-specific predictions by selectively focusing on relevant examples. Here, we adapt this idea to supervised learning procedures such as lasso regression and…

Machine Learning · Statistics 2025-12-11 Erin Craig , Robert Tibshirani

In the field of Explainable AI (XAI), counterfactual (CF) explanations are one prominent method to interpret a black-box model by suggesting changes to the input that would alter a prediction. In real-world applications, the input is…

Machine Learning · Computer Science 2024-10-15 Emmanouil Panagiotou , Manuel Heurich , Tim Landgraf , Eirini Ntoutsi

When training transformers on graph-structured data, incorporating information about the underlying topology is crucial for good performance. Topological masking, a type of relative position encoding, achieves this by upweighting or…

Several explainable AI methods allow a Machine Learning user to get insights on the classification process of a black-box model in the form of local linear explanations. With such information, the user can judge which features are locally…

Machine Learning · Computer Science 2023-02-16 Francesco Lomuscio , Paolo Bajardi , Alan Perotti , Elvio G. Amparore

Visual attention is a mechanism closely intertwined with vision and memory. Top-down information influences visual processing through attention. We designed a neural network model inspired by aspects of human visual attention. This model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Ruoyang Hu , Robert A. Jacobs

Graph-structured data arise naturally in many different application domains. By representing data as graphs, we can capture entities (i.e., nodes) as well as their relationships (i.e., edges) with each other. Many useful insights can be…

Artificial Intelligence · Computer Science 2018-07-24 John Boaz Lee , Ryan A. Rossi , Sungchul Kim , Nesreen K. Ahmed , Eunyee Koh

Explainable AI (XAI) has become critical as transformer-based models are deployed in high-stakes applications including healthcare, legal systems, and financial services, where opacity hinders trust and accountability. Transformers…

Computation and Language · Computer Science 2026-01-22 George Mihaila

Apart from the high accuracy of machine learning models, what interests many researchers in real-life problems (e.g., fraud detection, credit scoring) is to find hidden patterns in data; particularly when dealing with their challenging…

Traditional methods for tabular classification usually rely on supervised learning from scratch, which requires extensive training data to determine model parameters. However, a novel approach called Prior-Data Fitted Networks (TabPFN) has…

Machine Learning · Computer Science 2024-06-12 Quangao Liu , Wei Yang , Chen Liang , Longlong Pang , Zhuozhang Zou

Many machine learning algorithms for tabular data produce black-box models, which prevent users from understanding the rationale behind the model predictions. In their unconstrained form, graph neural networks fall into this category, and…

Machine Learning · Computer Science 2024-08-15 Amr Alkhatib , Henrik Boström

We present Learning to Explain (LTX), a model-agnostic framework designed for providing post-hoc explanations for vision models. The LTX framework introduces an "explainer" model that generates explanation maps, highlighting the crucial…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Oren Barkan , Yuval Asher , Amit Eshel , Yehonatan Elisha , Noam Koenigstein

We present an attention-based spatial graph convolution (AGC) for graph neural networks (GNNs). Existing AGCs focus on only using node-wise features and utilizing one type of attention function when calculating attention weights. Instead,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Li , Yuichi Tanaka

Data repair is a common and crucial step in many frameworks today, as applications may use data from different sources and of different levels of credibility. Thus, this step has been the focus of many works, proposing diverse approaches.…

Databases · Computer Science 2020-07-10 Daniel Deutch , Nave Frost , Amir Gilad , Oren Sheffer

In this paper, we address referring expression comprehension: localizing an image region described by a natural language expression. While most recent work treats expressions as a single unit, we propose to decompose them into three modular…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Licheng Yu , Zhe Lin , Xiaohui Shen , Jimei Yang , Xin Lu , Mohit Bansal , Tamara L. Berg

Effective analysis of tabular data still poses a significant problem in deep learning, mainly because features in tabular datasets are often heterogeneous and have different levels of relevance. This work introduces TabSeq, a novel…

Machine Learning · Computer Science 2024-10-22 Al Zadid Sultan Bin Habib , Kesheng Wang , Mary-Anne Hartley , Gianfranco Doretto , Donald A. Adjeroh

Complex black-box machine learning models are regularly used in critical decision-making domains. This has given rise to several calls for algorithmic explainability. Many explanation algorithms proposed in literature assign importance to…

Machine Learning · Computer Science 2021-03-30 Neel Patel , Martin Strobel , Yair Zick

Feature fusion, the combination of features from different layers or branches, is an omnipresent part of modern network architectures. It is often implemented via simple operations, such as summation or concatenation, but this might not be…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yimian Dai , Fabian Gieseke , Stefan Oehmcke , Yiquan Wu , Kobus Barnard